Back
India   India   Engineer   Pro5.ai -

Lead Data Engineer - Data Pipeline (5-7 yrs) Anywhere in India/Multiple | Engineer in Engineering 1

Pro5.ai (formerly Mangtas)

This listing was posted on hirist.

Lead Data Engineer - Data Pipeline (5-7 yrs) Anywhere in India/Multiple

Location:
Anywhere in India/Multiple Locations
Description:

Job Description :Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions. The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business's growing demands.This hands-on role requires technical expertise to deliver data and analytical services, including data ingestion, transformation, storage, and reporting and strives to continuously develop new and improved data engineering capabilities.Key Accountabilities :- Design data solutions to meet business, technical and user requirements.- This includes building modern data pipelines that meet functional/non-functional business requirements and provide end-to-end data solutions.- Participate in proofs-of-concept on platform innovation, and effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialisation.- Contribute to ongoing management of the platform, including platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues.- Identify, design, and implement process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability.- Technical ownership for data and data pipelines to ensure compliance with data standards, architectural standards, and achievement of business requirements.- Build a strong understanding of platform architecture and the best way to leverage it to achieve effective outcomes for a given project.- Support compliance with data, information and security management requirements. Tech stack :- A strong understanding and experience across modern data stacks airbyte/melanto/AWS DMS/AWS App flow, Apache Kafka/Aws Kinesis, Postgres / AWS redshift, DuckDB, DBT, Trino, / Athena, Clickhouse, cubeJs, metabase / looker / AWS Quicksight.- AWS platform networking, IAM, security, EKS.- Understand and read Elixir, Python, Typescript.- Proficient in Spark, SQL, Python, EKS / Kubernetes / Terraform. (ref:hirist.tech)
Education/experience:
2 To 5 Years
Company:
Pro5.ai
Posted:
May 23 on hirist
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
  • Always meet the employer in person.
  • Avoid sharing sensitive personal and financial information.
  • Avoid employment offers that require a deposit or investment.

To learn more, visit the Safety Center or click here to report this listing.

More About this Listing: Lead Data Engineer - Data Pipeline (5-7 yrs) Anywhere in India/Multiple
Lead Data Engineer - Data Pipeline (5-7 yrs) Anywhere in India/Multiple is a Engineering Engineer Job at Pro5.ai located in India. Find other listings like Lead Data Engineer - Data Pipeline (5-7 yrs) Anywhere in India/Multiple by searching Oodle for Engineering Engineer Jobs.