Sampoorna Consultants Pvt. Ltd
This listing was posted on hirist.
Lead Data Engineer - SQL/Spark (4-8 yrs) Mumbai (Analytics & Data Science)
Location:
Mumbai
Description:
Client is looking out for a technical delivery leader on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions.The role will drive the development of data processing frameworks and architectural approaches that scale to handle the business's growing demands.This hands-on role requires technical expertise to deliver data and analytical services, including data ingestion, transformation, storage, and reporting and strives to continuously develop new and improved data engineering capabilities.The key accountabilities:- Design data solutions to meet business, technical and user requirements. This includes building modern data pipelines that meet functional/non-functional business requirements and provide end-to-end data solutions- Participate in proofs-of-concept on platform innovation, and effectively transition and scale those concepts into production at scale through, engineering, deployment and commercialisation- Contribute to ongoing management of the platform, including platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues- Identify, design, and implement process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability- Technical ownership for data and data pipelines to ensure compliance with data standards, architectural standards, and achievement of business requirements- Build a strong understanding of platform architecture and the best way to leverage it to achieve effective outcomes for a given project- Support compliance with data, information and security management requirementsTechnical qualifications & skills:- Experience in building and maintaining real-time data pipelines.- Expected experience using the following tech stack:1. dbt2. SQL3. SQLSpark4. Python5. Dagster/AirflowPreferred but not mandatory:- Kubernetes and Terraform- CI/CD - Github actions, CircleCI- Datadog / Cloudwatch - Logging- Prior work with stream-processing systems (e.g., Kafka, Kinesis).- Exposure to Trino, Dagster, Cubejs, metabase/looker will be advantageo (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Lead Data Engineer - SQL/Spark (4-8 yrs) Mumbai (Analytics & Data Science)
Lead Data Engineer - SQL/Spark (4-8 yrs) Mumbai (Analytics & Data Science) is a Engineering Engineer Job at Sampoorna Consultants located in India. Find other listings like Lead Data Engineer - SQL/Spark (4-8 yrs) Mumbai (Analytics & Data Science) by searching Oodle for Engineering Engineer Jobs.
Lead Data Engineer - SQL/Spark (4-8 yrs) Mumbai (Analytics & Data Science) is a Engineering Engineer Job at Sampoorna Consultants located in India. Find other listings like Lead Data Engineer - SQL/Spark (4-8 yrs) Mumbai (Analytics & Data Science) by searching Oodle for Engineering Engineer Jobs.