Sampoorna Consultants Pvt. Ltd
This listing was posted on hirist.
Senior Data Engineer - Python/Spark (4-8 yrs) Mumbai (Analytics & Data Science)
Location:
Mumbai
Description:
Key Responsibilities : - Design, build, and maintain scalable and efficient data pipelines.- Implement the complete ELT process to enhance our data platform's performance and reliability.- Collaborate with cross-functional teams to gather requirements and deliver high-quality data solutions.- Optimize data flow and collection to improve data accuracy and utility.- Ensure best practices in data management and security are followed.Requirements & Experience : - You will have proven experience as a Data Engineer or in a similar role, with a strong understanding of data architectures and familiarity with data design patterns- You will be a SQL ninja, capable of crafting complex analytical and transformation queries that are highly performant- Your second preferred language will be Python next SQL- Experience with cloud services (AWS, Azure, Google Cloud) and understanding of their data-related services- Knowledge of modern data stack tools (e.g., DBT, DuckDB, Dagster, BigQuery, Redshift)- Excellent problem-solving skills and the ability to work independently or as part of a team- Strong communication skills and proficiency in EnglishTechnical Qualifications & Skills : - Experience in building and maintaining real-time data pipelines.- Minimum experience using the following tech stack- dbt - 5yrs- SQL > 5yrs- SQLSpark > 5yrs- Python at least 3yrs- Dagster/Airflow - 2 yrsPreferred but not mandatory :- Kubernetes and Terraform- CI/CD - Github actions, CircleCI- Datadog / Cloudwatch - Logging- Prior work with stream-processing systems (e.g., Kafka, Kinesis).- Exposure to Trino, Dagster, Cubejs, metabase/looker will be advantageous (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Senior Data Engineer - Python/Spark (4-8 yrs) Mumbai (Analytics & Data Science)
Senior Data Engineer - Python/Spark (4-8 yrs) Mumbai (Analytics & Data Science) is a Engineering Engineer Job at Sampoorna Consultants located in India. Find other listings like Senior Data Engineer - Python/Spark (4-8 yrs) Mumbai (Analytics & Data Science) by searching Oodle for Engineering Engineer Jobs.
Senior Data Engineer - Python/Spark (4-8 yrs) Mumbai (Analytics & Data Science) is a Engineering Engineer Job at Sampoorna Consultants located in India. Find other listings like Senior Data Engineer - Python/Spark (4-8 yrs) Mumbai (Analytics & Data Science) by searching Oodle for Engineering Engineer Jobs.