Techno Wise
This listing was posted on hirist.
Senior Azure Data Engineer - ETL/Databricks (5-8 yrs) Mumbai/Bangalore
Location:
Mumbai/Bangalore
Description:
Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and reliability.4. Work closely with cloud-based services, particularly Azure or AWS, to deploy and manage data solutions in the cloud environment.5. Implement data quality and data governance best practices to ensure the accuracy and reliability of the data.6. Monitor and troubleshoot data pipelines, resolving issues promptly to minimize downtime and data loss.7. Stay updated with the latest industry trends and technologies related to data engineering, Databricks, PySpark, and cloud platforms.8. Collaborate with cross-functional teams to integrate data engineering solutions into various applications and systems.9. Document data engineering processes, architectures, and configurations for reference and knowledge sharing.10. Provide technical guidance and mentorship to junior data engineers in the team.Requirements :Responsibilities :- Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services.- Utilize Databricks for big data analytics and real-time data processing, ensuring optimal performance and efficiency.- Collaborate with data architects to design and implement effective data models and architectures to support business requirements.- Implement ETL processes for data extraction, transformation, and loading, ensuring the integrity and quality of the data.- Integrate data from various sources, ensuring compatibility, accuracy, and adherence to data governance standards.- Identify and address performance bottlenecks in data pipelines, optimizing for speed, reliability, and scalability.- Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver effective solutions.- Conduct code reviews, enforce best practices in coding and documentation, and mentor junior team members.Education :- Bachelor's or master's degree in Computer Science, Information Systems, or a related field.Experience :- Minimum of 6 years of hands-on experience as a Data Engineer, with a focus on Azure Data Engineering and Databricks.Technical Skills :- Proficiency in Azure Data Factory, Azure Databricks, SQL, Python, and ETL processes.- Solid understanding of data modelling, data warehousing, and big data concepts. (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Senior Azure Data Engineer - ETL/Databricks (5-8 yrs) Mumbai/Bangalore
Senior Azure Data Engineer - ETL/Databricks (5-8 yrs) Mumbai/Bangalore is a Engineering Engineer Job at Techno Wise located in India. Find other listings like Senior Azure Data Engineer - ETL/Databricks (5-8 yrs) Mumbai/Bangalore by searching Oodle for Engineering Engineer Jobs.
Senior Azure Data Engineer - ETL/Databricks (5-8 yrs) Mumbai/Bangalore is a Engineering Engineer Job at Techno Wise located in India. Find other listings like Senior Azure Data Engineer - ETL/Databricks (5-8 yrs) Mumbai/Bangalore by searching Oodle for Engineering Engineer Jobs.