Back
India   India   Engineer   ARR Recruitment Solutions -

Azure Databricks Engineer - DataLake/Data Pipeline (5-10 yrs) Bangalore | Engineer in Engineering 1

ARR Recruitment Solutions

This listing was posted on hirist.

Azure Databricks Engineer - DataLake/Data Pipeline (5-10 yrs) Bangalore

Share
Tools
Location:
Bangalore
Description:

Azure Databricks Engineer About the Role :- We are seeking a highly skilled Azure Databricks Engineer to join our team and play a vital role in developing and maintaining our big data processing pipelines.- This role is ideal for a candidate with extensive experience in Azure data services and a strong understanding of Apache Spark for large-scale data processing.Responsibilities :- Design, develop, and implement efficient and scalable data processing pipelines using Apache Spark on Azure Databricks.- Collaborate with data engineers, data scientists, and other stakeholders to understand data requirements and translate them into technical solutions.- Leverage Azure Data Factory to orchestrate data movement and integration between various Azure data services (Data Lake, Synapse, SQL Database, etc. ).- Utilize SQL and Python/PySpark for data manipulation, transformation, and analysis.- Implement unit and integration tests to ensure the quality and reliability of data pipelines.- Configure and manage Azure Databricks clusters for optimal performance and resource utilization.- Integrate data pipelines with Azure DevOps for continuous integration and continuous delivery (CI/CD).- Monitor and troubleshoot data pipelines to identify and resolve issues proactively.- Stay up-to-date with the latest advancements in Azure Databricks, Apache Spark, and related technologies.- Participate in code reviews and knowledge sharing sessions with the team.Qualifications:- 5-10 years of experience in data engineering with a focus on big data processing.- In-depth knowledge of Azure data services, including Azure Databricks, Data Factory, Data Lake, and Synapse.- Proven experience in developing and deploying large-scale data processing pipelines using Apache Spark.- Proficiency in SQL and Python/PySpark for data manipulation and analysis.- Experience with CI/CD methodologies and Azure DevOps is a plus.- Familiarity with data governance tools like Azure Purview or Collibra Unity Catalog (a plus).- Excellent problem-solving and analytical skills.- Strong communication and collaboration skills. - Ability to work independently and as part of a team. (ref:hirist.tech)
Education/experience:
2 To 5 Years
Company:
ARR Recruitment Solutions
Posted:
April 27 on hirist
Share
Tools
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
  • Always meet the employer in person.
  • Avoid sharing sensitive personal and financial information.
  • Avoid employment offers that require a deposit or investment.

To learn more, visit the Safety Center or click here to report this listing.

More About this Listing: Azure Databricks Engineer - DataLake/Data Pipeline (5-10 yrs) Bangalore
Azure Databricks Engineer - DataLake/Data Pipeline (5-10 yrs) Bangalore is a Engineering Engineer Job at ARR Recruitment Solutions located in India. Find other listings like Azure Databricks Engineer - DataLake/Data Pipeline (5-10 yrs) Bangalore by searching Oodle for Engineering Engineer Jobs.