Infiniti Research
This listing was posted on hirist.
Azure Data Engineer - Databricks/Data Factory (4-6 yrs) Anywhere in
Location:
Anywhere in India/Multiple Locations
Description:
About Quantzig:. Quantzig is a global analytics & advisory firm with offices in the US, UK, Canada, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding, machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is built and operated by high-performance champions. If you have what it takes to be the champion with business and functional skills to take ownership of an entire project end-to-end, help build a team with great work ethic and a drive to learn, you are the one we're looking for. The clients love us for our solutioning capability, our enthusiasm and we expect you to be a part of our growth story.Company Website: https://www.quantzig.com/. Minimum Relevant Experience: 4-6 years in Databricks/Azure Cloud Technologies. Skillset Description: Azure Databricks and Azure Data Factory Expertise:- Demonstrate proficiency in designing, implementing, and optimizing data workflows using Azure Databricks and Azure Data Factory.- Provide expertise in configuring and managing data pipelines within the Azure cloud environment.PySpark Proficiency:- Possess a strong command of PySpark for data processing and analysis.- Develop and optimize PySpark code to ensure efficient and scalable data transformations.Big Data & CI/CD Experience:- Ability to troubleshoot and optimize data processing tasks on large datasets. - Design and implement automated CI/CD pipelines for data workflows.- This involves using tools like Jenkins, GitLab CI/CD, or Azure DevOps to automate the building, testing, and deployment of data pipelines.Data Pipeline Development & Deployment:- Design, implement, and maintain end-to-end data pipelines for various data sources and destinations.- This includes unit tests for individual components, integration tests to ensure that different components work together correctly, and end-to-end tests to verify the entire pipeline's functionality.- Ensure data quality, integrity, and reliability throughout the entire data pipeline.Extraction, Ingestion, and Consumption Frameworks:- Develop frameworks for efficient data extraction, ingestion, and consumption.- Implement best practices for data integration and ensure seamless data flow across the organization.Collaboration and Communication:- Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.- Communicate effectively with stakeholders to gather and clarify data-related requirements.- Pyspark and PySQL hands on coding. - Strong knowledge of Delta Lakes.Additional Details: Notice Period: Immediate to 30 Days. Location: Cessna Business Park, Kadubeesanahalli, Bangalore. (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Azure Data Engineer - Databricks/Data Factory (4-6 yrs) Anywhere in
Azure Data Engineer - Databricks/Data Factory (4-6 yrs) Anywhere in is a Engineering Engineer Job at Infiniti Research located in India. Find other listings like Azure Data Engineer - Databricks/Data Factory (4-6 yrs) Anywhere in by searching Oodle for Engineering Engineer Jobs.
Azure Data Engineer - Databricks/Data Factory (4-6 yrs) Anywhere in is a Engineering Engineer Job at Infiniti Research located in India. Find other listings like Azure Data Engineer - Databricks/Data Factory (4-6 yrs) Anywhere in by searching Oodle for Engineering Engineer Jobs.