Infiniti Research
This listing was posted on hirist.
Lead Azure Data Engineer - Databricks/PySpark (6-10 yrs) Bangalore (Analytics &
Location:
Bangalore
Description:
About Quantzig: Quantzig is a global analytics and advisory firm with offices in the US, UK, Canada, China, and India. we have assisted our clients across the globe with end-to-end advanced analytics, visual storyboarding , Machine Learning and data engineering solutions implementation for prudent decision making. We are a rapidly growing organization that is built and operated by high-performance champions. If you have what it takes to be the champion with business and functional skills to take ownership of an entire project end-to-end, help build a team with great work ethic and a drive to learn, you are the one we're looking for. The clients love us for our solutioning capability, our enthusiasm and we expect you to be a part of our growth story.Find out more about the company: https://www.quantzig.com/. We have developed exceptional expertise in advanced analytics and business intelligence solutions for transforming global organizations. Harness the power of our intelligent, actionable insights to solve complex problems and inspire innovation, change, and growth across your organization value chain.www.quantzig.com. What do we look for?. - 6+ years of experience into Azure.- Good exposure in working with Azure data bricks - Pyspark, Spark SQL, Scala (Lazy evaluation and delta tables, Parquet formats, Working with large and complex datasets). - Strong experience with DWH using Synapse (distribution of tables (hash, replicate, round robin scenario). - Partitioning of data and Polybase.- ETL (Incremental loading SCD1, SCD2, Upserts). - Data factory (pipeline orchestration, scheduling and different types of triggers).- Logic apps (added advantage). - Experience in Cloud Scale Analytics Platform, Federred Mesh Strategy for Lakehouse.- Good exposure in data layers - Gold layer, Silver layer & Bronze layer.- Design, develop, and maintain data pipelines and workflows to ingest, process, and deliver data efficiently and reliably.- Implement workflow automation solutions to streamline data processing, transformation, and integration tasks.- Collaborate with data stakeholders to gather and understand requirements for data workflows and automation processes.- Ensure data governance standards are met by implementing automation for data quality checks, data lineage, and metadata management.- Monitor and optimize data workflows for performance, scalability, and reliability.- Troubleshoot and resolve data pipeline issues promptly to minimize downtime and data loss.- Collaborate with data architects and data scientists to ensure data infrastructure meets analytical needs.- Develop and maintain documentation for data workflows, governance automation, and best practices.- Stay current with emerging technologies and industry trends in data engineering and governance. (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Lead Azure Data Engineer - Databricks/PySpark (6-10 yrs) Bangalore (Analytics &
Lead Azure Data Engineer - Databricks/PySpark (6-10 yrs) Bangalore (Analytics & is a Engineering Engineer Job at Infiniti Research located in India. Find other listings like Lead Azure Data Engineer - Databricks/PySpark (6-10 yrs) Bangalore (Analytics & by searching Oodle for Engineering Engineer Jobs.
Lead Azure Data Engineer - Databricks/PySpark (6-10 yrs) Bangalore (Analytics & is a Engineering Engineer Job at Infiniti Research located in India. Find other listings like Lead Azure Data Engineer - Databricks/PySpark (6-10 yrs) Bangalore (Analytics & by searching Oodle for Engineering Engineer Jobs.