KARYA CONSULTANTS PRIVATE LIMITED
This listing was posted on hirist.
Azure Databricks Developer - Python/Scala (7-10 yrs) Any Location/Bangalore
Location:
Any Location/Bangalore
Description:
Responsibilities :- Closely work with Architect and lead to design solutions to meet functional and non-functional- requirements.- Participate to understand architecture and solution design- artifacts.- Evangelize re-use through the implementation of shared- assets.- Proactively implement engineering methodologies, standards, and leading practices.- Provide insight and direction on roles and responsibilities required for solution- operations.- Identify, communicate and mitigate Risks, Assumptions, Issues, and Decisions throughout the full- lifecycle.- Considers the art of the possible, compares various solution options based on feasibility and impact, and proposes actionable- plans.- Demonstrate- strong analytical and technical problem-solving- skills.- Ability to analyze and operate at various levels of- abstraction.- Ability to balance what is strategically right with what is practically- realistic.Qualifications we seek in you!- Minimum qualifications :- Excellent technical skills to enabling the creation of future-proof, complex global- solutions- - Bachelor's Degree or equivalency (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work- experience.- Maintains close awareness of new and emerging technologies and their potential application for service offerings and products.- Work with architect and leads for solutioning to meet functional and non-functional- requirements.- Demonstrated knowledge of relevant industry trends and- standards.- Demonstrate- strong analytical and technical problem-solving- skills.- Must have excellent coding skills either Python or Scala, preferably Python.- Must have at least 5+ years of experience in Data Engineering domain with total of 7+ years.- Must have implemented at least 2 project end-to-end in Databricks.- Must have at least 2+ years of experience on databricks which consists of various components as below - Delta lake - dbConnect - db API 2.- Databricks workflows orchestration - Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.- Must have strong understanding of Data warehousing and various governance and security standards around Databricks.- Must have knowledge of cluster optimization and its integration with various cloud services.- Must have good understanding to create complex data pipeline.- Must have good knowledge of Data structure & algorithms.- Must be strong in SQL and sprak-sql.- Must have strong performance optimization skills to improve efficiency and reduce cost.- Must have worked on both Batch and streaming data pipeline.- Must have extensive knowledge of Spark and Hive data processing framework.- Must have worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.- Must be strong in writing unit test case and integration test.- Must have strong communication skills and have worked on the team of size 5 plus.- Must have great attitude towards learning new skills and upskilling the existing skills.- Good to have Rest API knowledge.- Good to have understanding around cost distribution.- Good to have knowledge of Databricks platform design.- Good to have Unity catalog and basic governance knowledge.- Good to have Databricks SQL Endpoint understanding.- Good To have CI/CD experience to build the pipeline for Databricks jobs.- Good to have if worked on migration project to build Unified data platform.- Good to have knowledge of DBT.- Good to have knowledge of docker and Kubernetes. (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Azure Databricks Developer - Python/Scala (7-10 yrs) Any Location/Bangalore
Azure Databricks Developer - Python/Scala (7-10 yrs) Any Location/Bangalore is a Technology Developer Job at Karya Consultants located in India. Find other listings like Azure Databricks Developer - Python/Scala (7-10 yrs) Any Location/Bangalore by searching Oodle for Technology Developer Jobs.
Azure Databricks Developer - Python/Scala (7-10 yrs) Any Location/Bangalore is a Technology Developer Job at Karya Consultants located in India. Find other listings like Azure Databricks Developer - Python/Scala (7-10 yrs) Any Location/Bangalore by searching Oodle for Technology Developer Jobs.