Coders Brain Technology Pvt. Ltd.
This listing was posted on hirist.
Senior Data Engineer - Azure Databricks (10-15 yrs) Any Location (Analytics &
Location:
Any Location
Description:
Position Name : Sr Data EngineerExperience Required : 8+yearsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :Solution Architect (Databricks) :Candidate having 8+ years of total experience in Data engineering (development/design), in which at least 5+ years as a Big Data architect/solution architect (on Big data platforms) , in which at least 3+ years of Proven experience as Architect/solution architect or a similar role on Databricks platform. Excellent hands-on experience in architecting and implementing data processing, data warehousing, and data analytics solutions on the Aws Databricks platform having huge data volume, a variety of data types, for batch and real-time data ingestion. Responsibilities :- Enforce adherence to architectural standards/principles, global product-specific guidelines, usability design standards, etc.- Proactively guide engineering methodologies, standards, and leading practices.- Identify, communicate, and mitigate Risks, Assumptions, Issues, and Decisions throughout the full lifecycle.- Provide guidelines in the definition of best practices & repeatable methodologies in Cloud Data Engineering, including Data Storage, ETL, Data Integration & Migration, Data Warehousing, and Data GovernanceRequired Skills :- Must have 9+ years of experience in Data Engineering project development/design handling huge data, in which at least 5+ years on cloud using cloud data engineering services (preferably on aws)- Must have designed and implemented at least 2-3 projects end-to-end in Databricks, E2E architecture of unified data platform covering all the aspect of data lifecycle starting from Data Ingestion, Transformation, Serve and consumption, understand composable architecture to take fullest advantage of Databricks capabilities.- Must have Implemented and configured the Databricks environment, including clusters, notebooks, and libraries, ensuring optimal performance and resource utilization.- Must have followed various architectural principles to design best suited per problem.- Must have Designed and developed scalable designing both Batch and streaming data pipeline , data lake architectures, and data warehousing solutions on the Databricks platform using Spark and Delta Lake.- Must be well versed with Databricks Lakehouse concept and its implementation in enterprise environments.- Must have a strong understanding of Data warehousing and various governance and security standards around Databricks.- Must have knowledge of cluster optimization and its integration with various cloud services, strong performance optimization skills to improve efficiency and reduce cost.- Must be strong in writing unit test cases and integration test and Responsible to set best practices around Databricks CI/CD. - Must have Integrated data from various sources, including structured, semi-structured, and unstructured data, into Databricks for processing and analysis. (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Senior Data Engineer - Azure Databricks (10-15 yrs) Any Location (Analytics &
Senior Data Engineer - Azure Databricks (10-15 yrs) Any Location (Analytics & is a Engineering Engineer Job at Coders Brain Technology located in India. Find other listings like Senior Data Engineer - Azure Databricks (10-15 yrs) Any Location (Analytics & by searching Oodle for Engineering Engineer Jobs.
Senior Data Engineer - Azure Databricks (10-15 yrs) Any Location (Analytics & is a Engineering Engineer Job at Coders Brain Technology located in India. Find other listings like Senior Data Engineer - Azure Databricks (10-15 yrs) Any Location (Analytics & by searching Oodle for Engineering Engineer Jobs.