Infinite Computer Solutions
This listing was posted on hirist.
Infinite Computer Solutions - DevOps Engineer - AWS Infrastructure (4-6 yrs)
Location:
Bangalore/Chennai/Hyderabad
Description:
Job Description :As a DevOps Engineer with AWS expertise, you will play a crucial role in designing, implementing, and optimizing data pipelines on AWS infrastructure using Databricks. You will work closely with cross-functional teams to ensure the efficient management of data workflows, from ingestion to processing and integration, while adhering to security and compliance standards.Key Responsibilities :Developing Data Pipelines :- Designing and implementing scalable data pipelines using Databricks on AWS infrastructure leveraging Python and Spark.Data Ingestion :- Managing the ingestion of structured and unstructured data from various sources into Databricks clusters on AWS, ensuring data quality and reliability.Data Processing:- Performing data processing tasks, including transformation, cleansing, aggregation, and enrichment, using Databricks tools and AWS services like EMR (Elastic MapReduce).Optimization and Performance Tuning :- Optimizing Databricks jobs and clusters for performance, efficiency, and cost-effectiveness on the AWS platform.Integration :- Integrating Databricks with other AWS services such as S3, Glue, Redshift, and Lambda to build end-to-end data solutions.Monitoring and Maintenance :- Monitoring Databricks clusters, jobs, and workflows for performance issues, troubleshooting errors, and ensuring high availability and reliability.Security and Compliance :- Implementing security best practices and ensuring compliance with data privacy regulations (e.g., GDPR, CCPA) in Databricks deployments on AWS.Collaboration :- Collaborating with data engineers, data scientists, and other stakeholders to understand data requirements and deliver solutions that meet business needs.Documentation :- Documenting Databricks workflows, architecture, and best practices to facilitate knowledge sharing and maintain system documentation.Continuous Learning :- Keeping up-to-date with the latest advancements in Databricks, AWS services, and data engineering technologies to continuously improve skills and contribute to innovation in data solutions.Qualifications and Skills :- Bachelor's degree in Computer Science, Engineering, or related field.- 4+ years of hands-on experience in DevOps, particularly with AWS.- Proficiency in Python and Spark for developing data pipelines.- Experience with Databricks, EMR, S3, Glue, Redshift, Lambda, and other AWS services.- Strong understanding of security best practices and compliance standards.- Excellent collaboration and communication skills.- Ability to work effectively in a fast-paced, dynamic environment.- Continuous learning mindset with a passion for innovation.Location: Bangalore, Chennai, Hyderabad (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Infinite Computer Solutions - DevOps Engineer - AWS Infrastructure (4-6 yrs)
Infinite Computer Solutions - DevOps Engineer - AWS Infrastructure (4-6 yrs) is a Engineering Engineer Job at Infinite Computer Solutions located in India. Find other listings like Infinite Computer Solutions - DevOps Engineer - AWS Infrastructure (4-6 yrs) by searching Oodle for Engineering Engineer Jobs.
Infinite Computer Solutions - DevOps Engineer - AWS Infrastructure (4-6 yrs) is a Engineering Engineer Job at Infinite Computer Solutions located in India. Find other listings like Infinite Computer Solutions - DevOps Engineer - AWS Infrastructure (4-6 yrs) by searching Oodle for Engineering Engineer Jobs.