Cortex Consulting Pvt. Ltd.
This listing was posted on hirist.
Senior Data Engineer - AWS/Python (15-17 yrs) Chennai (Analytics & Data Science)
Location:
Chennai
Description:
Job Description :We are seeking a highly experienced and accomplished Senior AWS Data Engineer to join our growing team in Chennai. You will play a pivotal role in designing, developing, and managing large-scale data pipelines on the AWS cloud platform, leveraging your expertise in Python and data engineering best practices. You will be responsible for the entire data lifecycle, from data ingestion to transformation and delivery, ensuring efficient and reliable data flow for our data-driven initiatives.Responsibilities :AWS Cloud Expertise :- Possess in-depth knowledge of AWS services for data management and processing, including S3, Redshift, DynamoDB, EMR, and Lambda functions.- Design and implement scalable data architectures on AWS that are secure, cost-effective, and meet performance requirements.- Utilize Infrastructure as Code (IaC) tools like Terraform to automate infrastructure provisioning and configuration management.- Stay up-to-date with the latest advancements in AWS services and best practices.Data Pipelines and Automation :- Develop and maintain robust data pipelines using Python and data engineering frameworks like Apache Airflow.- Automate data ingestion, transformation, loading (ETL) processes for seamless data movement within the AWS ecosystem.- Implement data quality checks and monitoring mechanisms to ensure data integrity and consistency throughout the pipeline.- Leverage Python libraries like Pandas and Spark for data manipulation and processing tasks.Data Warehousing and Analytics :- Experience with data warehousing concepts and technologies, including data modeling and schema design.- Collaborate with data analysts and scientists to understand data requirements and translate them into technical solutions.- Prepare and optimize data for analytics workloads on platforms like Redshift or Athena.Collaboration and Communication :- Work effectively with cross-functional teams (data analysts, scientists, developers) to ensure successful data integration and insights generation.- Provide clear and concise technical documentation for designed data pipelines and architectures.- Proactively communicate potential issues and propose solutions for efficient problem-solving.Qualifications :- Minimum of 15 years of experience in data engineering or a related field.- Proven track record of designing, developing, and deploying large-scale data pipelines on the AWS cloud platform.- Expertise in Python programming and data engineering frameworks (e., Airflow).- In-depth knowledge of AWS services for data management, processing, and analytics.- Familiarity with data warehousing concepts and technologies.- Experience with data quality management and monitoring tools.- Excellent communication, collaboration, and problem-solving skills.- Ability to work independently and manage multiple projects simultaneously.- Strong analytical and critical thinking skills.- Passion for learning and staying up-to-date with the latest advancements in data engineering technologies (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Senior Data Engineer - AWS/Python (15-17 yrs) Chennai (Analytics & Data Science)
Senior Data Engineer - AWS/Python (15-17 yrs) Chennai (Analytics & Data Science) is a Engineering Engineer Job at Cortex Consulting located in India. Find other listings like Senior Data Engineer - AWS/Python (15-17 yrs) Chennai (Analytics & Data Science) by searching Oodle for Engineering Engineer Jobs.
Senior Data Engineer - AWS/Python (15-17 yrs) Chennai (Analytics & Data Science) is a Engineering Engineer Job at Cortex Consulting located in India. Find other listings like Senior Data Engineer - AWS/Python (15-17 yrs) Chennai (Analytics & Data Science) by searching Oodle for Engineering Engineer Jobs.