Ilink Systems Pvt Ltd
This listing was posted on hirist.
AWS Data Engineer - SQL/Python (5-8 yrs) Chennai/Pune/Bangalore/Noida (Analytics
Location:
Chennai/Pune/Bangalore/Noida
Description:
Job Description :- AWS Data Engineer with min of 5 to 7 years of experience.- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.- Connect with stakeholders daily to discuss project progress and updates.- Work within an Agile process to deliver projects in a timely and efficient manner.- Design and develop Airflow DAGs to schedule and manage ETL workflows.- Transform SQL queries into Spark SQL code for ETL pipelines.- Develop custom Python functions to handle data quality and validation.- Write PySpark scripts to process data and perform transformations.- Perform data validation and ensure data accuracy and completeness by creating automated tests and implementing data validation processes- Run Spark jobs on AWS EMR cluster using Airflow DAGs.- Monitor and troubleshoot ETL pipelines to ensure smooth operation.- Implement best practices for data engineering, including data modeling, data warehousing, and data pipeline architecture.- Collaborate with other members of the data engineering team to improve processes and implement new technologies.- Stay up to date with emerging trends and technologies in data engineering and suggest ways to improve the team's efficiency and effectiveness. (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: AWS Data Engineer - SQL/Python (5-8 yrs) Chennai/Pune/Bangalore/Noida (Analytics
AWS Data Engineer - SQL/Python (5-8 yrs) Chennai/Pune/Bangalore/Noida (Analytics is a Engineering Engineer Job at Ilink Systems located in India. Find other listings like AWS Data Engineer - SQL/Python (5-8 yrs) Chennai/Pune/Bangalore/Noida (Analytics by searching Oodle for Engineering Engineer Jobs.
AWS Data Engineer - SQL/Python (5-8 yrs) Chennai/Pune/Bangalore/Noida (Analytics is a Engineering Engineer Job at Ilink Systems located in India. Find other listings like AWS Data Engineer - SQL/Python (5-8 yrs) Chennai/Pune/Bangalore/Noida (Analytics by searching Oodle for Engineering Engineer Jobs.