Back
India   India   Engineer   Advansoft -

Data Engineer - Hadoop/Python/Spark (5-9 yrs) Pune/Bangalore/Chennai (Analytics | Engineer in Engi1

ADVANSOFT

This listing was posted on hirist.

Data Engineer - Hadoop/Python/Spark (5-9 yrs) Pune/Bangalore/Chennai (Analytics

Share
Tools
Location:
Pune/Bangalore/Chennai
Description:

Skills :- Hadoop- Python- Spark- PySpark- ETL (Extract, Transform, Load)Roles & Responsibilities :- Data Ingestion: Develop and maintain data pipelines for ingesting raw data from various sources into the Hadoop ecosystem.- Data Processing: Utilize Python and Spark to process and transform large volumes of data efficiently, ensuring scalability and performance.- Data Modeling: Design and implement data models that facilitate efficient querying and analysis of structured and unstructured data.- ETL Development: Develop ETL (Extract, Transform, Load) processes to cleanse, transform, and integrate data from different sources into data warehouses or data lakes.- Performance Tuning: Optimize data processing workflows and queries to improve performance and reduce processing times.- Data Quality Assurance: Implement data quality checks and validation processes to ensure the accuracy, completeness, and consistency of data.- Data Governance: Enforce data governance policies and standards to ensure compliance with regulatory requirements and industry best practices.- Documentation: Maintain documentation for data pipelines, data models, and ETL processes to facilitate knowledge sharing and troubleshooting.- Collaboration: Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.- Continuous Improvement: Stay updated with emerging technologies and best practices in data engineering, and proactively identify opportunities for process optimization and automation. (ref:hirist.tech)
Education/experience:
2 To 5 Years
Company:
Advansoft
Posted:
May 22 on hirist
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
  • Always meet the employer in person.
  • Avoid sharing sensitive personal and financial information.
  • Avoid employment offers that require a deposit or investment.

To learn more, visit the Safety Center or click here to report this listing.

More About this Listing: Data Engineer - Hadoop/Python/Spark (5-9 yrs) Pune/Bangalore/Chennai (Analytics
Data Engineer - Hadoop/Python/Spark (5-9 yrs) Pune/Bangalore/Chennai (Analytics is a Engineering Engineer Job at Advansoft located in India. Find other listings like Data Engineer - Hadoop/Python/Spark (5-9 yrs) Pune/Bangalore/Chennai (Analytics by searching Oodle for Engineering Engineer Jobs.