Overture Rede Private Limited.
This listing was posted on hirist.
Data Engineer - Python/PySpark (3-6 yrs) Pune (Analytics & Data Science)
Location:
Pune
Description:
Description:- 3 to 6 years years experience in Big Data tech stack- Strong development background- Java or scala 3-6 years- Spark 1-4 years. Certifications are a plus- Azure - 1-3 years. Certifications are a plus- Databricks 1-2 years. Certifications are a plus- Strong SQL background- UI Development experience is plusJob Requirements: - Participate in the customer's system design meetings and collect the functional/technical requirements. - Build up data pipelines for consumption by the data science team. - Skillful in ETL process and tools. - Clear understanding and experience with Python and PySpark or Spark and SCALA, with HIVE, Airflow, Impala, and Hadoop and RDBMS architecture. - Experience in writing Python programs and SQL queries. - Experience in SQL Query tuning. - Experienced in Shell Scripting(Unix/Linux). - Build and maintain data pipelines in Spark/Pyspark with SQL and Python or SCALA. - Knowledge of Cloud (Azure/AWS/GCP, etc..) technologies is additional. - Good to have knowledge of Kubernetes, CI/CD concepts, Apache Kafka - Suggest and implement best practices in data integration. - Guide the QA team in defining system integration tests as needed. - Split the planned deliverables into tasks and assign them to the team. - Needs to Maintain/Deploy the ETL code and follow the Agile methodology - Needs to work on optimization wherever applicable. - Good oral, written and presentation skills. Preferred Qualifications: - Degree in Computer Science, IT, or similar field; a Master's is a plus. - Hands-on experience with Python and Pyspark Or - Hands-on experience with Spark and SCALA. - Great numerical and analytical skills. - Working knowledge of cloud platforms such as MS Azure, AWS, etc... - Technical expertise with data models, data mining, and segmentation techniques (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Data Engineer - Python/PySpark (3-6 yrs) Pune (Analytics & Data Science)
Data Engineer - Python/PySpark (3-6 yrs) Pune (Analytics & Data Science) is a Engineering Engineer Job at Overture Rede located in India. Find other listings like Data Engineer - Python/PySpark (3-6 yrs) Pune (Analytics & Data Science) by searching Oodle for Engineering Engineer Jobs.
Data Engineer - Python/PySpark (3-6 yrs) Pune (Analytics & Data Science) is a Engineering Engineer Job at Overture Rede located in India. Find other listings like Data Engineer - Python/PySpark (3-6 yrs) Pune (Analytics & Data Science) by searching Oodle for Engineering Engineer Jobs.