Techno Wise
This listing was posted on hirist.
Big Data Engineer - PySpark Framework (4-6 yrs) Mumbai/Pune/Bangalore (Analytics
Location:
Mumbai/Pune/Bangalore
Description:
Job Description : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a pivotal role in designing, implementing, and maintaining scalable data solutions leveraging the Big Data technologies like PySpark. This role requires a strong understanding of big data technologies, data engineering best practices, and the ability to collaborate effectively with cross-functional teams.Responsibilities :1. Design, develop, and implement end-to-end data pipelines using PySpark to process, cleanse, and transform large-scale datasets.2. Collaborate with data scientists, analysts, and stakeholders to understand data requirements and translate them into technical solutions.3. Optimize and tune Spark jobs for performance and scalability, ensuring efficient resource utilization and processing speed.4. Develop and maintain data ingestion processes from various sources such as databases, streams, and file systems into the Databricks environment.5. Implement data quality checks and validation processes to ensure the accuracy, completeness, and reliability of the data.6. Have worked on Data Orchestration Tools like Airflow.7. Working on storytask using Agile Methodology.8. Must have hand-on on GitHub and GitLab9. Work closely with DevOps teams to automate deployment processes and ensure the reliability and availability of data pipelines.10. Monitor, troubleshoot, and resolve issues related to data pipeline failures, performance degradation, and system errors.11. Stay updated on emerging technologies and industry trends in big data, distributed computing, and cloud platforms to drive continuous improvement and innovation. (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Big Data Engineer - PySpark Framework (4-6 yrs) Mumbai/Pune/Bangalore (Analytics
Big Data Engineer - PySpark Framework (4-6 yrs) Mumbai/Pune/Bangalore (Analytics is a Engineering Engineer Job at Techno Wise located in India. Find other listings like Big Data Engineer - PySpark Framework (4-6 yrs) Mumbai/Pune/Bangalore (Analytics by searching Oodle for Engineering Engineer Jobs.
Big Data Engineer - PySpark Framework (4-6 yrs) Mumbai/Pune/Bangalore (Analytics is a Engineering Engineer Job at Techno Wise located in India. Find other listings like Big Data Engineer - PySpark Framework (4-6 yrs) Mumbai/Pune/Bangalore (Analytics by searching Oodle for Engineering Engineer Jobs.