Nilasu consulting
This listing was posted on hirist.
Senior Data Engineer - Python/Spark (6-8 yrs) Bangalore/Kolkata/Pune (Analytics
Location:
Bangalore/Kolkata/Pune
Description:
Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable data solutions.Responsibilities :- Design, develop, and implement data pipelines for data ingestion, transformation, and loading using Python and Spark/PySpark.- Optimize Spark jobs for performance and scalability to handle large datasets.- Utilize working knowledge of Scala or Java with object-oriented principles and design patterns to contribute to complex data processing tasks (if applicable).- Manage and maintain data pipelines on Hadoop infrastructure.- Develop and integrate RESTful APIs for data access and consumption.- Automate data processing workflows using DevOps tools like Git, Maven, Jenkins, or Azure DevOps.- Apply Agile development methodologies and collaborate effectively with cross-functional teams (data scientists, analysts, developers).- Troubleshoot and fix performance issues across the codebase and database queries.- Document data pipelines and processes for maintainability and knowledge sharing.- Stay up-to-date with the latest advancements in big data technologies and tools.Qualifications :- At least 6 years of experience as a Data Engineer or a related role.- Strong expertise in Python programming and proficiency in Spark/PySpark for large-scale data processing.- Working knowledge of Scala or Java with object-oriented principles and design patterns (a plus).- Experience with Linux environments and Hadoop infrastructure.- Experience working with RESTful APIs for data exchange.- Familiarity with DevOps tools like Git, Maven, Jenkins, or Azure DevOps.- Understanding of Agile development methodologies and practices.- Excellent problem-solving and analytical skills.- Strong written and verbal communication skills to collaborate effectively with stakeholders.- Passion for learning and implementing new technologies.- Ability to thrive in a fast-paced and dynamic environment. (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Senior Data Engineer - Python/Spark (6-8 yrs) Bangalore/Kolkata/Pune (Analytics
Senior Data Engineer - Python/Spark (6-8 yrs) Bangalore/Kolkata/Pune (Analytics is a Engineering Engineer Job at Nilasu Consulting located in India. Find other listings like Senior Data Engineer - Python/Spark (6-8 yrs) Bangalore/Kolkata/Pune (Analytics by searching Oodle for Engineering Engineer Jobs.
Senior Data Engineer - Python/Spark (6-8 yrs) Bangalore/Kolkata/Pune (Analytics is a Engineering Engineer Job at Nilasu Consulting located in India. Find other listings like Senior Data Engineer - Python/Spark (6-8 yrs) Bangalore/Kolkata/Pune (Analytics by searching Oodle for Engineering Engineer Jobs.