RiskInsight Consulting Pvt Ltd
This listing was posted on hirist.
Data Engineer - Hadoop Ecosystem Components (4-8 yrs) Karnataka/Bangarapet
Location:
Karnataka/Bangarapet
Description:
About the Role :We are seeking a skilled and experienced Big Data Engineer to join our team and play a crucial role in building and maintaining our big data infrastructure. You will leverage your expertise in the Hadoop ecosystem and data processing frameworks to design, implement, and optimize scalable data pipelines.Responsibilities : - Design, develop, and maintain efficient data pipelines for large-scale data processing.- Utilize your proficiency in HDFS, HiveQL, and PySpark to create and optimize data processing workflows.- Perform data wrangling and transformation tasks to ensure data quality and consistency.- Write efficient SQL queries for data manipulation and retrieval.- Automate tasks and schedule jobs using Linux shell scripting.- Develop and maintain Python scripts for data manipulation, analysis, and automation tasks.- Collaborate with data analysts and data scientists to understand data needs and translate them into technical solutions.- Troubleshoot and debug big data processing issues to ensure smooth system operation.- Continuously monitor and optimize data pipelines for performance and scalability.- Advocate for best practices in data management and big data technologies.- Stay up-to-date on the latest trends and innovations in the big data and analytics landscape.Qualifications : - 4-8 years of experience as a Data Engineer or a similar role.- Strong expertise in Hadoop ecosystem components, including HDFS, HiveQL, and YARN.- Proven experience in developing and optimizing data processing workflows using PySpark.- Proficiency in SQL for data manipulation and querying.- Hands-on experience with Linux shell scripting for automation and job scheduling.- Solid understanding of Python programming language and libraries for data manipulation and analysis.- Experience with version control systems (Git) is a plus.- Knowledge of CI/CD pipelines is a plus.- Excellent communication and collaboration skills to work effectively with cross-functional teams.- Strong problem-solving skills and a keen eye for detail.- Proactive and eager to learn new technologies and stay updated in the big data field. (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Data Engineer - Hadoop Ecosystem Components (4-8 yrs) Karnataka/Bangarapet
Data Engineer - Hadoop Ecosystem Components (4-8 yrs) Karnataka/Bangarapet is a Engineering Engineer Job at Riskinsight Consulting located in India. Find other listings like Data Engineer - Hadoop Ecosystem Components (4-8 yrs) Karnataka/Bangarapet by searching Oodle for Engineering Engineer Jobs.
Data Engineer - Hadoop Ecosystem Components (4-8 yrs) Karnataka/Bangarapet is a Engineering Engineer Job at Riskinsight Consulting located in India. Find other listings like Data Engineer - Hadoop Ecosystem Components (4-8 yrs) Karnataka/Bangarapet by searching Oodle for Engineering Engineer Jobs.