Cortex Consulting Pvt. Ltd.
This listing was posted on hirist.
Hadoop Developer - Big Data (5-7 yrs) Chennai (Analytics & Data Science)
Location:
Chennai
Description:
We are seeking a highly skilled and motivated Hadoop Developer to join our team and play a crucial role in developing and maintaining our big data processing pipelines.The Ideal Candidate :Experience :- 5+ years of experience in developing and maintaining big data applications using Hadoop ecosystem technologies.Technical Skills :- In-depth knowledge of Apache Hadoop architecture and core components (HDFS, YARN, MapReduce).- Proficiency in distributed data processing frameworks like Apache Spark (Spark SQL, Spark Streaming).- Expertise in data warehousing and querying using Apache Hive and HiveQL.- Strong understanding of Unix/Shell scripting for automating Hadoop tasks.- Solid programming skills in Python or Scala for developing big data applications.Additional Skills :- Experience with data ingestion tools like Sqoop, Flume, or Kafka (a plus).- Familiarity with data quality and data cleansing techniques.- Understanding of distributed file systems like HDFS and alternatives like Apache Parquet or Apache ORC.- Experience with big data visualization tools (e.g., Tableau, Power BI) is a plus.Soft Skills :- Excellent communication and collaboration skills to work effectively with cross-functional teams (data analysts, data scientists, etc.).- Strong problem-solving and analytical skills.- Ability to learn new technologies quickly and adapt to changing requirements.- A proactive and results-oriented approach to work.Responsibilities :- Design, develop, and implement big data processing pipelines using Hadoop and Spark.- Develop and maintain data extraction, transformation, and loading (ETL) processes using tools like Sqoop, Flume, or Kafka.- Write efficient MapReduce and Spark jobs to process large datasets.- Design and develop Hive tables and queries to store and analyze big data.- Automate Hadoop tasks using Unix/Shell scripting.- Troubleshoot and debug big data processing issues.- Monitor and optimize Hadoop cluster performance.- Work with data analysts and data scientists to understand data requirements and develop solutions.- Stay up-to-date with the latest advancements in big data technologies and best practices. (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Hadoop Developer - Big Data (5-7 yrs) Chennai (Analytics & Data Science)
Hadoop Developer - Big Data (5-7 yrs) Chennai (Analytics & Data Science) is a Technology Developer Job at Cortex Consulting located in India. Find other listings like Hadoop Developer - Big Data (5-7 yrs) Chennai (Analytics & Data Science) by searching Oodle for Technology Developer Jobs.
Hadoop Developer - Big Data (5-7 yrs) Chennai (Analytics & Data Science) is a Technology Developer Job at Cortex Consulting located in India. Find other listings like Hadoop Developer - Big Data (5-7 yrs) Chennai (Analytics & Data Science) by searching Oodle for Technology Developer Jobs.