programming.com
This listing was posted on hirist.
Data Engineer - Scala/Python (5-7 yrs) Hyderabad (Analytics & Data Science)
Location:
Hyderabad
Description:
Job Description :Role Overview :As a Data Engineer , you will be responsible for designing, building, and maintaining efficient, scalable data pipelines and infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure data integrity, accessibility, and usability. Your expertise in SQL, Python or Scala, Spark, Hadoop, Hive, and HDFS will be crucial in managing our large-scale data processing and storage systems.Key Responsibilities :- Design, develop, and maintain robust data pipelines using SQL, Python or Scala, and Apache Spark.- Implement and manage Hadoop-based data storage solutions, including HDFS, Hive, and other related = technologies.- Optimize data processing workflows to ensure high performance and scalability.- Collaborate with data scientists and analysts to understand data requirements and deliver necessary data infrastructure and tools.- Ensure data quality and integrity through thorough testing and validation processes.- Monitor and troubleshoot data pipelines and infrastructure, addressing any issues promptly.- Stay updated with the latest industry trends and best practices in data engineering and big data technologies.Required Skills and Qualifications :- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.- Proven experience as a Data Engineer or in a similar role.- Strong proficiency in SQL for data querying and manipulation.- Proficiency in programming with Python or Scala.- Hands-on experience with Apache Spark for data processing.- Extensive experience with Hadoop ecosystem tools such as HDFS and Hive.- Familiarity with data warehousing concepts and ETL processes.- Strong problem-solving skills and attention to detail.- Excellent communication and teamwork abilities.Preferred Qualifications :- Experience with cloud platforms such as AWS, Azure, or Google Cloud.- Knowledge of additional big data tools and frameworks like Kafka, Flink, or Cassandra.- Certification in data engineering or related fields. (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Data Engineer - Scala/Python (5-7 yrs) Hyderabad (Analytics & Data Science)
Data Engineer - Scala/Python (5-7 yrs) Hyderabad (Analytics & Data Science) is a Engineering Engineer Job at Programming.com located in India. Find other listings like Data Engineer - Scala/Python (5-7 yrs) Hyderabad (Analytics & Data Science) by searching Oodle for Engineering Engineer Jobs.
Data Engineer - Scala/Python (5-7 yrs) Hyderabad (Analytics & Data Science) is a Engineering Engineer Job at Programming.com located in India. Find other listings like Data Engineer - Scala/Python (5-7 yrs) Hyderabad (Analytics & Data Science) by searching Oodle for Engineering Engineer Jobs.