gethyr
This listing was posted on hirist.
Data Engineer - Hadoop (2-6 yrs) Bangalore (Analytics & Data Science)
Location:
Bangalore
Description:
Responsibilities:- Designing and implementing fine-tuned production-ready data/ML pipelines in Hadoop platform.- Driving optimization, testing, and tools to improve quality.- Reviewing and approving high-level & detailed design to ensure that the solution delivers to the business needs and aligns with the data & analytics architecture principles and roadmap.- Understanding business requirements and solution design to develop and implement solutions that adhere to big data architectural guidelines and address business requirements.- Following proper SDLC (Code review, sprint process).- Identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, etc.- Building robust and scalable data infrastructure (both batch processing and real-time) to support the needs of internal and external users- Understanding various data security standards and using secure data security tools to apply and adhere to the required data controls for user access in the Hadoop platform.- Supporting and contributing to developing guidelines and standards for data ingestion- Working with data scientist and business analytics team to assist in data ingestion and data-related technical issues.- Designing and documenting the development & deployment flow.Requirements:- Experience in developing rest API services using one of the Scala frameworks- Ability to troubleshoot and optimize complex queries on the Spark platform- Expert in optimizing 'big data' data/ML pipelines, architectures, and data sets- Experience in Big Data access and storage techniques.- Experience in doing cost estimation based on design and development.- Excellent debugging skills for the technical stack mentioned above which even includes analyzing server logs and application logs.- Highly organized, self-motivated, proactive, and able to propose the best design solutions.- Good time management and multitasking skills to work to deadlines by working independently and as a part of a team.- Ability to analyze and understand complex problems.- Ability to explain technical information in business terms.- Ability to communicate clearly and effectively, both verbally and in writing.- Strong in user requirements gathering, maintenance, and support (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Data Engineer - Hadoop (2-6 yrs) Bangalore (Analytics & Data Science)
Data Engineer - Hadoop (2-6 yrs) Bangalore (Analytics & Data Science) is a Engineering Engineer Job at Gethyr located in India. Find other listings like Data Engineer - Hadoop (2-6 yrs) Bangalore (Analytics & Data Science) by searching Oodle for Engineering Engineer Jobs.
Data Engineer - Hadoop (2-6 yrs) Bangalore (Analytics & Data Science) is a Engineering Engineer Job at Gethyr located in India. Find other listings like Data Engineer - Hadoop (2-6 yrs) Bangalore (Analytics & Data Science) by searching Oodle for Engineering Engineer Jobs.