This listing was posted on iSmartRecruit.
Big data engineer
Location:
Pune, Maharashtra
Description:
Years of Experience- 3 to 8 years Big data engineer/ developer experience. Job Description- We are looking for a Big Data Engineer that will work on the collecting, storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company. Skills & Competencies: Experience with SCALA or Python programming Language. Good knowledge of Core Big Data Concepts (HDFS, Hadoop Daemons) (must) Experience or knowledge of Linux Shell Commands (Preferred) Data Ingestion Tools: Sqoop, Flume, Kafka (at least one with proper hands-on) Data Storage: Hive, Hbase, HDFS (at least one with proper hands-on) ETL Tools: Spark, Scala, Python (at least one with proper hands-on) Management of Hadoop cluster, with all included services Ability to solve any ongoing issues with operating the cluster Experience with NoSQL databases, such as HBase, Cassandra, MongoDB preferred Cloud experience highly preferred Writing high-performance, reliable and maintainable code. Good knowledge of database structures, theories, principles, and practices. Analytical and problem solving skills, applied to Big Data domain Responsibilities: Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities Implementing ETL process Monitoring performance and advising any necessary infrastructure changes Defining data retention policies Hadoop development and implementation. Loading from disparate data sets. Pre-processing using Hive and Pig. Designing, building, installing, configuring and supporting Hadoop. Translate complex functional and technical requirements into detailed design. Perform analysis of vast data stores and uncover insights. Maintain security and data privacy. Create scalable and high-performance web services for data tracking. High-speed querying. Managing and deploying HBase. Being a part of a POC effort to help build new Hadoop clusters. Test prototypes and oversee handover to operational teams. Propose best practices/standards.
Posted:
March 31 on iSmartRecruit
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to iSmartRecruit
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Big data engineer
Big data engineer is a Engineering Engineer Job located in Pune MH. Find other listings like Big data engineer by searching Oodle for Engineering Engineer Jobs.
Big data engineer is a Engineering Engineer Job located in Pune MH. Find other listings like Big data engineer by searching Oodle for Engineering Engineer Jobs.