Astuto Technologies Private Limited
This listing was posted on hirist.
Astuto Technologies - Data Engineer - Apache/Spark (2-5 yrs) Bangalore
Location:
Bangalore
Description:
We are seeking a highly skilled and experienced Staff Engineer - Data Pipelines to join our data engineering team. The ideal candidate will have a strong background in designing, building, and maintaining data pipelines, with expertise in setting up and optimizing data processing frameworks such as Apache Spark or similar, Kafka/Pulsar, and Data Lake.Responsibilities: Design and develop robust, scalable, and efficient data pipelines to collect, process, and store large volumes of data from various sources.Collaborate with data scientists, data analysts, and other teams to understand data requirements and supply data solutions.Set up and configure Apache Spark or similar for stream processing, batch processing, and real-time analytics.Manage and perfect data streaming and messaging platforms such as Kafka and Pulsar for real-time data ingestion.Work on data quality monitoring and ensure data accuracy, consistency, and reliability.Collaborate with cross-functional teams to troubleshoot and resolve data pipeline issues.Keep abreast of industry trends and emerging technologies related to data pipelines and recommend improvements.Requirements: Bachelor's or higher degree in Computer Science, Data Engineering, or a related field.Proven experience (2+ years) in designing and implementing data pipelines in a production environment.Strong ability in setting up and configuring Apache Spark, and Kafka/Pulsar for data streaming, transformation, and processing.Hands-on experience with AWS services, including S3 Lambda and EMR.Solid knowledge of data warehousing concepts and technologies.Strong programming skills in languages such as Python or Scala.Familiarity with service-oriented architecture and gRPC or similar.Familiarity with data modeling, database systems, and SQL.Experience with Clickhouse or similar.Excellent problem-solving and communication skills.Strong team player and ability to collaborate with cross-functional teams.Results-oriented and able to work independently with minimal supervision.Proactive in staying up to date with industry trends and best practices. (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Astuto Technologies - Data Engineer - Apache/Spark (2-5 yrs) Bangalore
Astuto Technologies - Data Engineer - Apache/Spark (2-5 yrs) Bangalore is a Engineering Engineer Job at Astuto Technologies located in India. Find other listings like Astuto Technologies - Data Engineer - Apache/Spark (2-5 yrs) Bangalore by searching Oodle for Engineering Engineer Jobs.
Astuto Technologies - Data Engineer - Apache/Spark (2-5 yrs) Bangalore is a Engineering Engineer Job at Astuto Technologies located in India. Find other listings like Astuto Technologies - Data Engineer - Apache/Spark (2-5 yrs) Bangalore by searching Oodle for Engineering Engineer Jobs.