Zelus India
This listing was posted on hirist.
Big Data Engineer - Distributed Computing (8-10 yrs) Bangalore (Analytics & Data
Location:
Bangalore
Description:
Job Description :- Design, develop, and maintain scalable and high-performance data processing applications using Apache Spark and Scala, leveraging distributed computing frameworks for processing large volumes of data.- Data Ingestion and Transformation : Implement data ingestion pipelines to ingest data from various sources into Azure Data Lake Storage or Azure Blob Storage, and transform the data using Spark RDDs, DataFrames, and Datasets.- Spark Development : Develop Spark applications using Scala programming language, utilizing Spark APIs for data manipulation, transformation, aggregation, and analysis- Integrate Spark applications with other Azure services such as Azure Databricks, Azure Synapse Analytics, Azure HDInsight, and Azure SQL Database for end-to-end data processing and analytics workflows.- Streaming Data Processing : Implement real-time data processing solutions using Spark Streaming or Azure Stream Analytics, enabling real-time insights and analytics on streaming data sources.- Data Orchestration : Design and implement data orchestration workflows using Apache Airflow or Azure Data Factory to schedule and manage Spark jobs and data pipelines.- Experience with cloud platforms, particularly Microsoft Azure, and familiarity with Azure services such as Azure Data Lake Storage, Azure Blob Storage, Azure Databricks, Azure Synapse Analytics, and Azure Data Factory.- Strong understanding of distributed computing principles and big data processing concepts, including data partitioning, parallel processing, and fault tolerance. (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Big Data Engineer - Distributed Computing (8-10 yrs) Bangalore (Analytics & Data
Big Data Engineer - Distributed Computing (8-10 yrs) Bangalore (Analytics & Data is a Engineering Engineer Job at Zelus India located in India. Find other listings like Big Data Engineer - Distributed Computing (8-10 yrs) Bangalore (Analytics & Data by searching Oodle for Engineering Engineer Jobs.
Big Data Engineer - Distributed Computing (8-10 yrs) Bangalore (Analytics & Data is a Engineering Engineer Job at Zelus India located in India. Find other listings like Big Data Engineer - Distributed Computing (8-10 yrs) Bangalore (Analytics & Data by searching Oodle for Engineering Engineer Jobs.