Akshaya IT Business Solutions
This listing was posted on hirist.
Data Engineer - Spark/PySpark (6-11 yrs) Bangalore (Analytics & Data Science)
Location:
Bangalore
Description:
Job Description :- Design and develop real-time data ingestion pipelines using Databricks and Spark Streaming to enable timely processing of large volumes of data.- Implement complex data transformations and aggregations to extract actionable insights from streaming data sources.- Collaborate with data scientists, analysts, and business stakeholders to understand requirements and translate them into scalable data solutions.- Optimize and tune data processing workflows for performance, reliability, and scalability.- Work closely with platform and infrastructure teams to ensure seamless integration of data pipelines with existing systems and technologies.- Stay updated with the latest advancements in data engineering, streaming technologies, and best practices to drive continuous improvement and innovation.Requirements :- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.- Proven experience working with Databricks, Spark, and PySpark in real-time data processing environments.- Strong understanding of streaming data architectures, messaging systems (e.g., Kafka), and data serialization formats (e.g., Avro, Parquet).- Hands-on experience with designing and implementing scalable data pipelines for real-time analytics use cases.- Proficiency in SQL and data modeling concepts. (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Data Engineer - Spark/PySpark (6-11 yrs) Bangalore (Analytics & Data Science)
Data Engineer - Spark/PySpark (6-11 yrs) Bangalore (Analytics & Data Science) is a Engineering Engineer Job at Akshaya IT Business Solutions located in India. Find other listings like Data Engineer - Spark/PySpark (6-11 yrs) Bangalore (Analytics & Data Science) by searching Oodle for Engineering Engineer Jobs.
Data Engineer - Spark/PySpark (6-11 yrs) Bangalore (Analytics & Data Science) is a Engineering Engineer Job at Akshaya IT Business Solutions located in India. Find other listings like Data Engineer - Spark/PySpark (6-11 yrs) Bangalore (Analytics & Data Science) by searching Oodle for Engineering Engineer Jobs.