See Similar Listings
India   India   Engineer   Physicswallah -

PhysicsWallah - Data Engineer - ETL (1-3 yrs) Bangalore (Analytics & Data | Engineer in Engine1

PhysicsWallah

This listing was posted on hirist.

PhysicsWallah - Data Engineer - ETL (1-3 yrs) Bangalore (Analytics & Data

Share
Tools
Location:
Bangalore
Description:

Working Experience :- Minimum 1 year of work experience.- Startup experience preferred, Streaming Platform, Edtech work experience bonus. Roles & Responsibilities :- Develop ETL (Extract, Transform, Load) processes to move and transform data between systems.- Integrate data from various sources, ensuring consistency and accuracy.- Monitor system performance and identify areas for optimization.- Align architecture with business requirements and provide solutions which fit best to solve the business problems.- Build the infrastructure required for optimal ETL pipelines from a wide variety of data sources using SQL and AWS big data technologies.- Evaluate and recommend new technologies to enhance data processing capabilities.- Work closely with data scientists, analysts, and other stakeholders to understand their data needs.- Use programming language( python, spark) and tools efficiently to collate the data.- Identify ways to improve data reliability, efficiency and quality.- Use data to discover tasks that can be automated.Skill Sets :- Can Develop ETL (Extract, Transform, Load) processes to move and transform data between systems.- Have good hands-on experience in any coding language Python or Scala.- Good understanding of Data Engineering concepts such as data warehousing, datalakes, data modeling, data quality assurance, data lifecycle management, streaming data, metadata management etc.- Strong hold on cloud-based ecosystems(AWS preferred).- Have an understanding of data pipeline orchestration tools such as Airflow or Azkaban (Airflow Preferable).- Can work with spark, EMR and Kubernetes cluster.- Can write spark jobs, shell scripts and optimized data pipelines.- Experience with relational SQL and NoSQL databases, including Postgres, Amazon Redshift and MongoDB.- Have an understanding of OOPS-based data platforms, and can develop data platform modules.- Good understanding of backend APIs and their use cases. (ref:hirist.tech)
Education/experience:
1 To 2 Years
Company:
Physicswallah
Posted:
April 27 on hirist
Share
Tools
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
  • Always meet the employer in person.
  • Avoid sharing sensitive personal and financial information.
  • Avoid employment offers that require a deposit or investment.

To learn more, visit the Safety Center or click here to report this listing.

More About this Listing: PhysicsWallah - Data Engineer - ETL (1-3 yrs) Bangalore (Analytics & Data
PhysicsWallah - Data Engineer - ETL (1-3 yrs) Bangalore (Analytics & Data is a Engineering Engineer Job at Physicswallah located in India. Find other listings like PhysicsWallah - Data Engineer - ETL (1-3 yrs) Bangalore (Analytics & Data by searching Oodle for Engineering Engineer Jobs.