Intraedge Technologies Ltd.
This listing was posted on hirist.
Big Data Engineer - Google Cloud Platform (3-8 yrs) Gurgaon/Gurugram (Analytics
Location:
Gurgaon/Gurugram
Description:
Job Description :We are seeking a skilled Big Data GCP Engineer to join our team. The ideal candidate will have substantial experience with Google Cloud Platform (GCP) and a strong background in Big Data technologies. This role involves working with various GCP services and tools to design, develop, and optimize data processing pipelines and workflows.Key Responsibilities :GCP Data Engineering :- Design, implement, and maintain data processing pipelines using GCP services such as BigQuery, DataProc, Airflow, Cloud Composer, and GCP Hydra Services.- Optimize and manage data storage and retrieval processes to ensure efficient performance and cost-effectiveness.Big Data Technologies :- Utilize Hive, PySpark, and Python to develop and manage Big Data solutions.- Implement data transformations, aggregations, and data enrichment processes.Data Pipeline Development :- Develop and maintain ETL processes to integrate and process large datasets from various sources.- Ensure data quality, reliability, and security in all data processing activities.Workflow Automation :- Use Airflow and Cloud Composer to automate data workflows and orchestrate complex data processing tasks.- Monitor and troubleshoot data pipelines to ensure smooth and uninterrupted operations.Performance Optimization:- Optimize data processing jobs for performance and scalability.- Implement best practices for data storage, indexing, and partitioning in BigQuery and other GCP services.Collaboration and Support :- Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective solutions.- Provide technical support and troubleshooting for data-related issues.Documentation and Best Practices :- Maintain comprehensive documentation of data pipelines, workflows, and processes.- Adhere to industry best practices and standards in Big Data and cloud engineering.Required Skills and Qualifications : - Education: Bachelor's degree in Computer Science, Information Technology, or a related field.Experience :- 3+ years of hands-on experience with GCP services such as BigQuery, DataProc, Airflow, Cloud Composer, and GCP Hydra Services.- 3-8 years of experience in Big Data engineering.Technical Skills :- Proficient in Hive, PySpark, and Python.- Strong understanding of data warehousing concepts and best practices.- Experience with cloud data optimization and cost management.Soft Skills :- Strong problem-solving and analytical skills.- Excellent communication skills, both verbal and written.- Ability to work effectively in a team-oriented, collaborative environment.Personal Attributes :- Self-motivated, proactive, and able to work independently.- Strong attention to detail and commitment to delivering high-quality solutions. (ref:hirist.tech)
Visit Our Partner Website
This listing was posted on another website. Click here to open: Go to hirist
Important Safety Tips
- Always meet the employer in person.
- Avoid sharing sensitive personal and financial information.
- Avoid employment offers that require a deposit or investment.
To learn more, visit the Safety Center or click here to report this listing.
More About this Listing: Big Data Engineer - Google Cloud Platform (3-8 yrs) Gurgaon/Gurugram (Analytics
Big Data Engineer - Google Cloud Platform (3-8 yrs) Gurgaon/Gurugram (Analytics is a Engineering Engineer Job at Intraedge Technologies located in India. Find other listings like Big Data Engineer - Google Cloud Platform (3-8 yrs) Gurgaon/Gurugram (Analytics by searching Oodle for Engineering Engineer Jobs.
Big Data Engineer - Google Cloud Platform (3-8 yrs) Gurgaon/Gurugram (Analytics is a Engineering Engineer Job at Intraedge Technologies located in India. Find other listings like Big Data Engineer - Google Cloud Platform (3-8 yrs) Gurgaon/Gurugram (Analytics by searching Oodle for Engineering Engineer Jobs.