Data Engineer (GCP)
Data Engineer (Google Cloud Platform - GCP)Job OverviewWe are seeking a skilled Data Engineer with expertise in Google Cloud Platform (GCP) to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have hands-on experience with GCP services such as BigQuery, Dataflow, Pub/Sub, Cloud Composer, Cloud Storage, and Dataproc, and strong programming skills in Python, SQL, or Java.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes using GCP services.
- Build and optimize data warehouse solutions using BigQuery.
- Develop real-time and batch data processing workflows using Apache Beam, Dataflow, and Pub/Sub.
- Automate workflows and orchestrate pipelines with Cloud Composer (Apache Airflow).
- Work with structured and unstructured data to support business analytics and machine learning initiatives.
- Implement data governance, security, and compliance best practices.
- Collaborate with data analysts, data scientists, and business stakeholders to define data requirements.
- Monitor and optimize data processing performance, scalability, and cost efficiency.
- Develop CI/CD pipelines for data engineering solutions using Terraform, Cloud Build, or similar tools.
Required Skills & Qualifications
- 3+ years of experience in data engineering.
- Hands-on experience with Google Cloud Platform (GCP) services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer.
- Strong programming skills in Python, SQL, or Java.
- Expertise in ETL development, data modeling, and data warehousing.
- Experience with Apache Beam, Apache Airflow, or Spark.
- Proficiency in writing complex SQL queries and optimizing database performance.
- Familiarity with Terraform, Kubernetes, or Docker is a plus.
- Understanding of data security, compliance, and governance best practices.
- Experience with streaming data architectures is a plus.
- Strong problem-solving and communication skills.
Preferred Qualifications
- Google Cloud Professional Data Engineer certification is a plus.
- Experience in machine learning pipelines and MLOps.
- Knowledge of NoSQL databases (Firestore, Bigtable, or MongoDB).
- Experience with BI tools like Looker, Tableau, or Power BI.
Job Type
Payroll
Categories
Data Engineer (Software and Web Development)
Cloud Architects (Software and Web Development)
DevOps Engineers (Software and Web Development)
Data Scientist (Software and Web Development)
Data Analysts (Information Design and Documentaion)
Must have Skills
- BigQuery - 3 Years
- Intermediate
- DATAPROC - 3 Years
- Intermediate
- GCP - 3 Years
- Intermediate
- Apache Beam - 3 Years
- Intermediate
- GCP Dataflow - 3 Years
- Intermediate
- Apache Spark - 3 Years
- Intermediate