Equal Opportunity Employer
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, protected veteran status, or disability status. EEO/AA/M/F/Disabled/Vets
Job Description :
About the Role
We are looking for a Senior Data Engineer with experience in excellent analytical abilities in GCP BigQuery, ETL/BI, Python, Composer/Airflow, SQL, GCP Services - with the ability to operate in an agile environment and keen to detail while understanding the larger data warehouse.
Skills & Competencies
- A minimum of 4.5+ years of working experience as a hands-on data engineering is a must
- Advanced Degree in the field of Computer Science, Data Engineering, Data Analytics or equivalent discipline
- Strong programming experience with Python, SQL, ETL and efficiently querying big datasets using SQL
- Prior experience with CircleCI CI/CD, Terraform and Github version control is a must
- Solid understanding of Data Collection, Data Ingestion, Data Integration, and Data Operations & Maintenance
- Implement data governance practices, including data quality, security, and compliance, in line with organizational standards.
- Domain knowledge on News, Media & Communications is an added advantage.
Responsibilities
- Design, build, and maintain scalable ETL/ELT pipelines in Google Cloud, using tools like Cloud Composer (Airflow), and BigQuery.
- Collaborate with cross-functional teams to define data architecture and data warehouse requirements
- Automate data pipelines, ETL/ELT processes, and data integration workflows using infrastructure-as-code (IaC) and configuration management tools
- Deep understanding of BigQuery, including SQL, optimization techniques, partitioning, clustering, and performance tuning.
- Deliver production quality, modular, reproducible code in Python, SQL
- Implement continuous integration and continuous deployment (CI/CD) pipelines for data pipelines and data-related applications
- Keep abreast of the latest developments in the field through continuous learning and proactively champion promising new methods relevant to the problems at hand.
Our Tech Stack
- Google Cloud Platform is IaaS
- BigQuery, GCS, Python, SQL
- Composer / Airflow - orchestration tools
- Terraform, CircleCI, CI/CD, GIthub, Jira, Confluence
This job is posted with NTS Technology Services Pvt. Ltd.
Job Category: