Job
Summary:
We are
seeking a highly skilled Data Engineer to design, develop, and maintain
robust data pipelines and architectures. The ideal candidate will transform
raw, complex datasets into clean, structured, and scalable formats that enable analytics,
reporting, and business intelligence across the organization. This
role requires strong collaboration with data scientists, analysts, and
cross-functional teams to ensure timely and accurate data availability and
system performance.
Key
Responsibilities:
- Design and implement scalable
data pipelines to support real-time and batch processing.
- Develop and maintain ETL/ELT
processes that move, clean, and organize data from multiple sources.
- Build and manage modern data
architectures that support efficient storage, processing, and access.
- Collaborate with stakeholders to
understand data needs and deliver reliable solutions.
- Perform data transformation,
enrichment, validation, and normalisation for analysis and reporting.
- Monitor and ensure the quality,
integrity, and consistency of data across systems.
- Optimize workflows for performance,
scalability, and cost-efficiency.
- Support cloud and on-premise
data integrations, migrations, and automation initiatives.
- Document data flows, schemas,
and infrastructure for operational and development purposes.
- Apply best practices in data
governance, security, and compliance.
Required
Skills & Qualifications:
- Bachelor’s or Master’s degree in
Computer Science, Data Engineering, or a related field.
- Proven 6+ Years experience in data
engineering, ETL development, or data pipeline management.
- Proficiency with tools and
technologies such as:
- SQL, Python, Spark, Scala
- ETL tools (e.g., Apache Airflow, Talend)
- Cloud platforms (e.g., AWS, GCP, Azure)
- Big Data tools (e.g., Hadoop, Hive, Kafka)
- Data warehouses (e.g., Snowflake, Redshift, BigQuery)
- Strong understanding of data
modelling, data architecture, and data lakes.
- Experience with CI/CD, version
control, and working in agile environments.
Preferred
Qualifications:
- Experience with data
observability and monitoring tools.
- Knowledge of data cataloguing and governance frameworks.
- AWS/GCP/Azure data certification
is a plus.