Senior Data Engineer
Evnek Technologies
Full-time
On-site
Bangalore, Karnataka, India
Senior Jobs
Job Role: Senior Data Engineer
Experience: 5+yrs
Location: Bengaluru
Notice Period: Max 30days
Role Overview
We are seeking a Senior Data Engineer to design, build, and maintain robust
data ingestion frameworks and scalable pipelines. You will be instrumental in
shaping platform architecture, implementing efficient data models, and
delivering cloud-based solutions to handle both real-time and batch processing
on a scale.
Key Responsibilities
- Design,
develop, and optimize DBT models for scalable, maintainable data
transformations.
- Architect
and implement modern ELT pipelines leveraging DBT and orchestration tools
such as Apache Airflow or Prefect.
- Lead
query optimization and performance tuning for DBT models on Snowflake, Redshift,
or Databricks.
- Integrate
DBT workflows and pipelines with AWS services (S3, Lambda, Step Functions,
RDS, Glue) and event-driven architectures.
- Build
robust ingestion processes from diverse sources, including Manufacturing
Execution Systems (MES), manufacturing stations, and web applications.
- Manage
and monitor orchestration tools to ensure automated, reliable execution of
DBT models.
- Implement
CI/CD best practices for DBT, including version control, automated
testing, and streamlined deployment workflows.
- Troubleshoot
and resolve pipeline issues while optimizing for cost and performance.
Qualifications
- 5+
years of hands-on DBT experience, including model design, testing, and
optimization.
- 5+
years of strong SQL experience, with proven skills in query optimization
and database performance tuning.
- 5+
years of programming experience, including custom DBT macros, scripting,
APIs, and AWS integrations using boto3.
- 3+
years of experience with orchestration tools like Apache Airflow or Prefect.
- Proven
experience with cloud data platforms (Snowflake, Redshift, Databricks, or BigQuery).
- Hands-on
knowledge of AWS data services (S3, Lambda, Step Functions, RDS, SQS, CloudWatch).
- Familiarity
with serverless architectures and infrastructure as code (CloudFormation, Terraform).
- Strong
communication skills with the ability to deliver MVPs aligned with sprint
timelines.
- Excellent
analytical and problem-solving abilities, with a track record of
cross-functional collaboration.
Nice to Have
- Experience
in hardware manufacturing data processing.
- Contributions
to open-source data engineering projects.
- Knowledge
of BI tools such as Tableau for data visualization.
- Understanding
of front-end technologies (React, JavaScript, or similar) for building
internal visualization tools or collaborating with UI teams.