Lead Data Engineer
Staples India Business Innovation Hub
Full-time
On-site
Chennai, Tamil Nadu, India
Senior Jobs
Duties & Responsibilities
<\/div>
<\/div>
Design, develop, and maintain scalable ETL/ELT data pipelines to support business and analytics needs
<\/div>
<\/div>
Write, tune, and optimize complex SQL queries for data transformation, aggregation, and analysis
<\/div>
<\/div>
Translate business requirements into well -designed, documented, and reusable data solutions
<\/div>
<\/div>
Partner with analysts, data scientists, and stakeholders to deliver accurate, timely, and trusted datasets
<\/div>
<\/div>
Automate data workflows using orchestration/scheduling tools (Airflow, ADF, Luigi, etc.)
<\/div>
<\/div>
Develop unit tests, integration tests, and validation checks to ensure data accuracy and pipeline reliability
<\/div>
<\/div>
Document pipelines, workflows, and design decisions for knowledge sharing and operational continuity
<\/div>
<\/div>
Apply coding standards, version control practices, and peer code reviews to maintain high -quality deliverables
<\/div>
<\/div>
Proactively troubleshoot, optimize, and monitor pipelines for performance, scalability, and cost efficiency
<\/div>
<\/div>
Support function rollouts, including being available for post -production monitoring and issue resolution
<\/div><\/span>
Requirements<\/h3>
<\/div><\/span>
Requirements<\/h3>Qualifications
<\/div>Basic Qualifications
<\/div>Bachelor’s degree in computer science, Information Systems, Engineering, or a related field
<\/div>6 -8 years of hands -on experience in data engineering and building data pipelines
<\/div>At least 3 years of experience in writing complex SQL queries in a cloud data warehouse/ data lake environment.
<\/div>Solid hands -on experience with data warehousing concepts and implementations
<\/div>At least 1 year of experience with Snowflake or another modern cloud data warehouse
<\/div>At least 1 year of hands -on Python development (scripting, OOP, ETL/ELT automation)
<\/div>Familiarity on Data modeling and Data warehousing concepts
<\/div>Experience with orchestration tools (e.g., Airflow, ADF, Luigi)
<\/div>Familiarity with at least one cloud platform (AWS, Azure, or GCP)
<\/div>Experience with DBT (Data Build Tool) for data transformations
<\/div>Familiarity with CI/CD and version control (Git) in data engineering projects
<\/div>Strong analytical, problem -solving, and communication skills
<\/div>Ability to work both independently and as part of a collaborative team
<\/div>
<\/div>Preferred Qualifications
<\/div>Exposure to real -time/streaming platforms (Kafka, Spark Streaming, Flink)
<\/div>Exposure to the e -commerce or customer data domain
<\/div>Understands the technology landscape, up to date on current technology trends and new technology, brings new ideas to the team
<\/div>
<\/div><\/span>
<\/div>
Basic Qualifications
<\/div>
<\/div>
Bachelor’s degree in computer science, Information Systems, Engineering, or a related field
<\/div>
<\/div>
6 -8 years of hands -on experience in data engineering and building data pipelines
<\/div>
<\/div>
At least 3 years of experience in writing complex SQL queries in a cloud data warehouse/ data lake environment.
<\/div>
<\/div>
Solid hands -on experience with data warehousing concepts and implementations
<\/div>
<\/div>
At least 1 year of experience with Snowflake or another modern cloud data warehouse
<\/div>
<\/div>
At least 1 year of hands -on Python development (scripting, OOP, ETL/ELT automation)
<\/div>
<\/div>
Familiarity on Data modeling and Data warehousing concepts
<\/div>
<\/div>
Experience with orchestration tools (e.g., Airflow, ADF, Luigi)
<\/div>
<\/div>
Familiarity with at least one cloud platform (AWS, Azure, or GCP)
<\/div>
<\/div>
Experience with DBT (Data Build Tool) for data transformations
<\/div>
<\/div>
Familiarity with CI/CD and version control (Git) in data engineering projects
<\/div>
<\/div>
Strong analytical, problem -solving, and communication skills
<\/div>
<\/div>
Ability to work both independently and as part of a collaborative team
<\/div>
<\/div>
<\/div>
<\/div>
Preferred Qualifications
<\/div>
<\/div>
Exposure to real -time/streaming platforms (Kafka, Spark Streaming, Flink)
<\/div>
<\/div>
Exposure to the e -commerce or customer data domain
<\/div>
<\/div>
Understands the technology landscape, up to date on current technology trends and new technology, brings new ideas to the team
<\/div>
<\/div><\/span>
<\/div>
<\/div><\/span>