Lead Data Engineer

Role Overview:

We are looking for a skilled Lead Data Engineer to design, build, and manage scalable data pipelines and architectures. You will lead a team of data engineers, collaborate with cross-functional stakeholders, and drive best practices in data engineering to support data-driven decision-making.

Key Responsibilities:

• Lead the design, development, and deployment of robust data pipelines and ETL/ELT processes.
• Architect scalable, secure, and high-performance data platforms on cloud/on-prem environments (AWS, GCP, Azure).
• Mentor and guide a team of data engineers, providing technical leadership and fostering collaboration.
• Collaborate with data scientists, analysts, and business teams to understand data requirements and deliver solutions.
• Optimize data workflows for performance, cost, and reliability.
• Implement data governance, quality, and security standards.
• Monitor and troubleshoot data infrastructure issues, ensuring high availability.
• Stay updated with emerging data technologies and recommend adoption as appropriate.

Qualifications:

• Proven experience in data engineering with strong hands-on skills in ETL, data warehousing, and big data technologies.
• Expertise in SQL, Python, Spark, and cloud data services (e.g., AWS Glue, BigQuery, Snowflake).
• Experience leading and mentoring data engineering teams.
• Familiarity with data modeling, pipeline orchestration (Airflow, Control-M), and data governance frameworks.
• Strong problem-solving, communication, and stakeholder management skills.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.