Lead Data Engineer –Azure
Admin LooksUrgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including 7+ years of expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog. This is a remote role requiring excellent leadership, technical, and problem-solving skills.
Key Responsibilities
•Leadership: Lead and mentor a team of data engineers, ensuring project deliverables are met with high quality and on time.
•Architecture and Design: Design and implement scalable, secure, and efficient data solutions using Azure services.
•Development: Build, monitor, and optimize complex data pipelines and workflows using Azure Data Factory and Azure Databricks.
•Data Modeling: Design robust data models to support analytical and operational needs.
•Programming: Write and optimize SQL queries and utilize PySpark for large-scale data processing and transformation.
•Data Governance: Implement data security and governance frameworks using Unity Catalog and ensure compliance with organizational standards.
•Collaboration: Work closely with business stakeholders, data scientists, and analysts to understand requirements and translate them into technical solutions.
•Problem-Solving: Troubleshoot and resolve data-related issues to ensure seamless operations and data availability.
•Process Improvement: Advocate and implement best practices in data engineering, coding standards, and Agile methodologies.
Qualifications and Skills
Experience:
12+ years of professional experience in data engineering and analytics.
7+ years of hands-on expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog.
Leadership: Proven experience in leading and managing engineering teams, with the ability to inspire and guide team members effectively.
Technical Expertise:
Deep understanding of Azure cloud services and data ecosystems.
Strong knowledge of ETL/ELT processes and big data architectures.
Proficient in Python and SQL for data manipulation and analysis.
Soft Skills:
Excellent communication and collaboration abilities in a remote environment.
Problem-solving mindset with a focus on innovation and continuous improvement.
Ability to manage multiple priorities and meet tight deadlines.
Preferred: Familiarity with Agile and DevOps practices.