Lead Data Engineer

As an Azure Data Engineering Lead, who will play a pivotal role in designing, developing, and managing our data engineering solutions on the Microsoft Azure platform. You will lead a team of data engineers to deliver scalable, reliable, and secure data pipelines that enable data-driven decision-making across the organization.

Key Responsibilities:

• Technical Leadership:
  • Provide technical leadership and guidance to the data engineering team.
  • Design and implement robust and scalable data pipelines using Azure Data Factory, Azure Synapse Analytics, Databricks, and other relevant tools.
  • Develop data ingestion, transformation, and loading processes to extract value from diverse data sources.
  • Optimize data pipelines for performance and cost-efficiency.
  • Ensure data quality, integrity, and security throughout the data lifecycle.
  • Collaborate with data scientists, analysts, and business stakeholders to understand their data needs and translate them into technical solutions.
• Team Management:
  • Lead and mentor a team of data engineers.
  • Assign tasks, monitor progress, and provide timely feedback.
  • Foster a collaborative and innovative team culture.
  • Recruit and onboard new team members.
• Cloud Architecture:
  • Design and implement cloud-native data architectures on Azure.
  • Leverage Azure Data Lake Storage for efficient data storage and retrieval.
  • Utilize Azure Synapse Analytics for unified data ingestion, analytics, and ETL.
  • Explore the capabilities of Microsoft Fabric for a unified data and analytics platform.
• Data Governance:
  • Establish and enforce data governance policies and standards.
  • Implement data lineage and impact analysis to ensure data traceability.
  • Monitor data quality and identify potential issues.

Required Skills and Experience:

• Strong proficiency in Azure Data Factory, Azure Synapse Analytics, Databricks, and Azure Data Lake Storage.
• Experience with SQL, Python, and PySpark.
• Knowledge of data warehousing, data modeling, and ETL processes.
• Understanding of cloud computing principles and Azure services.
• Experience with data governance and data quality practices.
• Strong problem-solving and analytical skills.
• Excellent communication and interpersonal skills.
• Ability to lead and mentor a team of data engineers.

Preferred Qualifications:

• Experience with Microsoft Fabric.
• Certifications in Azure Data Engineering or related fields.
• Knowledge of machine learning and AI concepts.
• Experience with DevOps practices and CI/CD pipelines.

If you are passionate about data engineering and want to work with cutting-edge technologies on the Azure platform, we encourage you to apply.