Sabenza IT & Recruitment logo

Senior Data Engineer (Native Databricks Preferred)

Sabenza IT & Recruitment
Full-time
On-site
Cape Town, Western Cape, South Africa
Senior Jobs

We are seeking a highly skilled <\/span><\/span>Senior Databricks Engineer / Architect<\/span><\/span><\/b> with hands -on experience in <\/span><\/span>native Databricks environments<\/span><\/span><\/b> and a proven track record in <\/span><\/span>SAP to Databricks data migration<\/span><\/span><\/b> projects. The ideal candidate will be responsible for designing, implementing, and optimizing scalable data architectures that support advanced analytics, data engineering, and business intelligence initiatives.
<\/span><\/span><\/p>


<\/div><\/span>

Requirements<\/h3>

Key Responsibilities<\/span><\/span><\/b>
<\/span><\/span><\/h3>
  • Design and architect scalable data platforms and pipelines within <\/span><\/span>native Databricks environments<\/span><\/span><\/b>.<\/span>
    <\/span><\/span><\/p><\/li>

  • Lead and execute <\/span><\/span>SAP to Databricks migration<\/span><\/span><\/b> projects, ensuring seamless data integration and transformation.<\/span>
    <\/span><\/span><\/p><\/li>

  • Collaborate with business stakeholders, data engineers, and analysts to define architecture and data strategy.<\/span>
    <\/span><\/span><\/p><\/li>

  • Implement best practices for <\/span><\/span>data governance, security, and performance optimization<\/span><\/span><\/b> on the Databricks platform.<\/span>
    <\/span><\/span><\/p><\/li>

  • Develop and maintain <\/span><\/span>data models, ETL processes<\/span><\/span><\/b>, and <\/span><\/span>automation frameworks<\/span><\/span><\/b> for high -performance analytics.<\/span>
    <\/span><\/span><\/p><\/li>

  • Guide and mentor technical teams on Databricks architecture, implementation standards, and platform utilization.<\/span>
    <\/span><\/span><\/p><\/li>

  • Work closely with cloud teams (Azure, AWS, or GCP) to ensure seamless integration with enterprise data ecosystems.<\/span>
    <\/span><\/span><\/p><\/li>

  • Stay current with Databricks feature releases and advancements to continuously enhance platform capabilities.<\/span>
    <\/span><\/span><\/p><\/li><\/ul>

    Requirements<\/span><\/span><\/b>
    <\/span><\/span><\/h3>
    • Databricks Platform Architect Certification<\/span><\/span><\/b> (mandatory).<\/span>
      <\/span><\/span><\/p><\/li>

    • 3+ years of hands -on experience<\/span><\/span><\/b> working with <\/span><\/span>native Databricks environments<\/span><\/span><\/b>.<\/span>
      <\/span><\/span><\/p><\/li>

    • Proven experience in <\/span><\/span>migrating data from SAP systems to Databricks<\/span><\/span><\/b>.<\/span>
      <\/span><\/span><\/p><\/li>

    • Strong expertise in <\/span><\/span>PySpark, SQL, Delta Lake, and Databricks Workflows<\/span><\/span><\/b>.<\/span>
      <\/span><\/span><\/p><\/li>

    • Solid understanding of <\/span><\/span>data warehousing concepts, data modeling, and ELT/ETL design patterns<\/span><\/span><\/b>.<\/span>
      <\/span><\/span><\/p><\/li>

    • Experience integrating Databricks with <\/span><\/span>cloud data platforms<\/span><\/span><\/b> (AWS S3, GCP Storage, or Azure).<\/span>
      <\/span><\/span><\/p><\/li>

    • Knowledge of <\/span><\/span>data governance, lineage, and security best practices<\/span><\/span><\/b>.<\/span>
      <\/span><\/span><\/p><\/li>

    • Excellent problem -solving, analytical, and communication skills.<\/span>
      <\/span><\/span><\/p><\/li>

    • Experience in <\/span><\/span>leading or architecting enterprise data solutions<\/span><\/span><\/b>.<\/span>
      <\/span><\/span><\/p><\/li><\/ul>


      <\/div><\/span>

Apply now
Share this job