Luminary Talent Sourcing logo

Senior Data Engineer

Luminary Talent Sourcing
Contract
On-site
Johannesburg, Gauteng, South Africa
Senior Jobs
We are looking for a skilled Senior Data Engineer to join our team in Fairlands, Johannesburg. The ideal candidate will have expertise in SQL coding, particularly in the Redshift and PostgreSQL, and a deep understanding of data warehousing principles. Experience in AWS Redshift and S3 is key. Abinitio ETL experience is desirable. This role requires working on -premises and involves close collaboration with data science and analytics teams.<\/span><\/span><\/span>
<\/span><\/span><\/div>

<\/span><\/span><\/div>

<\/span><\/span><\/div>

Key Responsibilities<\/span>
<\/span><\/span><\/p>

  • Design, build, and optimize data pipelines in AWS Redshift.<\/span>
    <\/span><\/span><\/li>
  • Develop and optimize complex SQL queries and scripts, with a focus on Redshift/PostgreSQL.<\/span>
    <\/span><\/span><\/li>
  • Manage and optimize Redshift databases for diverse applications.<\/span>
    <\/span><\/span><\/li>
  • Implement and adhere to data warehousing principles and best practices.<\/span>
    <\/span><\/span><\/li>
  • Utilize S3 and, preferably, Abinitio ETL tools for efficient data handling.<\/span>
    <\/span><\/span><\/li>
  • Ensure data quality and integrity in all processes.<\/span>
    <\/span><\/span><\/li>
  • Collaborate with various teams to understand and meet data requirements.<\/span>
    <\/span><\/span><\/li>
  • Troubleshoot and resolve issues in data processes and systems.<\/span>
    <\/span><\/span><\/li>
  • Stay updated with new trends and technologies in data engineering.<\/span><\/span>
    <\/li><\/ul>

    <\/div>
    ​<\/span><\/span>
    <\/div>

    KINDLY TAKE NOTE THAT THE RECRUITMENT AND SELECTION PROCESS WILL INVOLVE <\/span>
    <\/p>

    ​<\/span>PSYCHOMETRIC ASSESSMENTS<\/span>.<\/span>
    <\/p>

    ​<\/span>
    <\/span><\/span><\/div>

    <\/div><\/span>

    Requirements<\/h3>
    • Bachelor’s degree in Computer Science, Engineering, or a related field.<\/span>
      <\/span><\/span><\/li>
    • Minimum of 5 years of experience in data engineering or a similar role.<\/span>
      <\/span><\/span><\/li>
    • Strong expertise in SQL coding, especially in a Redshift and PostgreSQL environment.<\/span>
      <\/span><\/span><\/li>
    • Solid understanding of data warehousing concepts.<\/span>
      <\/span><\/span><\/li>
    • Proficiency in AWS Redshift and S3.<\/span>
      <\/span><\/span><\/li>
    • Experience with Abinitio ETL is beneficial but not required.<\/span>
      <\/span><\/span><\/li>
    • Excellent problem -solving and analytical skills.<\/span>
      <\/span><\/span><\/li>
    • Effective communication skills and ability to work in a team environment.<\/span>
      <\/span><\/span><\/li><\/ul>

      <\/div><\/span>