Expert Data Engineer

Role Responsibilities:<\/span><\/span><\/span><\/b>
<\/span><\/span><\/p>

Data Engineers in this environment are custodians of critical data assets and pipelines. Responsibilities include:<\/span><\/span><\/span>
<\/span><\/span><\/p>

·       <\/span><\/span><\/span>Building and maintaining large -scale Big Data pipelines on cloud -based data platforms<\/span>
<\/p>

·       <\/span><\/span><\/span>Ensuring secure and compliant data sharing aligned with information classification standards<\/span>
<\/p>

·       <\/span><\/span><\/span>Supporting enterprise Data & Analytics initiatives and high -priority use cases<\/span>
<\/p>

·       <\/span><\/span><\/span>Continuously improving and automating data engineering processes<\/span>
<\/p>

·       <\/span><\/span><\/span>Evaluating emerging tools and technologies to drive innovation<\/span>
<\/p>

·       <\/span><\/span><\/span>Mentoring and upskilling team members<\/span>
<\/p>

·       <\/span><\/span><\/span>Maintaining high -quality technical documentation<\/span>
<\/p><\/span>

Requirements<\/h3>

Essential Skills:<\/span><\/b>
<\/span><\/p>

Candidates must demonstrate strong, above -average expertise in:<\/span>
<\/span><\/p>

Cloud & Infrastructure<\/span><\/b>
<\/span><\/p>

• Terraform<\/span>
  <\/span><\/span><\/li>
• Docker<\/span>
  <\/span><\/span><\/li>
• Linux / Unix<\/span>
  <\/span><\/span><\/li>
• CloudFormation<\/span>
  <\/span><\/span><\/li>
• CodeBuild / CodePipeline<\/span>
  <\/span><\/span><\/li>
• CloudWatch<\/span>
  <\/span><\/span><\/li>
• SNS<\/span>
  <\/span><\/span><\/li>
• S3<\/span>
  <\/span><\/span><\/li>
• Kinesis Streams (Kinesis, Firehose)<\/span>
  <\/span><\/span><\/li>
• Lambda<\/span>
  <\/span><\/span><\/li>
• DynamoDB<\/span>
  <\/span><\/span><\/li>
• Step Functions<\/span>
  <\/span><\/span><\/li>
• Parameter Store<\/span>
  <\/span><\/span><\/li>
• Secrets Manager<\/span>
  <\/span><\/span><\/li><\/ul>

   <\/span>
  <\/span><\/p>

  Programming & Data Engineering<\/span><\/b>
  <\/span><\/p>

  • Python 3.x<\/span>
    <\/span><\/span><\/li>
  • SQL (Oracle / PostgreSQL)<\/span>
    <\/span><\/span><\/li>
  • PySpark<\/span>
    <\/span><\/span><\/li>
  • Boto3<\/span>
    <\/span><\/span><\/li>
  • ETL development<\/span>
    <\/span><\/span><\/li>
  • Big Data platforms<\/span>
    <\/span><\/span><\/li>
  • PowerShell / Bash<\/span>
    <\/span><\/span><\/li><\/ul>

     <\/span>
    <\/span><\/p>

    Data Platforms & Tools<\/span><\/b>
    <\/span><\/p>

    • Glue<\/span>
      <\/span><\/span><\/li>
    • Athena<\/span>
      <\/span><\/span><\/li>
    • Technical data modelling & schema design (hands -on, not drag -and -drop)<\/span>
      <\/span><\/span><\/li>
    • Kafka<\/span>
      <\/span><\/span><\/li>
    • AWS EMR<\/span>
      <\/span><\/span><\/li>
    • Redshift<\/span>
      <\/span><\/span><\/li><\/ul>

       
      <\/span>Business & Analytics<\/span><\/b>
      <\/span><\/p>

      • Business Intelligence (BI) experience<\/span>
        <\/span><\/span><\/li>
      • Strong data governance and security understanding<\/span>
        <\/span><\/span><\/li><\/ul>

         <\/span>
        <\/span><\/p>

        Advantageous Skills:<\/span><\/b>
        <\/span><\/p>

        • Advanced data modelling expertise, especially in Oracle SQL<\/span>
          <\/span><\/span><\/li>
        • Strong analytical skills for large, complex datasets<\/span>
          <\/span><\/span><\/li>
        • Experience with testing, data validation, and transformation accuracy<\/span>
          <\/span><\/span><\/li>
        • Excellent documentation, written, and verbal communication skills<\/span>
          <\/span><\/span><\/li>
        • Ability to work independently, multitask, and collaborate within teams<\/span>
          <\/span><\/span><\/li>
        • Experience building data pipelines using AWS Glue, Data Pipeline, or similar<\/span>
          <\/span><\/span><\/li>
        • Familiarity with AWS S3, RDS, and DynamoDB<\/span>
          <\/span><\/span><\/li>
        • Solid understanding of software design patterns<\/span>
          <\/span><\/span><\/li>
        • Experience preparing technical specifications, designing, coding, testing, and debugging solutions<\/span>
          <\/span><\/span><\/li>
        • Strong organisational abilities<\/span>
          <\/span><\/span><\/li>
        • Knowledge of Parquet, AVRO, JSON, XML, CSV<\/span>
          <\/span><\/span><\/li>
        • Experience with Data Quality tools such as Great Expectations<\/span>
          <\/span><\/span><\/li>
        • Experience working with REST APIs<\/span>
          <\/span><\/span><\/li>
        • Basic networking knowledge and troubleshooting skills<\/span>
          <\/span><\/span><\/li>
        • Understanding of Agile methodologies<\/span>
          <\/span><\/span><\/li>
        • Experience with documentation tools such as Confluence and JIRA<\/span>
          <\/span><\/span><\/li><\/ul>
          
          <\/span><\/div>

          Qualifications & Experience<\/span><\/b>
          <\/span><\/p>

          • Relevant IT, Business, or Engineering Degree<\/span>
            <\/span><\/span><\/li>
          • Experience developing technical documentation and artefacts<\/span>
            <\/span><\/span><\/li>
          • Experience with enterprise collaboration tools<\/span>
            <\/span><\/span><\/li><\/ul>

             <\/span>
            <\/span><\/p>

            Preferred Certifications<\/span><\/b>
            <\/span><\/p>

            Candidates with one or more of the following will be prioritised:<\/span>
            <\/p>

            
            <\/div>

            ·       <\/span><\/span><\/span>AWS Cloud Practitioner<\/span>
            <\/p>

            ·       <\/span><\/span><\/span>AWS SysOps Associate<\/span>
            <\/p>

            ·       <\/span><\/span><\/span>AWS Developer Associate<\/span>
            <\/p>

            ·       <\/span><\/span><\/span>AWS Architect Associate<\/span>
            <\/p>

            ·       <\/span><\/span><\/span>AWS Architect Professional<\/span>
            <\/p>

            ·       <\/span><\/span><\/span>HashiCorp Terraform Associate<\/span>
            <\/p><\/span>