C

Staff Data Engineer

Commonwealth Bank of Australia
Full-time
On-site
Sydney, New South Wales, Australia
Senior Jobs
  • You are passionate about making peoples jobs simpler and more rewarding

  • We are a team of big thinkers who are engineering the future of banking

  • Together we can create industry leading product lifecycles that support capabilities, people and technology

Do work that matters

Technology is the enabling force behind information technology functions for the Group to achieve the highest levels of customer experience, security and reliability, velocity, and innovation. 

In Business Banking (BB) Technology, we provide technology solutions to Business Banking domains across Business Banking and CommSec. We are empowering businesses and people to succeed with tomorrow’s technology, our purpose is to become the leading digital business bank, powered by the next horizon of technology.

See yourself in our team

We are seeking a highly driven, hands-on Staff Data Engineer who brings deep technical expertise and strong leadership capabilities. In this role, you will architect, build, and deliver business-critical data engineering solutions in payments ecosystem. You’ll lead engineering efforts across the squad, setting technical direction, mentoring engineers, and driving best practices in data engineering.

This is a high-impact role where you’ll collaborate closely with cross-functional teams, influence platform strategy, and ensure scalable, reliable data solutions. We foster an innovative and dynamic culture, with a genuine commitment to diversity, inclusion, and continuous growth. You’ll be supported by a team of passionate engineers and highly invested leaders focused on your career progression and technical leadership

We’re interested in hearing from people who

  • Have solid hands-on experience in Cloudera Data Platform and large migration programs from on-prem to Cloud

  • Are knowledgeable of Data warehousing solutions like Amazon Redshift, Google BigQuery, or Snowflake

  • Are passionate about building next generation Data platforms and Data pipeline solution across the Bank

  • Have got proven track record of Agile delivery including leading and working on end-to-end delivery of project

  • Are confident in their understanding of Data modelling, schema design, and Data architecture principles

  • Are confident leading, directing, coaching and guiding engineers

  • Pride themselves in driving pragmatic and fit for purpose solutions with high technical quality

  • Have solid hands-on experience with building Spark-based pipelines

  • Are pro-actively looking for ways to provide feedback and contribute towards Engineering and automation uplift to the Product

  • Are constantly thinking creatively and breaking boundaries to solve complex Data problems

  • Have solid understanding of DevOps practices and tools for CI/CD (e.g., Github, Jenkins, Docker, Kubernetes)

  • Are knowledgeable of Data governance practices, Data privacy regulations, and Security measures

Tech skills:

We use a broad range of tools, languages, and frameworks. We do not expect you to know them all but experience or exposure with some of these, or a willing to learn these skillsets (or equivalents) will set you up for success in this team 

  • Proven hands-on experience in large-scale distributed data processing with Spark, Scala, HDFS, MapReduce, and YARN

  • Expert-level proficiency in writing complex, optimised SQL queries

  • Strong experience in writing production-grade Python code for data processing, automation, and integration tasks

  • Hands-on experience with core AWS services including S3, Glue, Redshift, EMR and MSK. AWS certification is a plus

  • Deep understanding and hands-on experience with real-time data streaming (Kafka / MSK) and event-driven architectures

  • Expertise in handling complex file formats such as Avro, Parquet, and ORC, including nested structures

  • Solid grasp of traditional data ware housing concepts including dimensional modelling, normalisation, and star/snowflake schemas

  • Experience with modern table formats for large analytic datasets such as Apache Iceberg

  • Proficiency in building and maintaining ETL pipelines using AWS Glue or equivalent tools

Working with us

We support our people with the flexibility to balance where work is done with at least half their time connecting in our Sydney office.

We also have many other flexible working options available including changing start and finish times, part-time arrangements and job share to name a few.

If this sounds like you, apply now!

If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We’re keen to support you with the next step in your career.

We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.

Advertising End Date: 29/08/2025