Data Platform Engineer

Job Description

As a Data Platform Engineer, you’ll be at the heart of building and evolving our modern data platform, powered by Azure Data Factory, Azure SQL, Databricks, Synapse Analytics, and AI Foundry. This platform is critical to how we deliver analytics, insights, and AI capability across the organisation.

You’ll ensure the platform is reliable, scalable, and high-performing, enabling trusted data delivery at pace, while playing a key role in supporting AFCA’s growing data and AI ambitions.

Staying ahead of cloud-native innovation, you’ll continuously look for ways to enhance architecture, drive automation, and improve efficiency, helping future-proof our platform and keep us aligned to our enterprise vision.

What you’ll be doing:

• Design, build and maintain scalable data pipelines, lake and lakehouse architectures across Azure (ADF, Databricks, Synapse, Azure SQL)
• Develop robust batch and streaming pipelines to deliver reliable, high-quality data across the organisation
• Drive best practice through CI/CD, infrastructure as code, automated testing and observability
• Monitor and optimise performance, cost and reliability (clusters, jobs, queries and governance)
• Contribute to data models and architectures that enable analytics and AI/ML use cases
• Ensure solutions align with security, privacy and data governance standards
• Partner closely with data analysts, engineers, scientists and AI teams to improve platform capability and developer experience

Qualifications

To be successful in this role, you will need:

• Strong experience in data engineering or data platform roles, with demonstrated hands-on expertise in Azure Data Factory, Azure SQL, Databricks, Synapse Analytics and the broader Azure data ecosystem or similar (e.g. Fabric).  
• A Bachelor degree in Computer Science, Information Systems or relevant field
• Proficiency in SQL, Python, PySpark and Spark SQL, with experience building and optimising data pipelines at scale.  
• Experience with lakehouse, Delta Lake and medallion architecture patterns. Familiarity with infrastructure-as-code tools (e.g. Terraform, ARM) and Azure DevOps CI/CD practices for data platform deployments.  
• Understanding of data modelling concepts, data warehousing principles and modern data platform architectures.  
• Exposure to supporting AI/ML workloads on Databricks (e.g. MLflow, model serving, feature engineering) highly regarded.  
• Experience with or exposure to Azure AI Foundry highly regarded.  
• Experience in financial services, digital‑first organisations or highly regulated environments highly regarded. 
• Excellent stakeholder management skills, with the ability to clearly communicate end elicit requirements from non-technical audiences. 
• Growth mindset with a practical, outcome‑focused approach. 
• Customer‑centred, pragmatic and delivery‑oriented. 

Additional Information

• Silver AWEI Accreditation 2025 – Recognised for LGBTQ+ workplace inclusion.
• Accredited Family Friendly Workplace – Supporting work-life balance and inclusivity.
• Hybrid working – Flexible arrangements with two days a week in our modern offices designed for collaboration and wellbeing.
• Additional and inclusive leave options – Flexible public holidays, gender affirmation leave, women’s health leave, and bonus paid time off over the end of year holiday period.

To apply

If you’re passionate about fairness and believe your skills align with this role, we encourage you to apply even if you don’t meet every single criterion.

We welcome applications from people of all backgrounds, cultures, abilities, sexual orientations, and gender identities. If you require any accessibility support during the recruitment process, please reach out to our team at [email protected].

We believe fairness starts with people. That’s why we don’t use AI or automated tools to screen candidates. As a result, our processes may take a little longer, and we thank you for your patience.

About AFCA

The Australian Financial Complaints Authority (AFCA) was established in 2018 as a private not-for-profit ombudsman service providing free, fair and independent help with financial disputes. The original team has grown to over 1600 dedicated professionals. Since 2018, AFCA has received more than 634,000 complaints, helping to secure $2.1 billion in compensation for consumers. 

AFCA is a 2026 Circle Back Initiative Employer - we are committed to responding to every applicant.