IT & Telecomms […]
Melbourne […]
Flexible working arrangements
Must have extensive experience working with Databricks […]
Lead Data Engineer required to lead the design and development of end-to-end data pipelines for a leading financial services business. […]
design and development of pipelines using Databricks and Lakehouse
optimisation and maintenance of data workflows, ensuring quality and integrity
performance tuning and monitoring
Notebook development using Pyspark and Spark SQL
implementation of best practices for data engineering, including governance and security
mentoring and coaching...