Melbourne, Australia

William Librata

Senior Data Engineer

Data Engineer with 13+ years of experience designing robust, high-performing, and fault-tolerant data pipelines. Highly skilled in SQL and Python, with deep expertise in data modeling, data warehousing, pipeline architecture, and performance tuning across structured, semi-structured, and unstructured data.

  • 13+ Years Experience
  • SQL & Python
  • AWS & Azure
  • Data Warehousing & ETL
View Experience

About Me

I am a Data Engineer with more than 13 years of experience designing and building robust, high-performing, and fault-tolerant data processing pipelines. My background spans data modeling, data warehousing, data pipeline architecture, and performance tuning, with hands-on experience across structured, semi-structured, and unstructured data.

I currently work as a Senior Data Engineer supporting a major public health service in Melbourne, where I focus on real-time data movement, cloud migration, and analytics enablement. Earlier in my career I worked across data analytics, SaaS, and CRM/marketing businesses, delivering data warehouses, data lakes, ETL pipelines, and reporting platforms on both cloud (AWS, Azure) and on-premise (SQL Server) infrastructure.

I am highly skilled in SQL and Python, and have a strong interest in cloud, web API, and database technologies. I have a fast-learning, can-do attitude and enjoy staying current with new tools and approaches in the data engineering space.

Core Skills

Programming Languages

  • Python
  • SQL
  • T-SQL
  • PL/pgSQL
  • Bash
  • C#
  • VBA

Databases & Data Stores

  • Microsoft SQL Server
  • PostgreSQL
  • MySQL
  • PostGIS
  • Redis
  • DynamoDB

Cloud Platforms – AWS

  • CloudFormation
  • S3
  • EC2
  • Route 53
  • Glacier
  • RDS
  • IAM
  • SQS
  • Kinesis
  • Lambda
  • Redshift

Cloud Platforms – Azure

  • Blob Storage
  • App Services
  • Function App
  • Data Factory
  • Virtual Machines
  • Private Endpoints
  • Azure Infrastructure

Data Integration, ETL & Frameworks

  • pETL
  • SSIS
  • Django REST Framework
  • Celery
  • Leaflet

Analytics & Reporting

  • SSRS
  • Power BI
  • Microsoft Office Suite
  • QGIS

DevOps, Automation & Monitoring

  • Terraform
  • Vagrant
  • Packer
  • Team City
  • Octopus Deploy
  • GIT
  • SVN
  • New Relic
  • SQL Diagnostic Manager

Operating Systems

  • Windows
  • OSX
  • FreeBSD
  • Ubuntu

Professional Experience

Data Engineer

Alfred Health · Melbourne, Australia

August 2021 – Present

Alfred Health is the main provider of health services to people living in the inner south-east suburbs of Melbourne and a major provider of specialist services across Victoria, operating three facilities: The Alfred, Caulfield, and Sandringham.

  • Responsible for delivering analytics solutions around real-time data movement and cloud migration.
  • Collaborated with the Analytics Partnering team to deliver advanced analytics projects.
  • Developed a near real-time NLP data pipeline.
  • Enhanced data warehouse functionality.
  • Designed and implemented cloud infrastructure using Infrastructure as Code (IaC).
  • Developed the data warehouse semantic layer using DBT.
  • Designed and developed cloud migration strategy.
  • Proactively monitored and maintained both on-premise and cloud data warehouse environments.

SQL Developer

Alfred Health · Melbourne, Australia

November 2020 – August 2021

  • Worked within the Knowledge Management team providing technical capability and support to maintain data integrity in the data warehouse.
  • Collaborated with the Analytics Partnering team to deliver cloud-based analytics solutions.
  • Designed and developed robust, scalable data pipelines using Python and Azure serverless technologies to process structured and semi-structured data.
  • Developed a Power BI report for a Mental Health dashboard.
  • T-SQL programming and development in MS SQL Server.
  • Created ETL packages to cater to regular automated data requests.
  • Performed quality checks on reports and exports to ensure data quality.
  • Held full responsibility for data integrity in the data warehouse system, monitoring reliability and availability.
  • Extracted data for data registries, research, and other business and ad hoc purposes.
  • Performed database performance tuning as required.

Senior Database Developer

illion

September 2017 – November 2020

illion (formerly Dun & Bradstreet Australia) is a data analytics company and one of the largest independent data providers in Australia and New Zealand, well known as a consumer and commercial credit score provider and debt collection agency.

  • Worked in the database team as part of Enterprise IT, primarily as a data specialist across data modeling, ETL pipelines, data warehousing, data lakes, and online reporting.
  • Developed automated, complex, high-performing ETL pipelines both in the cloud (AWS) and on-premise (SSIS).
  • Designed, built, and maintained data warehouses in the cloud (AWS Redshift) and on-premise (SQL Server).
  • Designed, built, and maintained a data lake in AWS using Lambda and S3.
  • Worked closely with data scientists to deliver machine learning solutions using SSIS and Python.
  • Performed SQL Server performance tuning for both OLTP and OLAP environments.
  • Built, set up, and configured new SQL Server instances for OLTP and OLAP environments.
  • Developed database objects (triggers, stored procedures, functions) via T-SQL programming.
  • Developed online reporting solutions using SSRS.
  • Performed data modeling.
  • Secured data using database encryption, SSL connections, data masking, and database auditing.
  • Designed physical database structures (partitioning, sharding) for optimum performance.
  • Advised development and architecture teams on database design, performance, and disaster recovery.
  • Delivered monthly sessions covering trends and best practices for the database team.

Developer (Data)

InterfaceIT & GeoOp · Melbourne, Australia

May 2012 – September 2017

InterfaceIT was a Melbourne-based SaaS start-up building an enterprise-grade door-to-door sales mobile application for Android and iOS. In June 2016, InterfaceIT was acquired by GeoOp, a publicly listed SaaS company based in New Zealand that builds job management systems for Android and iOS.

  • Worked in a small agile team developing data solutions using test-driven development methodologies.
  • Focused on enriching and expanding data coverage across multiple countries using various cloud and database technologies.
  • Developed ETL processes using Python to process geospatial data.
  • Developed a scalable data processing framework using Python and AWS technologies including S3, Lambda, SQS, and EC2.
  • Designed and built a data lake in AWS using S3 and Lambda.
  • Designed and built a data warehouse on AWS Redshift.
  • Researched, analysed, and acquired new datasets to expand data coverage and capabilities.
  • Developed backend REST APIs using Python Django REST Framework to support the web console and mobile applications.
  • Analysed and resolved data quality-related issues.
  • Identified and resolved SQL Server and PostgreSQL performance-related issues.

Production Team Leader

Results Direct Pty Ltd

September 2011 – May 2012

Results Direct is a data-driven marketing services company focused on CRM, working with multinational companies such as Club21 (representing Calvin Klein and Armani), GM Holden, Hyundai, and KIA.

  • Managed a team of 3 operations support members and 2 database developers.
  • Responsible for accuracy and timely delivery of daily, weekly, and monthly recurring tasks.
  • Provided technical support to team members when required.
  • Mentored team members on database-related topics.
  • Led new in-house project delivery and resource acquisition.
  • Delivered monthly database-related tech talks and presentations.

Analyst Programmer

Results Direct Pty Ltd

May 2008 – September 2011

  • Member of the backend team responsible for automating manual production ETL processes using VBA, SQL Server, and SSIS.
  • Performed root cause analysis when required.
  • Developed ETL processes using SSIS.
  • Automated manual processes using VBA and T-SQL.
  • Ensured on-time delivery of critical reporting to clients.

Education & Certifications

Certifications

  • AWS Certified Data Analytics – Specialty October 2020
  • Microsoft Certified Solutions Expert: Data Management and Analytics December 2018
    • Exam 461: Querying Microsoft SQL Server 2012/2014
    • Exam 462: Administering Microsoft SQL Server 2012/2014 Databases
    • Exam 463: Implementing a Data Warehouse with Microsoft SQL Server 2012/2014
    • Exam 70-762: Developing SQL Databases
  • AWS Certified Solutions Architect – Associate June 2017

Education

  • Bachelor of Computing Monash University, Australia February 2006 – December 2007
    • Specialisation in Object-Oriented Systems Development and Distributed Computing Systems.
    • Achieved excellent grade in programming and system design course.
  • Diploma of Information and Technology Monash International College February 2005 – February 2006
    • Maintained excellent grades in all Information and Technology topics.
  • Certificate IV of Information and Technology Curtin International College June 2004 – February 2005
    • Graduated from the Certificate IV program in the Information Technology stream.
    • Received a certificate of excellence in Accounting.

Contact

I’m open to hearing about new opportunities and professional connections.