Data Engineering Lead

Contract type: Permanent
Location: Melbourne
Industry: Technology Business Intelligence
Salary Great $, AWS, Snowflake, Lead role
Start Date: 2021-04-06
Reference: V-114607
Contact name: Donna Bowen
Contact email:
Job published: April 07, 2021 09:33

Job Description

Are you an experienced Lead Data Engineer how has worked with large datasets? This client is in the Essential Services sector and can offer role stability. You will be working in a fast-paced environment. You will be responsible for data pipelines in AWS, DevOps CI/CD and the data preparing and manipulation for the data visualisation and advanced analytics team.  This role will drive the data pipelines and direction of the technical team.  

You will be working with a high performing technical team. You will be an integral part in enhancing the data engineering capability. If you have exposure to snowflake and matillion this will be beneficial but not essential.

Your Benefits:
  • Immediate full-time role
  • Melbourne CBD
  • High performing team
  • Cool Tech – AWS/Snowflake/Matillion
Your Role:
  • Lead the technical team from a technical perspective to streamline and automate the data processes and in providing a scalable cloud solution (AWS)
  • Design, building and maintaining the data pipelines for the business (ETL) in AWS
  • Be responsible for best practice in legacy systems, SQL and # (transformation)
  • Ensure the accuracy of code quality, logging, exception management and performance.
  • Be responsible for the data modelling, data mining and statistical skills for the descriptive profiling, segmentation, predicative models for the purpose of answering business questions
  • Build internal relationships with stakeholders and translate their business requirements into a technical requirement
  • Build reusable code, libraries, patterns and consumable frameworks for data sourcing, staging, transform, conforming and extraction
  • Automation testing and deployment
  • Guide, support and mentor junior team members

You will need to have: 
  • Bachelor of IT/Engineering or relevant/equivalent industry experience
  • Demonstrated experience in a Technical Lead/Team/Leader role
  • Proficient commercial experiences with Python and PySpark  (and/or C#, C++)
  • Must be proficient in AWS
  • Proven experience in SQL, NoSQL and ETL
  • Ideal but not essential experieince with Matillion and Snowflake 
  • Excellent communication and stakeholder management skills (essential)
  • Proven experience across data warehousing and reporting platforms 
  • Proven experience working in an agile environment
  • Current full Australian working rights (no sponsorship)

 This client has great tenure with its current employees due to excellent work perks such as bonus structure, flexibility and leave.

This is an exciting opportunity for a passionate and Technical Lead Data Engineer. You will be supported by a motivated, professional and collaborative team. APPLY NOW. Reviewing applications as they come through. 


Employee turnover on the rise?

Stop it now with our

Ultimate Guide to Remote Employee Retention!

Get your free guide now >>