Job Description
You will have a focus on the preparation, maintenance and operation of pipelines that deliver varying types of datasets, that form the basis of analysis, dashboards, statistical analysis; modelling and data quality analysis. You will have a focus on improving performance and adding features to existing data pipelines as required. Design and develop new data engineering pipelines as part of the Data Engineering Team and help decide how to implement improvements to pipeline, platforms, frameworks and infrastructure. You will be working with a broader Data Team that services this Global Company however the focus is on Australia. You will have license to be innovative in your approach and think about what you can actually deliver with the data to the business. Data sits within the IT Division. IT and Data together are instrumental in this organisations success.
Your Benefits:
- Stable Global Brand
- Azure Cloud Environment
- Full time permanent
- Hybrid Approach
- South Eastern Suburbs Melbourne
- Responsible for standards and practices for data architecture and engineering; data platform design, development and ongoing processing of logical and physical data models to support the business.
- To debug and diagnose issues within the organisations environments.
- Identify, design, and implement data pipelines to develop data sets that meet business requirements. Development of varying multi source dimensional data models, ability to work with varying stakeholders to provide guidance on data related needs
- Assist in the maintenance, optimisation and improvement of infrastructure to ensure efficiency and stability of the data platforms. Identify and implement internal process improvements to enhance delivery and scalability of the platform
- Relevant Tertiary Degree or equivalent industry based experience
- Proven experience with meta data driven frameworks for data pipelines and workflow management
- Demonstrated experience with implementations of data warehouses, data lake, data modelling and large-scale data processing systems.
- Data Engineering experience would suite this position with relevant Data Modernisation experience. Specifically experience in SAP BW to Microsoft AZURE Data Platform modernisation is very advantageous.
- Proven experience with building and optimizing data pipelines, architectures, and data sets
- Hands on technical skills and experience in dimensional modelling methodologies and frameworks is essential
- Hands on technical skills in the AZURE Data Platform (DevOps, Synapse /SQL, DataFactory, DataBricks, DataLake Gen2/Delta
- Lake, Purview) is essential
- Hands on technical experience in SAP BW and or SAP HANA desirable
- Knowledge in navigating SAP ECC and its data structures desirable
