Job Description
This is a fantastic opportunity to really make a difference to their business. You will be joining a close-knit team that has a collaborative culture where its members are valued. This is a dynamic project environment.
Their environment is fully in Azure and you will be building data pipelines using ADF and Databricks. You will be dealing with live streaming data to feed into the data models. You will be responsible for the Integrations between different systems - including roadmap for integration between salesforce and another Platform. Build out data delivered by API's and make an industry focused data lake.
Your Benefits:
- Full time permanent role
- Azure + Databricks
- Melbourne hybrid
- Project Environment
- Sustainability client
- Build and maintain data pipelines in Azure and own the data integration
- You will be responsible for planning data management & architecture projects, maintaining and improving the data within production systems and establishing strong data governance.
- Responsible for master data, reference data and metadata management solutions
- Be responsible for the data modelling, data architecture, data quality management, profiling, cataloguing and data lineage concepts and implementation
- Acquire, ingest, and process data from multiple sources and systems into our data platforms
- Facilitate conversations between the business and vendors
You will need:
- Masters or bachelor's degree in Computer Science, or equivalent industry experience
- Demonstrated experience as a Data Engineer (Mid to Senior level)
- Experienced in data warehousing and star schemas
- Knowledge of Microsoft Azure Data Stack e.g. Azure Data Factory and Data Lake
- Experience with Azure Logic App, Azure API Management and Azure Databricks
- Advanced skills in SQL and NoSQL databases
- Experience in consuming and aggregating data from multiple sources, including APIs
- Proficient in data extraction, manipulation, and presentation
- Adept at working with cross functional groups across multiple geographies
APPLY NOW.
