Job Description
You will be working with a high performing technical team. You will be an integral part in enhancing the data engineering capability. If you have exposure to snowflake and matillion this will be beneficial but not essential. Location options of Brisbane or Melbourne.
Your Benefits:
- Immediate full-time role
- Melbourne CBD or Brisbane
- High performing team
- Cool Tech – AWS/Snowflake/Matillion
- Building and maintaining the data pipelines for the business (ETL) in AWS
- Provide leadership through guiding other data engineers/scientists & software engineers on software engineering best practices, scalable cloud architectures that focus on greater functionality and flexibility in our data systems;
- Own the designs and implementations of data pipelines, and data models, and advise on good practices for operating at scale;
- Develop an understanding of strategic business initiatives and apply your expertise in Data Engineering for translating new requirements into scalable and sustainable data solutions;
- Be responsible for best practice in legacy systems, SQL and # (transformation)
- Ensure the accuracy of code quality, logging, exception management and performance.
- Be responsible for the data modelling
- Build internal relationships with stakeholders and translate their business requirements into a technical requirement
- Build reusable code, libraries, patterns and consumable frameworks for data sourcing, staging, transform, conforming and extraction
- Automation testing and deployment
- Bachelor of IT/Engineering or relevant/equivalent industry experience
- Experience in developing reliable, high quality, well tested software solutions
- Proficient experience within the AWS Cloud environment with data services such as AWS S3, AWS EC2, AWS Lambda, AWS Kinesis, AWS Glue, AWS Athena, AWS
- Hands-on, proficient experience with programming in Python and PySpark building data management solutions and; working with business intelligence and visualisation tools (e.g. Tableau, Power BI);
- You are comfortable being responsible for continuous deployment, operation, and monitoring of your data solutions and their infrastructure;
- Strong technical proficiency in SQL, NoSQL and experience working with queues & event streams;
- DevOps – CI/CD
- Excellent communication and stakeholder management skills (essential)
- Proven experience across data warehousing and reporting platforms
- Proven experience working in an agile environment
- Current full Australian working rights (no sponsorship)
