MABASA / LINKEDIN
Data Engineer
Viable Solutions Pty Ltd
- Location
- Sydney, New South Wales, Australia
- Work type
- fulltime
- Source publication date
- Original publication date not confirmed
- Source closing date
- Not supplied — check original advert
Job description from the source
Responsibilites • Building and maintaining dbt transformation models across multiple pipeline layers — from raw ingestion through to governed, consumer\-ready datasets • Writing Snowflake SQL for complex transformations: type casting, deduplication, incremental load logic, surrogate key generation • Developing and debugging Apache Airflow DAGs on AWS ECS • Contributing to AWS Lambda\-based ingestion( Python) — file validation, control file generation, S3 event handling • Maintaining source\-to\-target mapping documentation and aligning models to business requirements and data specs • Supporting onboarding of downstream consumers via data sharing mechanisms and event\-driven notifications • Participating in code reviews, writing YAML\-based data quality tests, and owning tickets from design through to production Tech stack required • Strong SQL • Proficiency with dbt Core • Apache Iceberg Table format (Nice to have) • Apache Airflow • AWS \- Working Knowledge of S3, Lambda, MWAA, ECS, Glue Catalogs, Lake Formation, Lambda, SQS, EventBridge • Experience with fixed\-format or structured financial data files • CICD with Github Actions.
Check the original advert before applying
Apply through the employer or original publisher. An external site may require registration. Opening an advert does not submit an application.
Content is supplied by an external publisher and may change. For source and availability limits, read our listing disclaimer. How to check an original listing ↗