MABASA / LINKEDIN
DataBricks Engineer
BULLIT MANAGEMENT SERVICES LIMITED
- Location
- Sydney, New South Wales, Australia
- Work type
- fulltime
- Source publication date
- Original publication date not confirmed
- Source closing date
- Not supplied — check original advert
Job description from the source
• Minimum 8+ years in development/software engineering and has extensively knowledge of working in Agile organisations. • Strong Python and SQL skill and good to have Java experience. • Have hands-on experience building complex data pipelines, • Have extensive experience with Apache PySpark, Python, Azure Synapse, ADF, Azure Functions, data models and ETL pipelines. • Have experience in setting up and optimizing both SQL and NoSQL data stores (MS-SQL, ADLS Gen2), as well as familiarity with object storage services (e.g., ADLS Gen2, Big Data), • Experience in managing and further developing distributed systems and clusters for batch processing, • Knowledge of MLOps architecture and practices, • Experience with modern data modelling concepts and large-scale data warehousing architecture. • Basic understanding of modern DevOps tool set, e.g. Azure DevOps, Git. • Knowledge of ETL and data warehousing methods, good to have Informatica experience.
Check the original advert before applying
Apply through the employer or original publisher. An external site may require registration. Opening an advert does not submit an application.
Content is supplied by an external publisher and may change. For source and availability limits, read our listing disclaimer. How to check an original listing ↗