Data Engineer
- 17 Oct 2018
- Sydney
- Permanent
- Flexible Work environment -
- Cutting Edge Green field Data Engineering
- Start Up Vibe - Fully Funded
The Company
This huge Brand, with a relatively small (Sub 1000 staff) foot print is at the heart of Australia's capital market community and are embarking on an ambitious new product line leveraging data assets.
They operate a flexible work environment, promote gender & cultural diversity and need to bring on board a fantastic data engineer to build their Big Data pipeline.
The Tech
This will be a Greenfield brand new build, and likely to be on the Cloudera distribution model, using J2ee and Talend for DQ.
The Mission
This role will suit a smart, personable engineer with technical strengths in
We are looking for someone who can demonstrate a track record in building strong relationships with stakeholders across the delivery of Data Analytics.
Culture Fit
This will suit a problem solver, who takes pride in delivering quality code, enjoys a fast paced iterative environment. People that are open to taking on new responsibilities should thrive here.
This is a seriously good career move for the right guy or girl, and as always we are endeavouring to present a gender balanced short list, so Ladies & Gentleman - if this tickles your toes please apply on line
This huge Brand, with a relatively small (Sub 1000 staff) foot print is at the heart of Australia's capital market community and are embarking on an ambitious new product line leveraging data assets.
They operate a flexible work environment, promote gender & cultural diversity and need to bring on board a fantastic data engineer to build their Big Data pipeline.
The Tech
This will be a Greenfield brand new build, and likely to be on the Cloudera distribution model, using J2ee and Talend for DQ.
The Mission
- Build the big data pipeline by ingesting, filtering, sorting, joining and/or transform data sets using Talend to a Cloudera Big Data Platform based on business requirements.
- Build the data validation, reconciliation and metadata management components to support the data governance and information management processes.
- Build APIs and supporting documentation to support the consumption of data utilising Enterprise API Gateway Solutions and Talend.
- Build the data models and analytics-ready datasets to support data science and the data product development processes.
- Productise data products developed by the firm or its third party partners using Spark framework within the Cloudera platform.
- Develop unit test cases, detect quality issues, identify their root causes, implement fixes, and implement an end-to-end fully automated CI/CD pipeline.
- Provide operational support for the Data Platform products and services
This role will suit a smart, personable engineer with technical strengths in
- Core Java
- Talend or Informatica
- Big Data Dev (Hadoop. Mapreduce, Spark, Python, Kafka etc)
- Database Modelling / Data Warehousing
- Devops Exposure
We are looking for someone who can demonstrate a track record in building strong relationships with stakeholders across the delivery of Data Analytics.
Culture Fit
This will suit a problem solver, who takes pride in delivering quality code, enjoys a fast paced iterative environment. People that are open to taking on new responsibilities should thrive here.
This is a seriously good career move for the right guy or girl, and as always we are endeavouring to present a gender balanced short list, so Ladies & Gentleman - if this tickles your toes please apply on line