Log In
Sign Up
Software
Telstra Hiring for Data Sourcing Engineer Job at Australia Full Time
br{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]>
Employment Type
Permanent
Closing Date
28 Nov 2022 11:59pm
Job Title
Data Sourcing Engineer
Job Summary
Job Description
Being part of Networks & IT means you’ll be part of a team that focuses on extending our network superiority to enable the continued execution of our digital strategy.
The role with us
As a Data Sourcing Engineer you will:
- Participate in agile scrum ceremonies such as sprint planning, backlog grooming, estimation, and review.
- Support new development activities and improve application performance
- Ensure technical debt is managed in line with group level OKR’s and Telstra best practises
- Assist supporting application monitoring and performance management
- Uplift and maintain codebases ensuring they are fit for purpose with careful attention to risk mitigation.
- Triage and diagnose pipeline faults using tools like tcpdump, nslookup and curl.
- Work with other mission members and TPO’s to plan roadmaps and scope technical work
- Writing & presenting technical documentation to assist others
- Actively contribute to the evaluation of complex business information to define the business problem and create and implement best practice solutions
- Collaborate closely with Senior Data Engineers and Architects to contribute to the development and construction of data design ideas that deliver data optimisation and meet business requirements
- Install (wrangling/ingestion and curation processes), test and maintain data systems using a combination of data sources, analytical techniques and insight generation
- Source, probe and analyse data sets acquired from varying sources using a range of programming languages, tools and techniques to enable data to be ingested and curated, in preparation for loading and application of the sourced data
- Uncover and investigate data quality issues forensically and methodically within a highly complex data landscape and help identify ways to improve data reliability, efficiency and quality.
- Prepare data for predictive and prescriptive modelling, perform analysis, fix issues and ensure data meets quality requirement in order to contribute to cross-team (within mission/chapter/function) work
- Actively contribute to the design and development of embedded firmware frameworks to support the deployment of Telstra developed services on existing customer gateways.
- Participate in the building of tools and processes to support the infrastructure, development of streaming software and DevOps practices
- Present complex technical information to both technical and non-technical stakeholders in a way that optimises the engagement and facilitates agreement on project scope, milestones and deliverables
- Identify tasks that can be automated and participate in pushing for change to increase stability and speed of the platforms and products
- Safeguard application information against accidental or unauthorized damage, modification or disclosure by operating within standard practices, procedures, change control and testing processes.
About you
We utilize tools such as Docker, Kubernetes, NixOS, Puppet and are trialling Openshift for automation. We use Grafana, Influx, VictoriaMetrics in concert with Prometheus Alert Manager and Nagios for alarming, instrumentation, and dashboards. Practicing a true Dev-ops culture you will be responsible for maintaining CI/CD pipelines and will use tools such as Git, Bitbucket, Bamboo, Jenkins to assist.
To be successful in this role you will need to have solid skills in developing software in a Linux based environment with one or more of Python, Perl, or Elixir.
An understanding of Git, Docker and relational databases such as MySQL or PostgreSQL is also needed. Having previous experience with Kubernetes will be advantageous but is not strictly required. Additionally, you will be exposed to wide-ranging data lakes and ETL Pipelines, so having a good understanding of big data practices is incredibly useful, but not necessary.
You will need skills in software development as you will be challenged by large-scale custom-built data pipelines that need to operate at maximum scale to achieve desired throughput. As such, a keen desire to learn will be important to your success. You will also need to have strong organisational and communication skills to work with your remote colleagues.
Key Skills
- Coding (Bash, Elixir, Perl, Python)
- Time Series Databases (VictoriaMetrics, Influx)
- Event streaming (Kafka)
- Prometheus/AlertManager
- Container Technologies (Kubernetes/Docker)
- MySQL/Postgresql
- Collecting metrics with Telemetry and/or SNMP
- Data visualisation
- Restful API’s
- Data Management
- ETL
- Continuous Integration
- Continuous Deployment
- Data warehousing
- Presentation
- Attention to detail
If this opportunity sounds like a perfect fit for you, we’d encourage you to apply!