Logo for Equal Experts South Africa

Senior Data Engineer

Role overview

Qualifications

  • Significant experience working on data pipelines, platforms and projects.
  • Experience in developing solutions in one or more of the main Cloud providers (AWS, GCP, Azure).
  • Strong background in at least one programming language, Python or Scala preferable.
  • Strong collaboration and communication skills, including the ability to communicate effectively while working remotely with globally distributed teams.

Responsibilities

  • Working with the client and the team to determine data processing and access needs and how best to deliver them.
  • Creation and support of highly available data pipelines and storage solutions (e.g. data warehouses).
  • Delivery of software using agile (pair programming, TDD, CI/CD, etc) practices.
  • Mentoring client team members.

About the company

Equal Experts South Africa logo

Equal Experts South Africa

IT Services & IT Consulting

Equal Experts are the innovative team members you want by your side solving business problems through expert software delivery. With over 3,000 consultants across 5 continents, all of whom have more than double the standard number of industry years of experience, Equal Experts has built a formidable culture of adding value to our clients, our team members and the software development industry. The South African team offers a unique experience for any software delivery team member wanting a different, more adult way of working. Our remote first ethos means that our teams work in a high trust environment of their choosing, where the focus is on great communication, excellent team sharing and high performance. The culture of innovation, low ego and knowledge sharing is inherent not only internally where Equal Experts consultants are encouraged to share their expertise and continuous learning with their EE community, but is something we extend into our customer engagements as well, helping to grow those we work with and adding value across the client engagement. We are a team that is excited to contribute to the growth of those around us, a team that builds skills while adding value, and that makes incremental changes that add up to momentous shift. We decide with data, design for users, deliver at pace and scale sustainably.

Company details

Company typeScaleup
IndustryIT Services & IT Consulting
Company size501 - 1000

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for blue-chip enterprise and public sector clients across a range of industry sectors. We work on important projects for our clients, deliver market-leading propositions across the digital, online and mobile channels, and are recognised for our leadership in the application of agile and lean delivery methods to assure delivery. We have offices in Australia, India, South Africa, the UK, the EU and the USA.


Our Data Engineers are highly skilled in creating data pipelines for ingest, transformation and storage of data, usually at scale, and are familiar with standing-up analytics clusters.


This role involves using modern agile technical practices - including Continuous Integration and Deployment, TDD, and XP - to deliver timely and pragmatic solutions, as well as helping others to do their jobs in a more effective way.

 

Responsibilities

  • Working with the client and the team to determine data processing and access needs and how best to deliver them.
  • Creation and support of highly available data pipelines and storage solutions (e.g. data warehouses).
  • Delivery of software using agile (pair programming, TDD, CI/CD, etc) practices.
  • Automation of data infrastructure and deployments. 
  • Advocating agile practices to the client organisation.
  • Mentoring client team members.
  • Helping improve the team and clients’ data capabilities.

 

Required Skills

  • Significant experience working on data pipelines, platforms and projects.
  • Experience in developing solutions in one or more of the main Cloud providers (AWS, GCP, Azure).
  • Strong background in at least one programming language, Python or Scala preferable.
  • Working with a variety of databases, data warehouses and distributed file systems in production environments.
  • Strong experience in SQL and data modelling.
  • Exposure with data processing at scale.
  • Knowledge about GDPR and data security.
  • Working with source control and infrastructure as code (Git/Github, Terraform, ansible etc.) and CI/CD tools.
  • Understanding and being able to support data scientists or business intelligence teams - in data prep, mentoring and support functions.
  • Strong collaboration and communication skills, including the ability to communicate effectively while working remotely with globally distributed

*This role is only open to candidates that are based in South Africa 

Apply once. Then go straight to the hiring manager.

After you apply, unlock the direct contact details of the people who actually make the call. A quick follow-up makes you 5x more likely to land an interview.

MR

Marcus Rivera

Chief Revenue Officer

m.rivera@company.com
linkedin.com/in/marcusrivera
Unlocked after you apply
Β·

Data Engineer Related jobs

Other jobs at Equal Experts South Africa

Premium

Reach out to the hiring manager directly.

Gain access to the contact details of the hiring managers who actually decide, and reach out to network with them directly. That, plus more when you upgrade:

  • Full match report with fit score and gaps
  • Career diagnostics on how recruiters read you
  • Curated company matches and warm intros
  • 48h early access to new roles

Cancel anytime.