Offer summary

Qualifications:

Minimum 5 years of professional experience as a Data Engineer., Proficiency in Python and Pyspark for data processing., Experience with Apache Spark 3.x, including RDD and SQL DataFrame., Knowledge of database integration, performance tuning, and related tools..

Key responsibilities:

Build and maintain large data pipelines using Pyspark and cloud technologies.

Analyze and transform raw data from various sources to support business needs.

Optimize data processing jobs for performance and efficiency.

Document code and produce unit tests to ensure data pipeline reliability.

As the largest holder of onsite search data outside the walled gardens, Captify is the leader in real-time audiences and insights, fueled by Search Intelligence. Captify’s solutions power pre-campaign strategy, programmatic activation, and unique measurement for the world’s biggest brands. Connecting searches from over 3 million websites globally, Captify helps brands understand consumer interests, motivations and mindsets. Search behavior provides a view into consumer intent, which is then made actionable through machine learning technology. Search Intelligence fuels flexible, cookieless, omnichannel solutions, to bring brands new, real-time audiences, publishers greater yield and consumers the most relevant digital experiences.

ABOUT CAPTIFY

Captify is the leading Search Intelligence Platform for the open web and the largest independent holder of firstparty search data outside of the walled gardens, connecting the realtime searches from over 2 billion devices globally. Its Search Intelligence technology powers omnichannel programmatic advertising and realtime insights for the world’s biggest brands, such as Disney, Unilever, eBay, MercedesBenz, Microsoft, Nestlé, GSK, Uber, Mars, P&G, Sony and Toyota—without reliance on thirdparty cookies. Captify brings brands more customers, publishers greater yield and consumers the most relevant digital experiences.

OUR CULTURE AND VALUES:

Here at Captify we are proud of our culture It’s contagious. Pass it on.

Step inside any of our global offices and one thing that is blissfully obvious is that while we’re putting blood, sweat and tears into disrupting the Search game, we’re having a seriously good time doing it. We’ve travelled the world together, enjoyed Captify Festivals, parties and our famous events across every market. We always take time to stop to celebrate milestones and wins.

We live by our core values:

Building this together

Give a shit

Fail fast to succeed faster

Unlimited potential

Find out more about our culture here: https:careers.captify.co.uk

OVERVIEW
We are looking for a Senior Data Engineer who will be working as part of the Data Products team responsible for building identity segmentation solutions, optimising programmatic advertising campaigns, and measuring their performance and other KPIs.
Search on its own is a highly complex dataset. Captify’s technologies have been built to extract maximum value from search for brands, partners and businesses all over the world and also to innovate & improve the consumer experience.
Captify’s worldclass engineers, semantic specialists and product teams are building the future of Search, and as part of our Engineering Team you will play a key part in developing our offering.
KEY RESPONSIBILITIES
What you’ll be doing:

You will clean, transform, and analyse vast amounts of raw data from various systems using Pyspark

Run large jobs on Kubernetes, AWS and Databricks

Build massive data pipelines

Produce unit tests

Code Documentation

REQUIREMENTS:
What you need to be successful:

5 years + professional experience as a Data Engineer

Proficiency in PythonPyspark.

Apache Spark 3.x: RDD, SQL DataFrame

Spark query tuning and performance optimization

PSQL database integration

Some experience working with PrometheusGrafana, S3, Athena, Apache Kafka, Airflow and Pandas

ScalaJava experience is a plus

StatisticsMLAI knowledge is a plus

YOU WILL ENJOY:
Generous holiday + bank holidays + your birthday + volunteer day

Regular shutdown days, including the festive period

Hybrid or remote working depending on location

Private healthcare (Depending on location and contract)

Access to SPILL instant therapy support

Access to Mental Health First Aiders

Financial wellbeing support

Work from any Captify office in the world
EQUAL OPPORTUNITIES
You are welcome at Captify for who you are, no matter where you come from, what you look like, or what your search history says about you. At Captify, equality is at the core of our culture and we are committed to building an inclusive global team that represents a variety of backgrounds, perspectives, beliefs, and experiences. The more diverse we are, the richer our community and the broader our impact. We don’t want you to fit in with our culture, we want you to add to our culture.
For candidates, view our EU HR Candidate Privacy Notice here .