Match score not available

Unlock Premium Benefits Today!
🚀 Elevate your career with priority access.
Stand out to top recruiters with Jobgether Priority Access:
  • ✅ Top Match: We help you identify job offers where you're a perfect fit.
  • ✅ Exclusive Referral Service: Connect directly with recruiters as a Jobgether Certified Premium User.
  • ✅ Personalized Feedback: Receive expert guidance on applications and have your profile manually reviewed.

Start Your Free Trial Now!

Start my free trial

Data Platform Engineer with Spark Experience

72% Flex
Remote: 
Full Remote
Experience: 
Mid-level (2-5 years)
Work from: 
Poland

Offer summary

Qualifications:

3+ years Python experience, 2+ years Spark (RDD API), Knowledge of OLAP, Scala, ClickHouse.

Key responsabilities:

  • Lead design and implement solutions
  • Collaborate across different teams
  • Work in high-volume production environment
Sigma Software Group logo
Sigma Software Group Large https://www.sigma.software
1001 - 5000 Employees
About Sigma Software Group
Sigma Software Group, an award-winning and trusted IT partner, has been serving customers for over 21 years, providing comprehensive IT solutions to various businesses, ranging from startups to established software product houses. As one of Europe's substantial IT consultancies, it brings together a dedicated workforce of over 2,100 professionals in 40 offices across 19 countries. With a diverse client base, including more than 300 enterprises, including Fortune 500 stalwarts, Sigma Software Group is a preferred choice for developing solutions that help businesses create cutting-edge products while meeting their unique needs.Sigma Software Group operates as a dynamic ecosystem of tech companies, offering 25 ready-to-implement innovative products and 40+ value-added services. Furthermore, Sigma Software Group is committed to fostering innovation through initiatives such as the Sigma Software Labs business incubator, Sigma Software University, the SID Venture Partners VC Fund, UA Tech Network, Techosystem, the European Business Association, and other collaborative efforts.Since 2015, Sigma Software Group has consistently earned recognition on the IAOP's prestigious World's Top 100 Outsourcing list. The company's accomplishments have also been acknowledged by prominent global media outlets such as Forbes, CNBC, The Times, and Reuters.
See more Sigma Software Group offers

Job description

Logo Jobgether

Your missions

Company Description

The Data Platform Engineer will collaborate with the client’s team, focusing on supporting, enhancing, and developing solutions to ensure their reliability and scalability. Responsibilities include maintaining existing processes, such as the Spark application for batch processing of incoming events and managing data transfers between Trino, ClickHouse, Elastic, and Firestore. 

The team is crucial to their mission, uncovering and combating bot operations such as PARETO, ICEBUCKET, 3ve, and Methbot. They strongly value deep work and flexibility, fully committing to flexible working arrangements to enable their R&D professionals to perform at their best. 

Does it sound like an interesting opportunity? Keep reading, and let’s discuss your future role. 

CUSTOMER 

Our client, founded in 2012 in Brooklyn, has grown from humble beginnings to develop the Defense Platform, the cornerstone of their product suite. This platform safeguards enterprises against advanced bot attacks, fraud, and account misuse. Currently, it authenticates over 20 trillion interactions weekly for large corporations and leading online platforms, ensuring their authenticity. 

PROJECT

The client’s platform is meant to prevent malicious ad behavior with enhanced precision through behavioral analysis, safeguarding publisher and platform reputations and revenue. 

Job Description
  • Working in a high-volume production environment 
  • Leading design and implementation of complex solutions in the platform 
  • Working across diverse teams in Product Management, Software, DevOps, and MLOps to clarify and coordinate various requirements and efforts 
  • Working as an individual contributor 

Qualifications
  • 3+ years of experience with Python 
  • Strong knowledge of data engineering fundamentals 
  • 2+ years of experience with Spark (RDD API) 
  • Solid commercial experience with OLAP  
  • Experience with Go and JavaScript (microservices/workers) 
  • Hands-on experience with Bash (infrastructure scripts) 
  • Knowledge of Scala 
  • Work experience with ClickHouse 
  • Knowledge in the AdTech domain  

WOULD BE A PLUS

  • Professional experience with any of the following technologies: 
  • Triune 
  • Jenkins 
  • Firestore 
  • Elasticsearch 
  • Datadog 
  • Nginx 
  • Airflow/Dagster 
  • Kubernetes 

Additional Information

PERSONAL PROFILE

  • Willingness to take ownership for problem solving  
  • Independence and self-reliance  
  • Good communication skills to collaborate with teams 

Required profile

Experience

Level of experience: Mid-level (2-5 years)
Spoken language(s):
English
Check out the description to know which languages are mandatory.

Hard Skills

BashClickHouseFirebaseNGINXTelecom Domain KnowledgePythonJavaScriptScalaElasticsearchDatadog MonitoringAirflowKubernetes

Soft Skills

  • Interpersonal Skills
  • Independence
  • Problem Solving
Are you interested?

Go Premium: Access the World's Largest Selection of Remote Jobs!

  • Largest Inventory: Dive into the world's largest remote job inventory. More than half of these opportunities can't be found on standard platforms.
  • Personalized Matches: Our AI-driven algorithms ensure you find job listings perfectly matched to your skills and preferences.
  • Application fast-lane: Discover positions where you rank in the TOP 5% of applicants, and get personally introduced to recruiters with Jobgether.
  • Try out our Premium Benefits with a 7-Day FREE TRIAL.
    No obligations. Cancel anytime.
Upgrade to Premium

Find more Data Engineer jobs

SEE MORE JOBS
Sign in or sign up with Google or LinkedIn