Match score not available

Unlock Premium Benefits Today!
🚀 Elevate your career with priority access.
Stand out to top recruiters with Jobgether Priority Access:
  • ✅ Top Match: We help you identify job offers where you're a perfect fit.
  • ✅ Exclusive Referral Service: Connect directly with recruiters as a Jobgether Certified Premium User.
  • ✅ Personalized Feedback: Receive feedback and expert guidance on applications, and have your profile manually reviewed.

Start Your Free Trial Now!

Start my free trial

Cloud Data Administrator (Spark)

Remote: 
Full Remote
Contract: 
Full time
Experience: 
Mid-level (2-5 years)
Work from: 
Poland

Offer summary

Qualifications:

Min. 4 years Apache Spark experience, Proficiency in Spark SQL, Python, and monitoring tools.

Key responsabilities:

  • Administrate Spark Clusters (PaaS) using Terraform
  • Optimize resource management and performance
NATEK logo
NATEK Information Technology & Services SME https://natek.eu/
501 - 1000 Employees
About NATEK
NATEK specializes in designing and implementing IT business solutions to support our partners in the digital transformation of their companies. Based on our unique position in CEE region we have been implementing projects for global clients since 2004. Together with our team of IT experts, we support our partners through Network Services, SAP Services, Customer Support, Cloud Services and Software Development Services and QA. NATEK is proud to be trusted by global organizations from Banking, Healthcare, Technology, Automotive, Telco and many more sectors. Our mission is to deliver high quality IT outsourcing solutions & BPO within Central and Eastern Europe to help companies empower their IT organizations. Originating from France, NATEK was established in Czech Republic in 2004. The company currently operates in Bulgaria, Czech Republic, Poland and Slovakia. Our dynamic team of over 600 employees comes from over 20 different locations worldwide. Make sure to follow this page for fresh updates on our projects as well as job opportunities within NATEK and news on the IT sector. You can also visit our website at: http://natek.eu or simply follow us on other social media: Facebook: facebook.com/NATEKworkITwithUS Twitter: twitter.com/Natek_eu Instagram: instagram.com/natek.eu/
See more NATEK offers

Job description

Job Description

BI Development Team is in the process of moving into Azure Cloud. One of the main areas is to administrate Spark Clusters (PaaS). Join us and be part of the Global BI Admin Team.

You’ll be working with a team located in Germany, but the entire project is conducted remotely. Communication is in English.

Your Responsibilities


  • Setup Synapse Linked Services and MS Synapse workspaces including Spark Clusters using Terraform
  • Spark version upgrades
  • Using Kafka, Oracle, etc.
  • Resource Management, Memory usage, optimizing CPU and resource usage for Spark Application
  • Launching and running executors on worker nodes
  • Monitor executor performance and scalability
  • Detecting handle worker node failures
  • Reallocating resources and restarting spark jobs
  • Monitoring the Spark cluster health, resource utilization, and job execution metrics
  • Monitoring by using Grafana and Prometheus
  • Performance tuning by fine-tuning Spark parameters
  • Working with Developers and helping to for improvement of code
  • IT Team Management


Our Requirements


  • Min. 4 years of experience with Apache Spark: Advanced knowledge of Spark architecture, including components (RDDs, DataFrames, Datasets)
  • Very good knowledge of Spark SQL
  • Proficiency in setting up, configuring, and maintaining Spark clusters
  • Understanding of YARN
  • Ability to optimize Spark jobs, memory usage, and parallelism
  • Familiarity with monitoring tools (preferred: Grafana and Prometheus)
  • Hadoop: HDFS, Hive, and other related technologies
  • Proficiency in Python, pyspark and spark SQL
  • Knowledge of securing Spark clusters and data.
  • Ability to troubleshoot
  • Experience in managing an IT team
  • Good communication with developers, data engineers, and stakeholders.
  • Experience in cross-functional teams


Benefits


  • Internal Mobility Program – enjoy many opportunities for career growth, job rotations, diversity of projects & technologies
  • Referral Program – enjoy cooperation with your colleagues and get a bonus!
  • 5/10 Years NATEK Club – we offer long-term cooperation and celebrate each fifth-year cooperation anniversary with gifts
  • NATEK CSR Events & team buildings – enjoy our values: accountability, partnership and expertise and #workITwithus
  • Cafeteria
  • Medical Healthcare
  • Multisport Club Card
  • Technical and Personal training
  • Language courses


Additionally only for CoW:


  • Life insurance
  • Bonuses for Personal Events
  • Day off for volunteering


Required profile

Experience

Level of experience: Mid-level (2-5 years)
Industry :
Information Technology & Services
Spoken language(s):
English
Check out the description to know which languages are mandatory.
Are you interested?

Database Administrator Related jobs

See more Database Administrator jobs
Sign in or sign up with Google or LinkedIn