Senior Big Data Engineer

Remote: 
Full Remote
Contract: 
Work from: 
Ukraine

Offer summary

Qualifications:

Minimum 3 years of hands-on development experience., Proficiency in Java and Python for data-oriented products., Experience with big data frameworks like Spark, Hadoop, and Airflow., Knowledge of distributed databases and microservices architecture..

Key responsibilities:

  • Design and develop scalable data processing and machine learning pipelines.
  • Investigate new technologies and rapidly learn their applications.
  • Take ownership of product development from requirements to deployment.
  • Collaborate with remote teams in an agile environment.

Commit logo
Commit SME https://www.comm-it.com/
501 - 1000 Employees
See all jobs

Job description

Description


  • Design and develop a scalable data processing and ML pipeline using the latest big data technologies in a fast paced agile environment
  • Investigate new technological areas and understand them in depth through rapid self-learning
  • Demonstrates strong analytical problem-solving skills to support scalable and sustainable design solutions
  • Ability to take ownership of product development including all life cycle stages: translating product requirements into actionable designs and tasks, development, UT, and production troubleshooting

Requirements


  • At least 3 years of hands-on development experience
  • Experience developing data-oriented products using Java/Python -Must
  • Experience in data processing FW such as Spark, Pandas, Hadoop, Airflow
  • Experience in Distributed Databases (Such as Elasticsearch, Mongo, Redis, etc)
  • Experience with developing microservices-based architecture
  • Experience working in container-based environments using tools such as K8s, helm
  • Experience working as a software developer in an Agile environment

Nice to have:

  • Experience in machine learning FWs such as SKLearn, Tensorflow
  • Experience with RedHat OpenShift
  • Dev Environment knowledge: GIT, Jenkins, Docker
  • Working with hybrid teams remotely.

Required profile

Experience

Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Analytical Thinking
  • Distributed Team Management

Data Engineer Related jobs