Data Engineer

Our client, a leading global IT service provider, is recruiting for a Data Engineer to join their business in Poland / Spain.

Key Responsibilities:

• Data engineer in the pRED MLOps product team
  

• The pRED MLOps team offers an opportunity to grow your technical skills by joining a multi disciplinary team and getting support to learn about new technologies in the very exciting field of MLOps. We are looking for a data engineer with a passion for Machine Learning Operations to join our team in pRED to help us grow our platform. You will also get exposed to pRED's work and unique Machine Learning efforts in drug discovery.
  

Parameters:

• FTE Allocation need: Full time, Poland
  

• Engagement duration: ASAP, open end
  

• Validated project: No
  

Position:

• In this role, you will be:
  

• Supporting the productive deployment and operationalization of key ML models for the pRED organization, with a particular focus on the management and processing of the data and its underlying technology required for these models.
  

• Inspiring our team and  data scientists to follow best practices when it comes to data management and processing in the context of ML
  

• Working with data scientists who create ML models to help them understand how to better manage and validate the quality of theirdata related to their ML models as well as their data processing pipelines
  

• Translating the data scientist's requirements into technical solutions that you and the product team can implement
  

• Designing and deploying Kube Flow pipelines and inference services while following the pRED MLOps best practices
  

• Building, managing and optimizing key services and their underlying databases
  

• Contributing to the establishment of monitoring technologies in our technical stack, with a focus both on infrastructure but also on ML outputs.
  

• Contributing to the development of the pRED MLOps tools and technical stack, including new solutions for data management and processing in the context of MLOps
  

• Contributing to the discovery and delivery of the pRED MLOps platform and service throughout refinement sessions, discussions and workshops with users (data scientists and others)
  

Must-have skills and experience:

• You have an extensive knowledge of existing data processing and management processes and frameworks, especially in the context of cloud based applications
  

• You have some hands-on experience working with Kafka, incl. writing consumer applications
  

• You have some experience working with AWS key services such as S3, EC2, RDS, Glue and Athena
  

• You are comfortable working with one or more of the following tools or processes in production: ETL processes, Oracle, SQL, noSQL
  

• You have extensive experience developing solutions using Python or R
  

• You are comfortable working with Docker and any similar technology
  

• You are keen on helping data scientists bring their ML models to a productive state and available to scientists in the pRED organization
  

• You enjoy working in an agile set up (we are using Scrum) and you are excited to work in a challenging, fast-paced and dynamic environment
  

Nice to have skills and experience:

• You have a good practical understanding of ML data pipelines and some relevant experience setting up such pipelines in production
  

• You have some experience working with Kubernetes
  

• You have some knowledge of Infrastructure as Code.
  

Bonus:

• You have some experience working with GoLan
  

• You have some hands-on experience working directly with one or more big data technologies (Spark, EMR...)
  

If you know of anyone within your network who may also be interested in this position,would you please forward this ‘Email & Role’ to them.