Logo for Commit

Senior Data Science Engineer (LLM & NLP)

Role overview

Summary

This role focuses on developing and deploying advanced language models and NLP solutions within an AI-driven financial technology company. You will contribute to the creation of model-driven services that enhance conversational AI capabilities for brokerage platforms and financial institutions.

Qualifications

  • 5+ years of commercial experience in Data Science, Machine Learning or AI Engineering.
  • 3+ years hands-on with LLMs and NLP.
  • Strong Python, OOP and software engineering fundamentals.
  • Upper-Intermediate English or higher (spoken and written).
  • BSc or higher in Computer Science, Software Engineering or a related field.

Responsibilities

  • Research, develop, and deploy LLM, NLP, and ML models.
  • Own the entire development lifecycle from problem definition to deployment.
  • Train, fine-tune, and maintain BERT-based models for various NLP tasks.
  • Collaborate with product, backend, DevOps, and financial domain experts.

Key facts

Hard skills

Key skills for this role

Other skills

  • Collaboration

About the company

Commit logo

Commit

  • IT Services & Consulting
  • SME
  • 501–1,000
Commit is a global tech services company with offices in New York, Israel, and Europe. The company was founded in 2005 and has over 700 multi-disciplinary innovation experts who serve a broad range of companies, from small startups to large enterprises in multiple business sectors. Commit specializes in advanced technologies and applications with dedicated practices in Software, IoT, Big Data, Cloud, Cyber, Collaboration, Data center migration projects, and more. Commit offers innovative, end-to-end technology solutions by developing custom software and IoT platforms for clients looking to build their next-gen products within the modern ICT world. Commit’s complete and comprehensive engineering powerhouse of resources, and proprietary Flexible R&D methodology helps transform its clients’ technology visions into high-quality products while reducing costs and improving time-to-market.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Description

An AI-driven financial technology company leveraging proprietary AI models and advanced language technologies to deliver fundamental insights on global stocks in multiple languages. Its generative AI technology is integrated into brokerage platforms and financial institutions, providing millions of investors with instant, data-driven stock analysis.

As a Senior Data Science Engineer, you will research, develop, and deploy LLM, NLP, and ML models, as well as the model-driven services powering conversational AI solutions.

You will own the entire development lifecycle — from problem definition and data exploration to model development, evaluation, and deployment of production-ready services.

Responsibilities:

  • Conversational AI & LLMs: multi-turn dialogue, context handling and answer generation over financial data; prompt engineering, structured outputs, tool use and agent workflows; RAG pipelines over financial documents; fine-tune or train own LLMs where an API model isn't the best fit; reduce hallucinations, latency and cost per request.
  • NLP models: train, fine-tune and maintain BERT-based models (intent detection, classification, entity extraction, embeddings); prepare and label data; decide when a smaller specialized model should replace an LLM call.
  • LLM services in production: Python services within a 20+ microservice system; model routing, fallbacks, retries, caching, rate-limit handling; versioned REST APIs; clean, tested code and code reviews.
  • Evaluation & monitoring: quality metrics and evaluation datasets; automated evaluation including LLM-as-a-judge and regression tests for prompt/model changes; tracing of LLM calls; experiments and A/B tests.
  • AWS: train, deploy and operate models on AWS (EKS, Lambda, S3, SageMaker, GPU instances); CI/CD for models and prompts with DevOps; track and reduce cost.
  • Collaboration: work with product, backend, DevOps and financial domain experts; contribute to architecture and modelling decisions.

Requirements

Must-have:

  • 5+ years of commercial experience in Data Science, Machine Learning or AI Engineering
  • 3+ years hands-on with LLMs and NLP
  • Strong Python, OOP and software engineering fundamentals
  • Proficient prompt engineering; experience with LLM evaluation
  • Good understanding of modern deep-learning architectures; hands-on with PyTorch or TensorFlow
  • SQL and NoSQL databases
  • Docker and containerized applications; deploying and operating services on Kubernetes
  • Daily use of AI coding tools (Claude Code, Cursor or similar)
  • Upper-Intermediate English or higher (spoken and written)
  • Fluency in Ukrainian
  • BSc or higher in Computer Science, Software Engineering or a related field


Nice to have:

  • RAG, vector databases and semantic search
  • Fine-tuning or training LLMs
  • Cloud platforms (AWS, GCP, Azure)
  • LangChain, LangGraph, LlamaIndex or similar
  • Observability: Grafana, Prometheus, Langfuse, LangSmith
  • Financial markets / fintech / trading domain knowledge
  • Mathematical optimization (LP/MILP, constraint programming)
  • Kaggle competitions

Related jobs

See all Data Engineer jobs

Other jobs at Commit