Offer summary

Qualifications:

Previous experience as a data engineer with at least 2-3 years in DB/ETL development., Technical expertise in data modeling techniques, particularly Data Vault, and advanced SQL programming., Experience with ETL tools like Talend and Data Transformation Tools such as DBT., Familiarity with cloud technologies and DevOps practices, including CI/CD and GitLab..

Key responsabilities:

Develop and maintain robust data pipelines while ensuring data quality and reliability.

Analyze raw data ingestion pipelines and support stakeholders in defining new data product use cases.

Collaborate with other teams and take ownership of data product pipelines.

Continuously seek improvements in best practices and efficiencies within the Agile Team.

Job description

Note! Only candidates from the EU will be taken into consideration!

Company Description

Transition Technologies MS is a fast-growing IT company with a global presence, specializing in end-to-end service delivery and staffing with industry-leading and niche technology expertise. At the moment TTMS is looking for a senior Data engineer for one of its pharma clients.

Senior Data Engineer

Responsibilities:

Apply data engineering practices and standards to develop robust and maintainable data pipelines
Analyze and organize raw data ingestion pipelines
Evaluate business needs and objectives
Support senior business stakeholders in defining new data product use cases and their value
Take ownership of data product pipelines and their maintenance
Explore ways to enhance data quality and reliability, be the "Quality Gatekeeper" for developed Data Products
Adapt and apply best practices from the Data One community
Be constantly on the lookout for ways to improve best practices and efficiencies and make concrete proposals
Take leadership and collaborate with other teams proactively to keep things moving
Be flexible and take on other responsibilities within the scope of the Agile Team

Qualifications:

Previous experience as a data engineer
Technical expertise with data modeling techniques (Data Vault)
Advanced expertise with ETL tools (Talend, Alteryx etc.)
Advanced SQL programming experience, Python is a plus
Previous experience with agile methodologies in Software Development
Previous experience working with Data Transformation Tools like DBT
Previous experience with DevOps, DataOps practices (CI/CD, GitLab, DataOps.live)
Hand-on experience with Snowflake, certification is a plus
Experience with the lifecycle management of data products
Knowledge of Data Mesh and FAIR principles
At least 2-3 years of DB/ETL development experience - Talend and DBT preferred

Required Skills:

4+ years of working with programming language focused on data pipelines, e.g. Python or R
4+ years of experience working with SQL
3+ years of experience in data pipelines maintenance
3+ years of experience with different types of storage (filesystem, relation, MPP, NoSQL) and working with various kinds of data (structured, unstructured, metrics, logs, etc.)
3+ years of experience in working in data architecture concepts (in any of following areas data modeling, metadata mng., workflow management, ETL/ELT, real-time streaming, data quality, distributed systems)
3+ years of cloud technologies with emphasis on data pipelines (Airflow, Glue, Dataflow - but also other smart solutions of handling data in the cloud - elastic, redshift, bigquery, lambda, s3, EBS etc.)
4+ years of experience working with SQL
1+ years of experience in Java and/or Scala
Very good knowledge of relational databases (optional)
Very good knowledge of data serialization languages such as JSON, XML, YAML
Excellent knowledge of Git, Gitflow and DevOps tools (e.g. Docker, Bamboo, Jenkins, Terraform
Capability to conduct performance analysis, troubleshooting and remediation (optional)
Excellent knowledge of Unix
Pharma data formats is a big plus (SDTM)

Required profile