Logo for Tiger Analytics

Senior Data Engineer

Role overview

Summary

This role is for a Data Engineer at Tiger Analytics, focusing on designing and maintaining data pipelines and infrastructure on AWS. You will collaborate with data scientists and analysts to support analytics and machine learning initiatives, particularly in the pharmaceutical sector.

Qualifications

  • 8+ years of experience in Data Engineering, preferably with experience supporting commercial pharmaceutical/healthcare data environments.
  • Strong hands-on experience with AWS cloud, Databricks, Spark, and SQL
  • Strong experience building ETL/ELT data pipelines and large-scale data processing workflows.
  • Hands-on experience with Apache Airflow for workflow orchestration.
  • Deep knowledge of commercial pharmaceutical data sources: Xponent, Veeva, MMIT, and Plantrak.

Responsibilities

  • Design, develop, and deploy end-to-end data pipelines on AWS using services such as Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift.
  • Build and maintain scalable data processing and transformation workflows using Databricks, Apache Spark, and SQL.
  • Develop and maintain Apache Airflow workflows for pipeline orchestration, scheduling, and automation.
  • Integrate and process commercial pharmaceutical data sources such as Xponent, Veeva, and MMIT.

Key facts

Hard skills

Key skills for this role

Other skills

  • Analytical Skills
  • Problem Solving
  • Communication

About the company

Tiger Analytics logo

Tiger Analytics

  • IT Services & Consulting
  • XLarge
  • 1,001–5,000
Tiger Analytics is a global leader in AI and Analytics, helping Fortune 1000 companies solve their toughest challenges. We offer fullstack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission to push the boundaries of what AI and analytics can do to help enterprises navigate uncertainty and move forward decisively. Our purpose is to provide certainty to shape a better tomorrow. Our team of 4000+ technologists and consultants are based in the US, Canada, the UK, India, Singapore, and Australia, working closely with clients across CPG, Retail, Insurance, BFS, Manufacturing, Life Sciences, and Healthcare. We are Great Place to Work-Certified™ and have been recognized by analyst firms such as Forrester, Gartner, Everest, ISG, HFS, and others. Ranked among the ‘Best’ and ‘Fastest Growing’ analytics firms lists by Inc., Financial Times, Economic Times and Analytics India Magazine. In India, our offices are located in Chennai, Hyderabad and Bangalore.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms, including Forrester and Gartner. We are looking for top-notch talent as we continue to build the best analytics global consulting team in the world.

We are seeking an experienced Data Engineer to join our data team. In this role, you will be responsible for designing, building, and maintaining scalable data pipelines, data integration processes, and data infrastructure on AWS cloud. You will collaborate closely with data scientists, analysts, and AI teams to support analytics, machine learning, and Generative AI initiatives across the organization.

Requirements

Key Responsibilities:

  • Design, develop, and deploy end-to-end data pipelines on AWS using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, and related data platform technologies.
  • Build and maintain scalable data processing and transformation workflows using Databricks, Apache Spark, and SQL.
  • Develop and maintain Apache Airflow workflows for pipeline orchestration, scheduling, dependency management, monitoring, and automation.
  • Integrate and process commercial pharmaceutical data sources such as Xponent, Veeva, MMIT, Plantrak, Specialty Pharmacy, LAAD, and similar sources.
  • Build and optimize data pipelines supporting pharma KPIs, metrics, analytics, and reporting requirements.
  • Design and implement data pipelines for AI/ML and Generative AI workloads, including structured and unstructured data preparation.
  • Enable data pipelines supporting LLM-based applications, vector embeddings, and knowledge retrieval/RAG solutions.
  • Support migration of legacy data systems and pipelines to modern AWS cloud and lakehouse architectures.
  • Monitor, troubleshoot, and optimize data pipelines for performance, scalability, reliability, and cost-effectiveness.
  • Ensure data pipelines meet required standards for data quality, accuracy, consistency, and operational reliability.
  • Communicate effectively with technical and business stakeholders to understand requirements and translate pharmaceutical business needs into scalable data solutions.

Required Skills:

  • 8+ years of experience in Data Engineering, preferably with experience supporting commercial pharmaceutical/healthcare data environments.
  • Strong hands-on experience with AWS cloud, Databricks, Spark, and SQL
  • Strong experience building ETL/ELT data pipelines and large-scale data processing workflows.
  • Hands-on experience with Apache Airflow for workflow orchestration.
  • Strong understanding of data modeling, data lake/lakehouse architecture, data ingestion, and transformation frameworks.
  • Deep knowledge of commercial pharmaceutical data sources: Xponent, Veeva, MMIT, Plantrak, Specialty Pharmacy, LAAD, and other commercial pharma data sources
  • Strong understanding of pharmaceutical commercial data processes, including: Alignment, Allocation, Split credits, Market basket, Customer universe
  • Strong understanding of pharma KPIs, metrics, and commercial analytics.
  • Strong analytical, problem-solving, and data troubleshooting skills.

Benefits

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, challenging, and entrepreneurial environment, with a high degree of individual responsibility.

Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis as protected by federal, state, or local law.

Related jobs

See all Data Engineer jobs

Other jobs at Tiger Analytics