Logo for Growth Acceleration Partners

Senior Data Engineer

Role overview

Summary

This role is for a Senior Data Engineer at Growth Acceleration Partners, focusing on building and operating data pipelines for a private equity and asset management client. You will work autonomously, collaborating with finance and reporting teams to ensure data accuracy and support system migrations.

Qualifications

  • Bachelor’s Degree in Computer Science, Software Engineering, Information Systems, or a related technical field.
  • 5+ years of experience building production data pipelines, including 2+ years on Databricks with Delta Lake
  • Strong experience in SQL (Spark SQL and T-SQL), Python, and PySpark
  • Experience supporting data migrations from legacy SQL Server environments to modern lakehouse platforms
  • Preferred: Advanced English proficiency

Responsibilities

  • Build incremental ingestion pipelines using watermarks and change timestamps.
  • Model and transform data across Silver and Gold layers, including deduplication and currency conversion.
  • Support the migration from the legacy system, loading historical data and reconciling figures before cutover.
  • Publish curated data to downstream consumers through Delta tables and Postgres-based synced tables.

Key facts

Hard skills

Key skills for this role

Other skills

  • Communication
  • Detail Oriented
  • Collaboration

About the company

Growth Acceleration Partners logo

Growth Acceleration Partners

  • IT Services & Consulting
  • SME
  • 501–1,000
Growth Acceleration Partners is a consulting and technology services company. We provide custom software, data engineering and modernization solutions. If you’re interested in working on our team, please follow the GAP Careers Page: https://www.linkedin.com/showcase/growth-acceleration-partners-careers-gap/ At GAP, we consult, design, build and modernize revenue-generating software and data engineering solutions for clients. With modernization services and AI tools, we help businesses achieve a competitive advantage through technology. Our remote, integrated engineering teams use end-to-end solutions to innovate and align with your business goals. Cofounded by CEO Joyce Durst in 2007, GAP became an early pioneer of the nearshoring model — providing outsourced software development from countries close to the U.S., both geographically and culturally. In 2023, GAP acquired the Application Migration Business Unit of Mobilize.Net — the global market leader in automated software modernization — and Mission Data, a leading smart digital products company. If you want to learn more about GAP, click the link below.

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

WHAT WE DO

Founded in 2007, Growth Acceleration Partners (GAP) is a consulting and technology services company. We consult, design, build and modernize revenue-generating software and data engineering solutions for clients. With modernization services and AI tools, we help businesses achieve a competitive advantage through technology. GAP’s remote, integrated engineering teams use end-to-end solutions to innovate and align with your business goals. We have 600+ English-speaking engineers based in Latin America and approximately 20 U.S.-based engineers. With some of the highest customer satisfaction scores in the industry, GAP’s focus is customer and employee success.

GAP is a woman-owned company headquartered in Austin Texas. We are a values-based company focused on growing our people by investing in education, onsite English classes and training in the latest technologies, including AI, data analytics and machine learning. Our goal is to provide solutions for our customers that help them achieve critical business outcomes, while enabling our GAPSters and our communities to attain long-term success.


Summary
We are looking for a Senior Data Engineer to build and operate the data pipelines that consolidate portfolio company data into a single, business-aligned model on Databricks for a company in the private equity and asset management industry. You will own pipelines end to end, from incremental ingestion through Bronze, Silver and Gold layers to serving data for BI reporting and internal applications. This role also supports a key migration from a legacy system, including historical loads and financial reconciliation before cutover. You will work with a high level of autonomy and partner closely with finance, reporting and application teams.

Education
Bachelor’s Degree in Computer Science, Software Engineering, Information Systems, or a related technical field.

Professional Experience

  • 5+ years of experience building production data pipelines, including 2+ years on Databricks with Delta Lake

  • Hands-on experience implementing medallion architectures (Bronze, Silver, Gold) with incremental processing

  • Proven track record in data quality and reconciliation, including tracing incorrect figures back to their source

  • Experience supporting data migrations from legacy SQL Server environments to modern lakehouse platforms
    Key Responsibilities

  • Build incremental ingestion pipelines using watermarks and change timestamps, safely handling late-arriving data and retaining full raw history

  • Model and transform data across Silver and Gold layers, including deduplication, unit and currency conversion, and quarantine of suspect records

  • Implement dimensional models with fact tables, slowly changing dimensions and reference data optimized for Power BI and application use

  • Support the migration from the legacy system, loading and freezing historical data and reconciling figures before cutover

  • Publish curated data to downstream consumers through Delta tables and Postgres-based synced tables for applications

  • Orchestrate, monitor and document pipelines, manage access and lineage in Unity Catalog, and maintain runbooks

    Required Technical Skills
    Strong experience in several of the following areas:

  • Lakehouse: Databricks, Delta Lake, MERGE, change data feed, medallion architecture

  • Languages: SQL (Spark SQL and T-SQL), Python, PySpark

  • Data Modeling: dimensional modeling, fact grain definition, surrogate keys, slowly changing dimensions

  • Governance & Quality: Unity Catalog or a similar governance layer, data quality checks, reconciliation, lineage

  • Performance: BI workload tuning, file layout, clustering, query plan analysis

    Nice to Have

  • Experience with private equity, asset management or fund administration data, such as portfolio monitoring, valuations and cash flows

  • Knowledge of financial reporting concepts such as LTM and YTD periods, fiscal year ends, restatements and FX conversion

  • Experience with Lakeflow (Delta Live Tables), Databricks Workflows, or Databricks Lakebase and PostgreSQL

  • CI/CD and infrastructure as code for data pipelines, such as Databricks Asset Bundles, on Microsoft Azure

    Soft Skills

  • Advanced English proficiency

  • Clear written communication, able to explain data issues and trade-offs to non-technical users

  • Strong attention to detail and ownership of data accuracy

  • Collaborative mindset when working with vendors, finance and reporting teams

At Growth Acceleration Partners, we're an equal opportunity employer committed to building a diverse and inclusive team. We value everyone's unique background, and we provide equal opportunities regardless of race, color, creed, religion, sexual orientation, gender identity, age, national origin, disability, marital status, veteran status or any other personal right protected by law. We foster a culture of belonging and strive to provide a welcoming environment where everyone feels safe to contribute and grow.

Related jobs

See all Data Engineer jobs

Other jobs at Growth Acceleration Partners