Logo for Sightly

Senior Data Engineer

Role overview

Summary

This role is for a senior data engineer at Sightly, responsible for managing data ingestion pipelines and the Snowflake platform. You will collaborate with various teams to gather requirements and ensure data reliability, while also leveraging AI tools to enhance efficiency.

Qualifications

  • 5+ years of data engineering experience running production pipelines.
  • Strong Python and SQL skills.
  • Deep experience with Airflow in production.
  • Experience with Snowflake, including administration.
  • A track record of integrating third-party REST APIs at volume.

Responsibilities

  • Own API ingestion pipelines: build and run Python pipelines and Airflow DAGs that pull from various sources.
  • Run our Snowflake platform: manage warehouses, roles, access, and cost.
  • Keep reporting and billing data trustworthy: maintain performance pipelines for client reports and automated billing.
  • Work directly with users: gather requirements from account managers, sales, and strategy, and ship iterations quickly.

Key facts

Hard skills

Key skills for this role

Other skills

  • Communication
  • Collaboration
  • Problem Solving

About the company

Sightly logo

Sightly

Your match analysis

See how your profile stacks up against this role.

We compared the job requirements to your profile to show where you're strong and where you fall short.

Job description

About the company

Sightly is a growing technology company leading the revolution in real-time marketing and brand intelligence. Join us as we pursue our disruptive mission to empower businesses everywhere to make the most authentic + profitable decisions in real time.

Our AI-driven Brand Mentality® platform enables any brand (or agency) to leverage an ever-changing ocean of news, social, media and audience data to make more intelligent decisions at the speed of culture. At Sightly, we're passionate about our product, our customers, our impact on the world, and most importantly, our team.

We are a small company with a strong collaborative ethic, so there will be opportunities to get involved with projects that will help expand your skillset and knowledge. Professionals who take the initiative, can work without a lot of supervision, can begin projects independently, and have good communication skills will excel in this position.

Why this role exists

Everything Sightly sells runs on data our pipelines collect every day: YouTube videos and channels, TikTok trends, social posts, news, and campaign performance from the ad platforms our clients buy on. That data lands in Snowflake and powers Brand Mentality, SmartLists, client reporting and automated billing. We need a senior data engineer to own those ingestion pipelines and the Snowflake platform underneath them, and to keep them reliable, fast and cost-efficient as volume grows.

Just as important, this person works directly with the people who use our data (account managers, sales, strategy and clients) to gather requirements and iterate quickly. AI has raised the bar for what one engineer can do, and we want someone who uses it to move fast and stretch beyond a traditional data engineering lane.

Note: This is a full-time position based remotely, reporting to our Director of Data.

What you'll do

  • Own API ingestion pipelines: build and run Python pipelines and Airflow DAGs that pull from YouTube, TikTok, Meta, Google Ads, DV360, social and news sources, handling quotas, rate limits, retries and credential rotation.

  • Run our Snowflake platform: manage warehouses, roles and access, partner data sharing, and cost. Tune schedules and storage (including our Iceberg migration) so we pay only for what we use.

  • Keep reporting and billing data trustworthy: maintain the ad-platform performance pipelines that feed client reports, our Reporting API and automated billing.

  • Lead on reliability and design: own alerting, data freshness and pipeline health, lead the response when something breaks, and shape how our data platform evolves as volume and use cases grow.

  • Work directly with users: sit with account managers, sales and strategy to understand what they need, turn requests into clear requirements, and ship iterations in days, not weeks. Partner with analytics and product engineers on dbt models and on serving data to the app (Postgres, OpenSearch).

  • Make it easy for others to contribute: document pipelines, tables and runbooks, and help build safe, AI-assisted paths (sandboxed environments, tests, CI/CD guardrails) so PMs and account managers can contribute to production data workflows.

What you bring (must-haves)

  • 5+ years of data engineering experience running production pipelines, including owning systems end to end and making architecture decisions.

  • Experience working directly with business users or clients: gathering requirements, explaining tradeoffs, and iterating quickly on feedback.

  • Strong Python and SQL.

  • Deep experience with Airflow (or a similar orchestrator) in production.

  • Experience with Snowflake (or BigQuery or Redshift), including administration: warehouses, access control, cost management.

  • A track record of integrating third-party REST APIs at volume, with their quotas, pagination and failures.

  • Experience on a major cloud platform, ideally GCP.

  • At least working familiarity with Elasticsearch or OpenSearch; deep expertise is a big plus.

  • Uses AI coding tools (such as Claude) as a core part of how you build, not an afterthought.

  • Comfortable with Git, code review and CI/CD.

Nice to have

  • Hands-on dbt experience, ideally on Snowflake: building and testing models, and keeping build times and warehouse costs down.

  • GCP data services: Cloud Composer, Dataflow, Cloud Storage.

  • Apache Iceberg.

  • Experience with ad platform APIs (Google Ads, DV360, Meta, TikTok) or YouTube data.

  • High-performance data processing in Python.

Our stack

Python, Airflow on Cloud Composer, Snowflake, dbt, Apache Iceberg, Dataflow, Cloud Storage, Postgres, OpenSearch, GitLab, all on Google Cloud.

Additional qualities we're looking for

  • Knowledge of or experience in the digital advertising and/or marketing field

  • Self-starter who seeks out unfamiliar, uncomfortable problems and learns fast

  • Client-minded communicator who enjoys working with non-technical people and can explain data in plain terms

  • Collaborative mentality, with a habit of mentoring teammates and raising the bar on code and design

  • Comfortable working in a fast-paced and dynamic environment

Location

  • This is a remote position.

Related jobs

See all Data Engineer jobs