Find your next role
Strengthen your profile
This role is for a senior data engineer at Sightly, responsible for managing data ingestion pipelines and the Snowflake platform. You will collaborate with various teams to gather requirements and ensure data reliability, while also leveraging AI tools to enhance efficiency.
Key skills for this role
See how your profile stacks up against this role.
We compared the job requirements to your profile to show where you're strong and where you fall short.
Sightly is a growing technology company leading the revolution in real-time marketing and brand intelligence. Join us as we pursue our disruptive mission to empower businesses everywhere to make the most authentic + profitable decisions in real time.
Our AI-driven Brand Mentality® platform enables any brand (or agency) to leverage an ever-changing ocean of news, social, media and audience data to make more intelligent decisions at the speed of culture. At Sightly, we're passionate about our product, our customers, our impact on the world, and most importantly, our team.
We are a small company with a strong collaborative ethic, so there will be opportunities to get involved with projects that will help expand your skillset and knowledge. Professionals who take the initiative, can work without a lot of supervision, can begin projects independently, and have good communication skills will excel in this position.
Everything Sightly sells runs on data our pipelines collect every day: YouTube videos and channels, TikTok trends, social posts, news, and campaign performance from the ad platforms our clients buy on. That data lands in Snowflake and powers Brand Mentality, SmartLists, client reporting and automated billing. We need a senior data engineer to own those ingestion pipelines and the Snowflake platform underneath them, and to keep them reliable, fast and cost-efficient as volume grows.
Just as important, this person works directly with the people who use our data (account managers, sales, strategy and clients) to gather requirements and iterate quickly. AI has raised the bar for what one engineer can do, and we want someone who uses it to move fast and stretch beyond a traditional data engineering lane.
Note: This is a full-time position based remotely, reporting to our Director of Data.
Own API ingestion pipelines: build and run Python pipelines and Airflow DAGs that pull from YouTube, TikTok, Meta, Google Ads, DV360, social and news sources, handling quotas, rate limits, retries and credential rotation.
Run our Snowflake platform: manage warehouses, roles and access, partner data sharing, and cost. Tune schedules and storage (including our Iceberg migration) so we pay only for what we use.
Keep reporting and billing data trustworthy: maintain the ad-platform performance pipelines that feed client reports, our Reporting API and automated billing.
Lead on reliability and design: own alerting, data freshness and pipeline health, lead the response when something breaks, and shape how our data platform evolves as volume and use cases grow.
Work directly with users: sit with account managers, sales and strategy to understand what they need, turn requests into clear requirements, and ship iterations in days, not weeks. Partner with analytics and product engineers on dbt models and on serving data to the app (Postgres, OpenSearch).
Make it easy for others to contribute: document pipelines, tables and runbooks, and help build safe, AI-assisted paths (sandboxed environments, tests, CI/CD guardrails) so PMs and account managers can contribute to production data workflows.
5+ years of data engineering experience running production pipelines, including owning systems end to end and making architecture decisions.
Experience working directly with business users or clients: gathering requirements, explaining tradeoffs, and iterating quickly on feedback.
Strong Python and SQL.
Deep experience with Airflow (or a similar orchestrator) in production.
Experience with Snowflake (or BigQuery or Redshift), including administration: warehouses, access control, cost management.
A track record of integrating third-party REST APIs at volume, with their quotas, pagination and failures.
Experience on a major cloud platform, ideally GCP.
At least working familiarity with Elasticsearch or OpenSearch; deep expertise is a big plus.
Uses AI coding tools (such as Claude) as a core part of how you build, not an afterthought.
Comfortable with Git, code review and CI/CD.
Hands-on dbt experience, ideally on Snowflake: building and testing models, and keeping build times and warehouse costs down.
GCP data services: Cloud Composer, Dataflow, Cloud Storage.
Apache Iceberg.
Experience with ad platform APIs (Google Ads, DV360, Meta, TikTok) or YouTube data.
High-performance data processing in Python.
Python, Airflow on Cloud Composer, Snowflake, dbt, Apache Iceberg, Dataflow, Cloud Storage, Postgres, OpenSearch, GitLab, all on Google Cloud.
Knowledge of or experience in the digital advertising and/or marketing field
Self-starter who seeks out unfamiliar, uncomfortable problems and learns fast
Client-minded communicator who enjoys working with non-technical people and can explain data in plain terms
Collaborative mentality, with a habit of mentoring teammates and raising the bar on code and design
Comfortable working in a fast-paced and dynamic environment
This is a remote position.
Data Engineer
Cotiviti · Today
Remote from United States · Full time
Senior Data Engineer
Clasp · Today
Remote from United States · Full time
Senior Data Engineer
DistroKid · Today
Remote from Europe, United States, European Union, Latin America, EMEA, United Kingdom · Full time
Staff Data Engineer
Castlight Health · 1 day ago
Remote from United States · Full time
Data Engineer
The Amatriot Group · 1 day ago
Remote from United States · Full time