Data Engineer

Project Description

We are looking for a Data Engineer to join our team and help build and operate a scalable, reliable data platform that supports core business operations and reporting. This role is focused on developing and maintaining data pipelines, improving platform reliability, and ensuring the accuracy and availability of data used across the organization.

The ideal candidate is comfortable working in a hands-on engineering role, contributes to data quality and pipeline performance, and works well within an established team structure.

Bringing in more data to support CDP (Customer Data Platform), support day to day workflow, add data to ecosystem

Duties/Day to Day Overview

Data Pipeline Development & Maintenance

• Design, build, and maintain scalable data pipelines to ingest, transform, and deliver data from a variety of source systems
• Develop and optimize data models and structures that support downstream reporting and analytics
• Ensure pipelines are performant, reliable, and designed with maintainability in mind

Platform Reliability & Monitoring

• Implement data quality checks, monitoring, and alerting across pipelines as defined by senior team members
• Support observability efforts by flagging issues and gaps to leads
• Assist with recovery processes and failure handling under senior guidance

Incident Response & Root Cause Analysis

• Act as a first responder for data pipeline and platform incidents
• Perform root cause analysis on failures, data discrepancies, and performance issues, and identify recurring patterns or systemic issues that require longer-term solutions
• Implement durable fixes and preventative measures to reduce recurrence

System & Infrastructure Improvements

• Contribute to improvements in pipeline orchestration and system performance as scoped by senior engineers
• Help automate manual processes and streamline workflows
• Support ongoing enhancements of our Snowflake-based data platform

Collaboration

• Work with internal stakeholders to clarify requirements and troubleshoot data-related issues
• Partner with analytics teams to ensure data is structured and delivered in a way that supports reporting needs

Day to Day

• 8am standup - only standing meeting they have, others will be ad hoc or if they're working on a project, working directly with the stakeholder, understanding what they need and where.
• Spend a lot of time on Slack and communication - say hello and goodbye in appropriate channels, visibility on appointments, etc.
• Using Toggle - newer implementation, tracking progress on projects. Leadership uses this data to do more effective budgeting and forecasting with accounting
• Look for immediate errors or issues they need to resolve and work those issues.
• Jira tickets, speak to what they accomplished, how did you move the project forward.
• Quick EOD report snapshot to Jalia

Top Requirements

Must Haves

• Experience working in Snowflake
• MUST HAVE SNOWFLAKE
• Experience with an ETL/ELT tool (e.g., integrate.io, Airflow, Fivetran, dbt, or similar)
• Must have experience with ETL tools, will train on integrate.io if they do not have that experience
• Strong SQL skills and experience working with relational databases
• Expert in SQL, Python is helpful
• Experience supporting data that underpins front-end reporting tools (e.g., BI platforms such as Sigma Computing or similar)
• Must have some experience with BI/reporting tools - PowerBI, Tableau, etc.
• Sigma not required. Will use it in a support capacity, debugging, issues with data flow between Snowflake and Sigma
• Experience working with data sourced from ERP systems in a retail or operational environment (e.g., NetSuite or similar)
• NetSuite not required. Open to other ERP systems - Oracle, etc.
• Understand retail data or data coming out of an ERP, understand financial transactions and sales
• Experience performing root cause analysis and resolution of data and pipeline issues
• Experience with data quality frameworks, monitoring, and alerting systems
• Experience improving or standardizing data platform processes and practices
• Retail, supply chain, or manufacturing experience required
• Working with data coming from financial retail systems, marketing data

Soft Skills

• Attention to detail
• Good problem-solving skills, with support from leadership for ambiguous situations
• Ability to balance speed with rigor, ensuring solutions are both effective and reliable
• Clear and effective communication, particularly when working through issues or clarifying requirements

Additional Qualifications

• Customer Data Platform experience (CDP)
• Experience with Google Analytics, website metrics