Senior Data Engineer

What you will do

As a Senior Data Engineer, you will be a key player in ensuring the stability and reliability of our data integrations. Offering support is a large and core focus of this role as you will be responsible for maintaining our existing integrations, acting as the technical expert for any issues that arise. This involves deep technical problem-solving, analyzing and addressing complaints from hotels, and debugging our data pipelines to find and fix root causes. A significant part of your role will be managing communication with a wide variety of internal and external stakeholders. You will not only resolve immediate issues but also take ownership of improving our overall support processes to make our team more effective and proactive.

Where you will have impact

• Maintain and enhance existing data integrations, ensuring the high reliability and quality of data from our external partners.
• Lead the investigation and resolution of complex technical issues, performing deep-dive analysis into our code and systems to identify the root cause of problems.
• Manage communication effectively with a wide range of stakeholders—including hotels, customer care, account managers, and company leadership—providing clear, transparent, and timely updates on ongoing incidents.
• Collaborate with external partners to gather necessary information and troubleshoot integration issues.
• Proactively identify and drive improvements to our support processes, tooling, and documentation, helping to build a more scalable and efficient support function.

About our team

The Data Engineering team is the gatekeeper of Lighthouse's vast datasets. Our mission is to reliably transform, integrate, and store the numerous data sources that power our BI products, from web-scraped data to direct API integrations. We handle a staggering amount of information—our main dataset holds over 3 trillion hotel rates, and we process over 100TB of data daily. You'll join a highly talented and collaborative group of 8 data engineers.

What's in it for you?

• Flexible working environment: Work from home or at one of our global offices.
• Flexible time off: Autonomy to manage your work-life balance.
• Alan Healthy benefits: 160€/month for food, transportation, or nursery.
• Wellbeing support: Subsidized up to 80% ClassPass subscription.
• Comprehensive health insurance: 100% Alan coverage for you, your spouse, and dependents.
• Collaborative team: High-bar, friendly, creative, and passionate colleagues.
• Career development: Workshops, frameworks, tools, training, and processes to realize your full potential.
• Impactful work: Shape products relied on by 85,000+ users worldwide.
• Competitive compensation: Proactively maintained to value your work.
• Referral bonuses: Earn rewards for bringing in new talent.

Who you are

• You thrive in a support-focused role, enjoying the challenge of debugging complex systems and ensuring their stability and reliability.
• Strong proficiency in Python with a demonstrated affinity for working with large-scale data.
• A thorough approach to development, with an ability to identify edge cases and potential issues in code.
• Experience building and maintaining data processing pipelines.
• The ability to work effectively both independently and as part of a collaborative, open team.
• Excellent verbal and written communication skills in English, with the ability to explain technical concepts to diverse audiences.

We welcome

• Hands-on experience with a major cloud platform such as GCP, AWS, or Azure.

Technologies you will work with

Google Cloud Pub/Sub, BigTable, BigQuery, Dataflow, Kubernetes, Python

#LI-Remote