Lead Cloud Engineer - Remote

About Us:

At Zyte, we eat data for breakfast and you can eat your breakfast anywhere and work for Zyte. Founded in 2010, we are a globally distributed team of over 240 Zytans working from over 28 countries who are on a mission to enable our customers to extract the data they need to continue to innovate and grow their businesses. We believe that all businesses deserve a smooth pathway to data

For more than a decade, Zyte has led the way in building powerful, easy-to-use tools to collect, format, and deliver web data, quickly, dependably, and at scale. And today, the data we extract helps thousands of organizations make smarter business decisions, secure competitive advantage, and drive sustainable growth. Today, over 3,000 companies and 1 million developers rely on our tools and services to get the data they need from the web.

About the Job:

As Lead Cloud Engineer, you will drive the architecture, development, and reliability of our Scrapy Cloud platform. You take the lead in implementing best practices for scalability, performance optimization, and system resilience. This role combines hands-on engineering with strategic leadership, focusing on high-availability infrastructure, automation, and continuous improvement in cloud software development.

About the Team:

The Scrapy Cloud team, within the App team, comprises developers, data engineers, and product managers focused on building a high-performance, scalable platform. We prioritize engineering excellence, reliability, and collaboration, fostering a culture of innovation and continuous improvement.

Requirements

Roles & Responsibilities:

• Lead the design and development of the Scrapy Cloud product maintaining high quality, performance, scalability and resiliency.
• Encourage team collaboration and open communication, facilitating regular meetings for brainstorming and feedback.
• Coordinate with product management to align team objectives with business goals.
• Drive the architectural decisions and guide technical design discussions within the team.
• Identify performance bottlenecks and implement solutions proactively.
• Mentor team members and support their professional growth through feedback and development plans.
• Stay up-to-date with industry trends and technologies to foster innovation.
• Ensure high delivery standards while maintaining a healthy team culture.

Requirements:

• Proficient in Python and experience with web frameworks such as Django, Flask, or similar.
• Strong background in cloud technologies (e.g., AWS, GCP, Kubernetes) and containerization.
• Thorough understanding of managing and optimizing cloud infrastructure and performance.
• Proven experience with CI/CD pipelines and infrastructure-as-code tools.
• Experience with designing and implementing APIs
• Excellent communication skills in English, both written and verbal.

Benefits

By joining the Zyte team, you will:

• Become part of a self-motivated, progressive, multi-cultural team.
• Have the freedom & flexibility to work remotely.
• Get the chance to work with cutting-edge open source technologies and tools.