Match score not available

Member of Technical Staff (GPU Engineer)

Remote:

Full Remote

Experience:

Senior (5-10 years)

Work from:

United States

Offer summary

Qualifications:

Strong background in Python and PyTorch, Experience with low-level GPU code, Familiarity with Slurm or Kubernetes, Knowledge of Ceph file systems preferred.

Key responsabilities:

Design and implement improvements to training infrastructure
Optimize models' training performance and efficiency

Reka AI Information Technology & Services Startup https://reka.ai/

2 - 10 Employees

See all jobs

Job description

We are seeking an experienced GPU Engineer with a strong background in Python and large-scale model training. In this role you will design and implement improvements to our large scale training infrastructure and directly help make technical decisions to optimise our models' training performance and efficiency.

Ideal Experience

Strong engineering skills with fluency in Python and PyTorch or other acceleration libraries.
Experience writing and debugging low-level GPU code (CUDA, Triton) and debugging hardware errors.
Experienced in scaling up GPU jobs via large-scale compute clusters using Slurm or Kubernetes.
Preferred: knowledge of advanced filesystems, particularly Ceph, and their integration and optimization in large systems.
Preferred: proficient in implementing robust monitoring systems for performance tracking and anomaly detection.

Reka's Mission

Reka's mission is to build useful multimodal artificial intelligence and use it to empower organisations and businesses. We are a globally distributed foundation model startup, headquartered in the San Francisco Bay Area, California. Embracing a remote-first approach, our team brings together top talent from around the world. Our founding team, along with many of our team members, has contributed to many of the breakthroughs in AI over the past decade.

Why Reka?

An Elite Team: Collaborate with top-tier engineers, researchers, operators from renowned organizations like Google DeepMind and Facebook AI Research (FAIR) and successful startups, driving innovation in cutting-edge AI technology.
Massive Market Opportunity: Be part of a rapidly growing industry poised to transform multiple sectors globally, offering the chance to make a significant impact.
Mission-Driven Environment: Work alongside a collaborative, mission-focused team dedicated to advancing AI for meaningful applications.
Inclusive and Open Culture: Thrive in an open and inclusive work environment that values diverse perspectives and fosters creativity.
Generous Benefits: Enjoy 5 weeks of paid leave to recharge, comprehensive healthcare benefits including vision and dental, and additional perks that support your well-being.
Visa Support: We provide visa assistance, including H1B and OPT transfers, for US employees to ensure a smooth transition and support your career with us.