Back

Distributed Training Engineer

Periodic LabsPeriodic Labs·Cannabis Technology

Apply effort

~7 min

Ashby

Posted

265 days

01

About the role

About Periodic Labs

We are an AI + physical sciences lab building state of the art models to make novel scientific discoveries. We are well funded and growing rapidly. Team members are owners who identity and solve problems without boundaries or bureaucracy. We eagerly learn new tools and new science to push forward our mission.

About the role

You will optimize, operate and develop large-scale distributed LLM training systems that power AI scientific research. You will work closely with researchers to bring up, debug, and maintain mid-training and reinforcement learning workflows. You will build tools and directly support frontier-scale experiments to make Periodic Labs the world’s best AI + science lab for physicists, computational materials scientists, AI researchers, and engineers. You will contribute open-source large scale LLM training frameworks.

You might thrive in this role if you have experience with:

  • Training on clusters with ≥5,000 GPUs

  • 5D parallel LLM training

  • Distributed training frameworks such as Megatron-LM, FSDP, DeepSpeed, TorchTitan

  • Optimizing training throughput for large scale Mixture-of-Expert models

Skills & Tags

02

Aplyr's read

Periodic Labs is at the forefront of cannabis technology, attracting specialists in lab testing and quality assurance for innovative product development.

Synthesized from recent postings & public sources

What's promising

  • Strong focus on cannabis industry-specific technology solutions.
  • Recent hires indicate a commitment to cutting-edge research and development.
  • Diverse roles suggest a dynamic and interdisciplinary work environment.

What to watch

  • Niche market focus may limit broader industry opportunities.
  • Potential regulatory challenges in the cannabis sector.
  • High specialization could restrict career mobility outside the cannabis industry.

Why Periodic Labs

  • Pioneering lab testing solutions for cannabis quality assurance.
  • Emphasis on advanced engineering roles like ML Systems and Supercompute Engineers.
  • Integration of condensed matter theory in product development.

Aplyr’s read is generated by AI from public sources. Was it useful?

03

About Periodic Labs

Periodic Labs is a technology company focused on developing advanced solutions for the cannabis industry, particularly in the area of lab testing and quality assurance.

04

Similar roles