Staff Software Engineer, Data Infrastructure, AI Compute Platform

The Team

Our AI research team sits at the heart of our mission to unlock new dimensions of biological understanding. You will leverage state-of-the-art AI to accelerate discovery and drive transformative insights in biology—developing novel AI models purpose-built for biological research, engineering robust systems that enable breakthrough science at unprecedented scale, and translating these advances into practical tools that empower researchers worldwide.

Our approach is comprehensive and integrated, bringing together world-class AI model development, exceptional engineering talent, high-quality biological data, powerful computing infrastructure, and strategic partnerships. Success requires excellence across five interconnected pillars: training frontier AI models specifically for biology; building engineering systems that maximize research velocity and efficiency; executing a sophisticated data strategy that fuels AI development; operating a world-class AI compute platform; and creating impactful products that transform AI capabilities into accessible scientific tools.

The Opportunity

The Data Engineering and Infrastructure team brings AI/ML technology and Data to the table in new ways to help drive AI powered solutions that accelerate Biomedical research. We are uniquely positioned to design, build, and scale software systems to help scientists better address the myriad challenges they face. We are supporting researchers and scientists around the world by developing the capacity to apply state-of-the-art methods in artificial intelligence and machine learning to solve important problems in the biomedical sciences.

This team works on building shared tools and platforms to be used across Biohub, partnering and supporting the work of an extensive group of Research Scientists, Data Scientists, AI Research Scientists, and Computational Biologists. Members of the shared infrastructure engineering team have an impact on all of Biohub’s initiatives by enabling the technology solutions used by other engineering teams to build a frontier model and scale the feedback loop.

What You'll Do

• Develop and maintain the tooling and infrastructure that drives the entire data lifecycle at Biohub, from ingestion and processing to secure storage and access. Your work will directly support cutting-edge research, AI model training, and data analysis across the organization.
• Partner with researchers and engineers across various domains, including genetics, imaging, and scientific literature. You'll work on various use cases, from web analytics to complex model training, ensuring data accessibility and performance for teams across CZI.
• Design and implement flexible, scalable, and performant systems to address our stakeholders’ needs, leveraging technologies like Argo Workflows, Slurm, Ray, AWS Parallel Cluster for mass-scale job processing and orchestration; Vast Data, Delta Lake, Databricks and Apache Iceberg for data management and access; and cloud and on-prem HPC resources

What You'll Bring

• Education & Experience: BS, MS, or PhD in Computer Science or a related technical discipline, or equivalent experience. 8+ years of hands-on coding experience in scripting (Python, PHP, Ruby) and systems languages (Rust, C++, C#, Go, Java, or Scala).
• Data Platform Expertise: Proficiency in managing large-scale data operations, including designing scalable pipelines (streaming and batch), working with varied data types, and optimizing flexible storage solutions using tools like Argo Workflows, Databricks, Slurm, etc.
• Data Management and Development Operations: E