About the role

Aplyr's Quick Take

This role is for an Applied AI Software Engineer focused on evaluating and improving AI agents used in healthcare applications. You'll design experiments to test performance and reliability of these agents, collaborating with various teams to ensure they meet real-world needs. It's primarily an individual contributor role with a strong emphasis on technical evaluation and experimentation.

Good fit

Ideal candidates have extensive experience with large language models and AI evaluation methods, likely with a background in software engineering or data science. A collaborative mindset and ability to work across teams in a fast-paced environment will help you thrive here.

Worth noting

The salary range is quite high, suggesting they value specialized skills significantly. The role also involves direct impact on healthcare technology, which could be rewarding for those passionate about improving patient outcomes.

Canvas Medical is the electronic medical records (EMR) and payments development platform for healthcare. We build modern, elegant front- and back-end tooling to enable new ways for developers and clinicians to collaborate to solve healthcare’s toughest challenges. Canvas is institutionally backed by some of the greatest technology investors in the world (funded notable health tech companies such as GoodRx, Oscar Health, and Hims & Hers Health).

The Role

We’re hiring an Applied AI Software Engineer to lead evaluations for agents in development and the post-deployment fleet of agents operating in Canvas to automate work for our customers. You will help develop agents in Canvas using state of the art foundation model inference and fine-tuning APIs along with our server-side SDK. The server-side SDK provides extensive tools and virtually all the context necessary for excellent agent performance. You’ll be responsible for designing and running rigorous evaluation experiments that measure performance, safety, and reliability across a wide variety of clinical, operational, and financial use cases.

This role is ideal for someone with deep experience evaluating LLM-based agents at scale. You’ll create high-fidelity unit evals and end-to-end evaluations, define expert-determined ground truth outcomes, and manage iterations across model variants, prompts, tool use, and context window configurations. Your work will directly inform model selection, fine-tuning, and go/no-go decisions for AI features used in production settings.

You’ll collaborate with product, ML engineering, and clinical informatics teams to ensure that Canvas's AI agents are not only capable, but trustworthy and robust under real-world healthcare constraints. You will also work with technical product marketers and developer advocates to help our broader developer community and the broader market understand the uniquely differentiated value of agents in Canvas.

Skills & Tags

go rust ai product design

Aplyr's read

Canvas Medical is revolutionizing healthcare data management with cutting-edge technology, attracting professionals passionate about enhancing healthcare efficiency and patient care.
Synthesized from recent postings & public sources

What's promising

•Canvas Medical offers innovative solutions for healthcare data integration, improving provider efficiency.
•The company is at the forefront of healthcare technology, leveraging AI to enhance patient care.
•Recent hires in AI and engineering indicate a focus on advanced tech development.

What to watch

•The healthcare technology sector is highly competitive, posing challenges for market differentiation.
•Rapid tech advancements require constant adaptation, which can be resource-intensive.
•Limited public information about the company's long-term financial stability and growth trajectory.

Why Canvas Medical

•Canvas Medical specializes in integrating complex healthcare data into user-friendly platforms.
•The company emphasizes AI-driven solutions, setting it apart in healthcare technology.
•Canvas Medical focuses on improving provider workflows, directly impacting patient care quality.

Aplyr’s read is generated by AI from public sources. Was it useful?

About Canvas Medical

Canvas Medical

canvasmedical.com

View company

Canvas Medical is a healthcare technology company that provides a platform for managing patient data and workflows. Their solutions aim to improve the efficiency of healthcare providers and enhance patient care through better data integration and management.