Senior Staff Engineer, Computer Vision/AI
Confirmed live in the last 24 hours
Instacart
Job Description
We're transforming the grocery industry
At Instacart, we invite the world to share love through food because we believe everyone should have access to the food they love and more time to enjoy it together. Where others see a simple need for grocery delivery, we see exciting complexity and endless opportunity to serve the varied needs of our community. We work to deliver an essential service that customers rely on to get their groceries and household goods, while also offering safe and flexible earnings opportunities to Instacart Personal Shoppers.
Instacart has become a lifeline for millions of people, and we’re building the team to help push our shopping cart forward. If you’re ready to do the best work of your life, come join our table.
Instacart is a Flex First team
There’s no one-size fits all approach to how we do our best work. Our employees have the flexibility to choose where they do their best work—whether it’s from home, an office, or your favorite coffee shop—while staying connected and building community through regular in-person events. Learn more about our flexible approach to where we work.
Overview
Instacarts Caper team is building AI-powered checkout experiences for in-store shopping. Basket Intelligence is a core functionality of the Caper smart carts, allowing us to unlock use cases in all domains (Shopping Experience, Incentives, Anti-Theft, Indoor Location). Our goal is to continuously improve basket understanding, and for that we are using more and more Computer Vision and AI technologies to ensure accuracy. The CV/AI: Visual Recognition group is at the center of that mission, building computer vision models and the infrastructure to support all domains in expanding their understanding of the customer basket.
As a Staff CV/AI Engineer, you’ll develop novel models and algorithms from scratch — true 0-to-1 work — alongside contributing to data handling, labeling, and modeling infrastructure needed to support them. You’ll work closely with Device, Backend, AI Infrastructure, and Instacart’s broader ML platform teams to define where and how models run, improve basket accuracy, and reduce shrink and anti-theft friction for our retail partners.
What You’ll Do
- Invent and build novel CV models and algorithms from scratch — detection, classification, tracking, and multi-sensor fusion — to replace heuristic-based basket understanding with robust, ML-driven accuracy.
- Own end-to-end data infrastructure: design and operate labeling pipelines, curation strategies, active learning loops, and annotation quality controls that continuously improve model performance. Devise mechanisms to label data in a way that is globally usable across all Caper domains.
- Own the model-to-device pipeline: optimize models for Caper’s edge hardware using quantization, pruning, TensorRT/ONNX, and CUDA-level tuning to meet real-time latency and power budgets.
- Partner with AI Infrastructure and Instacart’s ML platform teams to define where and how models run — evaluating tradeoffs across on-device, cloud, and third-party vendor options (e.g., NVIDIA).
- Translate business goals — basket accuracy, shrink reduction, retailer tooling — into system requirements; define metrics and run rigorous offline and online experiments to validate and communicate impact.
- Define technical strategy and roadmap for CV/AI; serve as the primary technical voice in cross-functional decisions with Device, Backend, AI Infrastructure, and Product.
- Establish engineering standards for model development and deployment that scale org-wide; grow engineers through mentorship and design leadership.
- Ensure in-store image and video systems are designed with privacy, security, and compliance requirements built in from the start.
Minimum Qualifications
- 8+ years owning end-to-end computer vision or deep learning systems in production — with a demonstrated track record of building models and algorithms from scratch, not just adapting or fine-tuning existing ones.
- Bachelor’s in Computer Science, Electrical Engin
Similar Jobs
Coupang
Senior Staff Machine Learning Infrastructure Engineer – Search & Discovery
Datadog
Senior Staff GenAI Engineer - Application Performance Monitoring (APM)
Staff Data Engineer, tvScientific
Bill.com
Senior Staff Machine Learning Engineer - Platform
Waymo
Senior Staff Machine Learning Engineer, Simulation
Waymo