Senior Software Engineer, AI Data Foundry

Mission Summary

The AI Data Foundry is the vital link between our company's expansive data and the engineering teams that rely on it. We architect and operate the core services and infrastructure necessary to transform petabytes of raw data each month into actionable insights for our Machine Learning and Autonomy engineers. This role is a key contributor across our core initiatives:

• Data Processing: We are building state-of-the-art infrastructure to meet the demands of our rapidly scaling fleet and sophisticated ML engineering requirements. You will be responsible for ensuring that our core data pipelines are robustly engineered—meaning they are performant, user-friendly, and highly fault-tolerant.
• Data Discovery: we are building a platform that combines cataloging data for search needs across our metadata stores, vector datastores, and various data warehouses to super charge our ML pipelines. You would be coming in and working with ML and autonomy stakeholders to build out this new discovery platform. 
• Data Lineage: we are getting started with building our data lineage system that will track the usage of all data at Motional. You would work with our stakeholders to ensure our system is widely adopted and address customer pain points.

What You'll Be Doing

• Play a key role in designing and building the next generation of data infrastructure.
• Build scalable backend services for data discovery and data lineage systems.
• Write high quality, maintainable code to process petabytes of data 
• Lead and champion high-level system design and quality code reviews/technical contributions.
• Design, build, and maintain scalable data processing and access with cloud ETL technology.

What We're Looking For

• 3+ years of professional experience as a data engineer or data pipeline engineer
• BS or MS in Computer Science or related field
• Strong development experience with Python and SQL.
• Expertise with AWS services and solutions (EKS, Lambda, ETL) 
• Experience with distributed system design and development
• Comfortable working in a fast-paced, continuous delivery environment

Bonus Points (not required): 

• Experience with Infrastructure Monitoring
• Experience working in cross-functional development teams