Principal AI Architect

Marmon Technologies India Private Limited

As a part of the global industrial organization Marmon Holdings—which is backed by Berkshire Hathaway—you’ll be doing things that matter, leading at every level, and winning a better way. We’re committed to making a positive impact on the world, providing you with diverse learning and working opportunities, and fostering a culture where everyone’s empowered to be their best.

The newly established AI Center of Excellence (COE) is seeking its key technical hire: a hybrid leader who functions as a Technical Architect, Technical Lead, and Delivery Owner. This is a highly visible, enterprise-level role responsible for bridging the gap between high-level AI strategy and hands-on technical execution. You will partner with business stakeholders across Marmon’s diverse portfolio to design, build, and deploy AI solutions that drive measurable value. This role is ideal for a strategic thinker who is equally comfortable whiteboarding an architecture as they are owning the end-to-end delivery of a production-ready AI agent or application.

Position Overview

The newly established AI Center of Excellence (COE) is seeking its key technical hire: a hybrid leader who functions as a Technical Architect, Technical Lead, and Delivery Owner. This is a highly visible, enterprise-level role responsible for bridging the gap between high-level AI strategy and hands-on technical execution. You will partner with business stakeholders across Marmon’s diverse portfolio to design, build, and deploy AI solutions that drive measurable value. This role is ideal for a strategic thinker who is equally comfortable whiteboarding an architecture as they are owning the end-to-end delivery of a production-ready AI agent or application.

Mandatory Skills

• Demonstrated expertise in large language models (LLMs), prompt engineering, and agentic frameworks such as LangChain, Semantic Kernel, and Copilot Studio
• Proven experience designing and delivering enterprise-grade AI solutions, including retrieval-augmented generation (RAG) and agentic workflows
• Strong expertise in cloud-native architecture and deployment across Azure, AWS, or GCP
• Extensive system design and architecture experience for complex, integrated enterprise platforms
• Ability to translate business requirements into scalable, practical AI solutions
• Hands-on experience building and scaling multi-agent systems and agentic workflows
• Ability to define data strategies across structured, unstructured, and vector-based data to improve AI performance and RAG accuracy
• Strong stakeholder engagement skills, with experience leading technical discovery sessions and translating business challenges into AI-enabled solutions
• Good understanding of multimodal AI models, including embedding and retrieval services for diverse content types such as video, CAD drawings, and other complex file formats

Key Responsibilities

• Design and implement enterprise-grade AI solutions, focusing on agentic workflows, RAG (Retrieval-Augmented Generation), and integrated LLM applications.
• undefined
• Lead the technical execution of AI projects, managing resources and timelines while maintaining a high bar for code quality and architectural integrity.
• undefined
• Collaborate with IT and Security teams to ensure AI deployments comply with enterprise data governance and infrastructure standards.
• undefined
• Mentor future technical team members and establish best practices for AI development, testing, and monitoring.
• undefined
• Provide "boots on the ground" technical leadership during the initial build phase, transitioning to a more strategic architectural role as the COE scales.
• undefined
• Stay at the forefront of AI research and toolsets, evaluating new technologies for their potential to benefit Marmon’s businesses.
  
  

Required Qualifications

• Bachelor’s or Master’s degree in Computer Science Engineering, or a related technical field.
• 15+ years of experience in software engineering and architecture, with at least 2-3 years focused on AI/ML delivery.
• Experience implementing information lifecycle management and levering AI for solving use cases focused in enterprise unstructured content.
• Experience in a consulting or multi-business environment is highly preferred, as you will be supporting a wide range of autonomous industries.
• Proven experience leading technical teams and owning the delivery of high-visibility enterprise initiatives.

Following receipt of a conditional offer of employment, candidates will be required to complete additional job-related screening processes as permitted or required by applicable law.