Senior Software Engineer - AI Foundations
Indexed description
AI Foundations is Toast's internal platform team for AI. We build the infrastructure, governance, and developer tooling that makes AI a reliable, scalable force multiplier across the entire product development lifecycle. Our products include the LLM Proxy, AI Key Management, Observability pipelines, the Claude Plugin Marketplace, and autonomous agents that participate directly in the software development lifecycle.
As a Senior Software Engineer on this team, you'll be hands-on building full-stack across the systems other Toast engineers depend on every day: the LLM proxy, agentic workflows, and the plugin marketplace that brings AI-native development practices to teams across the company.
A Day In The Life (Responsibilities)
- Design, build, and ship features across AI platform infrastructure, including the LLM proxy, AI key management, and observability pipelines
- Develop and extend autonomous agents that participate in the SDLC, such as the AI Review GitHub App and Developer Platform MCP integrations
- Build on and contribute to the internal plugin marketplace, developing plugins that encode Toast's architectural standards and quality practices into AI assistant behavior
- Implement MCP (Model Context Protocol) services and service templates that make it faster and easier for teams across Toast to build AI-powered workflows
- Contribute full-stack across backend services and frontend or developer-facing interfaces as needed
- Write high-quality, well-tested code and participate in design and code reviews
- Partner closely with product management to shape feature requirements, contribute to roadmap discussions, and translate product vision into reliable technical solutions
- 5+ years of experience designing and implementing scalable software systems, with a full-stack background spanning backend services and frontend or developer-facing interfaces
- Demonstrated experience building, deploying, or operating LLM-powered agents or AI-assisted developer tooling
- Familiarity with AI coding assistants (e.g., Claude Code, Cursor, GitHub Copilot) and an interest in extending them through custom plugins, skills, or hooks
- Experience with MCP (Model Context Protocol), tool use patterns, or agentic frameworks
- Working knowledge of prompt engineering and how LLM behavior responds to context and instructions
- Strong foundation in modern backend (Java, Kotlin, or similar) and frontend (TypeScript, React, or similar) technologies
- Experience with distributed systems, REST APIs, and cloud-native infrastructure
- Strong customer empathy and a drive to make developers' lives better through reliable, well-designed platform solutions
- Familiarity with A2A (Agent-to-Agent) protocols and multi-agent orchestration patterns
- Experience with machine learning concepts, model evaluation, or ML infrastructure
- Experience building developer experience platforms, internal tooling, or API gateways
- Familiarity with observability tooling for AI/LLM systems (e.g., Langfuse, DataDog)
Our Total Rewards Philosophy
We strive to provide competitive compensation and benefits programs that help to attract, retain, and motivate the best and brightest people in our industry. Our total rewards package goes beyond great earnings potential and provides the means to a healthy lifestyle with the flexibility to meet Toasters’ changing needs. Learn more about our benefits at https://careers.toasttab.com/toast-benefits.
How Toast Uses AI In Its Hiring Process
Throughout the hiring process, our goal is to get to know you. We use AI tools to support our recruiters and interviewers with tasks like note-taking, summarization, and documentation of interviews to ensure they can be fully focused on your conversation. All hiring decisions are made by people. To learn more: https://careers.toasttab.com/ai-in-hiring
Diversity, Equity, and Inclusion is Baked into our Recipe for Success
At Toast, our employees are our secret ingredient—when they thrive, we thrive. The restaurant industry is one of the most diverse, and we embrace that diversity with authenticity, inclusivity, respect, and humility. By embedding these principles into our culture and design, we create equitable opportunities for all and raise the bar in delivering exceptional experiences.
We Thrive Together
We embrace a hybrid work model that fosters in-person collaboration while valuing individual needs. Our goal is to build a strong culture of connection as we work together to empower the restaurant community. To learn more about how we work globally and regionally, check out: https://careers.toasttab.com/locations-toast.
Apply today!
Toast is committed to creating an accessible and inclusive hiring process. As part of this commitment, we strive to provide reasonable accommodations for persons with disabilities to enable them to access the hiring process. If you need an accommodation to access the job application or interview process, please contact [email protected].
Create a free Caio profile to unlock the full index and keep your job-search signal for future recommendations.
Unlock free search