Applied AI Operations Lead
Indexed description
Customer Deployment & Implementation
- Partner directly with healthcare organizations to deploy and configure AI agents for clinical documentation, scheduling, billing, communications, and workflow automation- Conduct workflow assessments to identify high-impact automation opportunities and design agent implementations that deliver measurable ROI- Configure and optimize agent performance using prompt engineering, context management, and tool selection based on specific customer requirements- Create and maintain customer-specific evaluation frameworks that demonstrate agent effectiveness and build stakeholder confidenceGovernance & Trust Building
- Maintain AI governance frameworks that ensure safe, reliable agent operations in production healthcare environments- Design and implement monitoring systems for agent performance, including accuracy tracking, drift detection, and quality assurance protocols- Partner with clinical and compliance teams to ensure deployed agents meet regulatory requirements and operational standards- Develop and deliver training programs that enable care teams to effectively collaborate with AI agentsTechnical Excellence & Innovation
- Work hands-on with foundation model APIs (OpenAI, Claude, Gemini) and the Canvas SDK to troubleshoot and optimize agent behavior- Collaborate with Applied AI engineering to translate field insights into product improvements and new capabilitiesBuild and maintain a library of best practices, implementation templates, and governance playbooks that accelerate customer success- Stay current with advances in LLM technology and healthcare AI applications to guide strategic customer conversationsStrategic Customer Partnership
- Serve as the trusted AI advisor for Canvas customers, helping them navigate the transformation to AI-powered healthcare operations- Drive executive conversations about AI strategy, demonstrating how Canvas's platform capabilities enable competitive advantage- Create compelling narratives around AI impact using customer success stories, performance metrics, and ROI analyses- Partner with sales teams on strategic opportunities, providing technical expertise and vision for AI transformationQualificationsRequired Experience & Background
- 5+ years in technical customer-facing roles (solutions engineering, technical consulting, customer success engineering)- Demonstrated experience deploying and managing LLM-based applications in production environments- Track record of driving successful enterprise technology implementations with measurable business outcomes- Strong project management skills with ability to juggle multiple customer engagements simultaneouslyAI & Technical Expertise
- Hands-on experience with products offered from foundation model providers (OpenAI, Anthropic,Google) and AI tools for low-code automation, with understanding of their capabilities and limitations- Understanding of AI safety, alignment, and governance principles- Experience with evaluation frameworks, A/B testing, and performance monitoring for AI systems- Learned experience with the edges and limitations of AI products, and understanding of the iterative process required to get high quality resultsHealthcare & Domain Knowledge
- Healthcare technology experience required, with ability to give workflow advice and construct automations that meet the needs of healthcare users- Understanding of clinical workflows, EMR systems, and healthcare operations a plus- Familiarity with HIPAA, clinical documentation standards, and healthcare compliance considerations- Ability to quickly develop domain expertise and speak credibly with clinical stakeholdersSkills & Capabilities
- Comfort with ambiguity and ability to define structure in undefined spaces- Exceptional written and verbal communication skills with ability to create compelling technical content- Strong analytical and problem-solving abilities with data-driven approach to decision making- Experience creating and delivering technical training to diverse audiencesWho You Are
- You're energized by ambiguity and thrive in fast-paced environments where you can experiment, iterate, and scale what works
- You have 5+ years of experience implementing workflow tools and automation solutions in enterprise settings, with 2+ years of hands-on experience with LLM-based systems
- You're deeply familiar with foundation model capabilities and have practical experience with context engineering and adversarial testing
- You excel at translating technical complexity into business value, comfortable presenting to both technical teams and C-suite executives
- You bring a consultative approach to customer engagement, able to diagnose problems, design solutions, and drive change management
- You have experience in healthcare technology or a strong willingness to rapidly develop domain expertise in clinical and operational workflows
- You combine technical depth with exceptional communication skills, able to create documentation, deliver training, and influence stakeholders
What Success Looks Like at 90 Days
- You've successfully deployed AI agents with at least 3 Canvas customers, demonstrating measurable improvements in efficiency and user satisfaction
- You've made significant contributions, based on your field insights, to the best practices playbook for AI agent deployment and monitoring
- You've created compelling case studies and ROI analyses that accelerate sales cycles and customer adoption
San Francisco preferred.
We are a mostly remote, distributed team. We encourage people to do their work when and where they perform at their best. Because of this structure, strong written communication skills, time management skills, and personal accountability are very important to us.Canvas Medical provides equal employment opportunities to all employees and applicants for employment without regard to race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.Originally posted on Himalayas
Create a free Caio profile to unlock the full index and keep your job-search signal for future recommendations.
Unlock free search