Sr. AI/ML Engineer

About The Role

We are seeking a Senior AI/ML Engineer to lead the development of core machine learning systems and AI-driven automation. This role focuses on building and improving LLM-based systems, NLP pipelines, and intelligent workflows that transform complex, unstructured data into usable insights.

You will work directly with senior leadership to shape technical direction, define what should be built, and turn ambiguous product goals into real engineering solutions. This is a hands-on role for someone comfortable building in new and evolving problem spaces.

What You’ll Do

• Lead the design and development of machine learning systems and LLM-based applications
• Fine-tune and adapt large language models for domain-specific use cases
• Build NLP pipelines to extract structured data from complex, unstructured documents
• Translate ambiguous product goals into clear technical and ML execution plans
• Work directly with product signals, user feedback, and backlog input to prioritize development work
• Build evaluation systems to measure model performance and detect regressions
• Design automated benchmarking pipelines for continuous model testing
• Define meaningful performance metrics tied to real-world outcomes
• Build feedback loops that use user corrections to continuously improve model performance
• Apply computer vision techniques to extract data from PDFs and scanned documents
• Develop AI agents that interact with web systems using automation tools such as Playwright or Selenium
• Work across system design, infrastructure, training, and inference pipelines
• Build scalable ML systems and supporting infrastructure from the ground up

How You’ll Succeed

• Turn unclear problem spaces into structured, executable technical plans
• Build systems that improve continuously through feedback and evaluation
• Deliver reliable, production-ready AI/ML solutions in fast-changing environments
• Balance experimentation with practical system design and scalability
• Communicate clearly with technical and non-technical stakeholders
• Make strong prioritization decisions when everything is not fully defined

Who You Are

• 6+ years of Python development experience
• 4+ years of experience in AI/ML engineering roles
• Strong experience building and deploying LLM-based systems (e.g., Claude, OpenAI models)
• Comfortable using modern LLM workflows such as prompting, evaluation, and iteration
• Experience building NLP systems for information extraction or document understanding
• Strong understanding of model evaluation, benchmarking, and performance measurement
• Experience working with JavaScript/Node.js and React in production environments
• Familiarity with MongoDB and AWS
• Experience building systems that integrate feedback loops or continuous learning
• Comfortable working in ambiguous environments without fully defined specifications
• Strong communication skills (upper intermediate or higher English)

Since 2005, Perform's engineers have been helping companies scale their apps and their teams. We were near-shoring before it was even a term and have worked with 100s of clients along the way.