Back to search
European Tech Recruit Linkedin · Posted 24d ago

Backend Engineer

San Francisco, California, United States

Linkedin
Continue to application Add your email once, then Caio opens the original posting.

Indexed description

Backend Engineer, AI

San Francisco (Fully Remote)


We're looking for a Backend Engineer to build and operate the AI infrastructure that powers our product.

You'll own the inference and orchestration layer between foundation models and our users, designing production systems that are fast, reliable and scalable. This role is focused on solving real engineering problems around latency, throughput, observability and distributed systems—not building model architectures.


What You'll Do

  • Build and maintain backend services powering AI features in production
  • Design inference pipelines and orchestration layers for LLM-based applications
  • Develop scalable APIs used by mobile and desktop clients
  • Optimise latency, throughput and cost using caching, batching and streaming
  • Own production monitoring, logging, alerting and incident response
  • Work closely with ML and frontend engineers to deliver reliable AI experiences


What We're Looking For

  • Strong backend engineering experience with Python
  • Experience building and operating high-throughput, low-latency production systems
  • Understanding of distributed systems and microservice architectures
  • Experience with AI inference, LLMs, embeddings or similar AI technologies
  • Strong debugging and performance optimisation skills
  • Comfortable working in fast-moving product environments


Free. 20 seconds. No password. See every match in this search.

Create a free Caio profile to unlock more results and save your role and location preferences.

Unlock free search
Want help applying to roles like this? Search Caio for free. If repetitive applications get heavy, Managed Job Search adds supervised execution for $99/month.
View Managed Job Search