Back to search
Love Freedom Solution Linkedin · Posted 1mo ago

Senior AI Engineer-Inference & Agent Systems

New York City, New York, United States

Linkedin
Continue to application Add your email once, then Caio opens the original posting.

Indexed description

🚀 Senior AI Engineer (3–7 Years Experience)

We’re hiring a Senior AI Engineer to build and scale production-grade AI systems used daily by real customers.

This is a hands-on role for someone who understands how to take AI from concept to high-performing, reliable systems in production — especially in environments where LLMs are non-deterministic and constantly evolving.

💡 What You’ll Do⚡ Optimize Performance

  • Drive inference optimization to achieve sub-400ms Time to First Token (TTFT) across multi-step agent pipelines
  • Improve latency, throughput, and cost efficiency across the system

🧠 Own Evaluation Systems

  • Build and manage ground truth datasets
  • Develop automated evaluation and scoring pipelines to detect regressions and ensure quality

🤖 Build Advanced Agent Architectures

  • Design and implement Plan → Execute → Synthesize agent pipelines
  • Enable parallel sub-agent execution for complex workflows
  • Partner closely with leadership to define system architecture

🔗 Integrate State-of-the-Art Models

  • Implement and optimize models from:
    • OpenAI
    • Anthropic
    • Google DeepMind
  • Configure models for high-performance analytics and reasoning use cases
⚙️ Build Reliable Orchestration

  • Lead development of orchestration systems using Temporal
  • Implement robust retry logic, timeouts, and partial failure recovery
  • Ensure system reliability in complex, long-running workflows

🔍 Develop Observability Infrastructure

  • Build tools to trace:
    • Token-level outputs
    • Tool calls
    • Reasoning and synthesis steps
  • Enable fast debugging and continuous system improvement
🎯 What We’re Looking For

  • 3–7 years of experience in software or AI engineering
  • Proven track record of shipping AI applications used by real customers
  • Experience building LLM-powered systems in production
  • Strong understanding of:
    • Latency optimization
    • Distributed systems
    • Handling non-deterministic model behavior
  • Ability to thrive in a fast-paced startup environment
Bonus: Experience in finance or analytics-driven systems

💰 Compensation & Environment

  • Competitive base salary + equity
  • High ownership, high-impact role
  • Work directly with leadership on core product architecture
  • Fast-moving team with rapid iteration cycles

📌 Right to Represent (RTR)

By applying, you agree that Love Freedom Solution may represent you for this opportunity and share your profile with the client.

Skills: orchestration,architecture,pipelines,leadership,analytics,models,optimization,advanced

Free. 20 seconds. No password. See every match in this search.

Create a free Caio profile to unlock more results and save your role and location preferences.

Unlock free search
Want help applying to roles like this? Search Caio for free. If the repetitive CV tweaking gets heavy, Daniel can help set up Caio Agent.
Ask about Agent