Senior AI Engineer - LLM Platforms & RAG - Hybrid - Budapest

Senior AI Engineer - LLM Platforms & RAG Systems (Budapest) | Hybrid

We're supporting a highly regarded enterprise software organisation building a dedicated AI Function focused on creating AI-native capabilities across a complex product ecosystem.

This is a deeply technical AI engineering role focused on building the core intelligence layer that future AI capabilities will depend on.

You'll work closely with engineering and architecture teams to design and scale production-grade LLM systems, retrieval infrastructure, evaluation frameworks, and agentic AI capabilities across the platform.

This role would suit someone who enjoys solving hard GenAI infrastructure problems rather than simply consuming AI APIs.

What you'll be doing:

• Building and optimising production LLM orchestration pipelines
• Designing modular prompt and context architectures
• Building advanced RAG systems using federated retrieval strategies
• Developing knowledge graph infrastructure using graph and vector databases
• Designing evaluation frameworks to measure AI system quality and retrieval effectiveness
• Implementing multi-agent orchestration patterns and tool-calling workflows
• Supporting model evaluation, benchmarking, and selection
• Contributing to AI governance and compliance readiness

What they're looking for:

• Strong hands-on experience building production LLM systems
• Deep practical understanding of RAG architectures and semantic retrieval
• Experience with graph databases and vector databases
• Strong prompt engineering and context engineering experience
• Experience building evaluation frameworks for AI systems
• Strong Python engineering background
• Experience building APIs, orchestration layers, and CI/CD pipelines
• Someone comfortable operating in a fast-moving engineering environment with high ownership

Nice to have:

• Multi-agent orchestration experience
• Knowledge graph architecture
• AI governance / EU AI Act awareness
• Shared AI platform/infrastructure experience
• SAP ecosystem exposure

This is not a role for someone whose AI experience is primarily theoretical or limited to basic chatbot implementations.

The ideal candidate is likely currently working within:

• AI infrastructure/platform engineering
• AI-native SaaS products
• Enterprise GenAI platforms
• Retrieval/search systems
• Production copilot environments
• Knowledge graph or semantic search platforms

Strong opportunity for engineers who enjoy building the foundational systems that make enterprise AI reliable, scalable, and production-ready.