Senior/Staff Software Engineer, Search & Retrieval Infrastructure

Role Overview

We are hiring a senior/staff software engineer to help design and build core components of our next-generation knowledge retrieval system built for the AI era. You'll build the framework that allows our customers to connect knowledge–synthesized from structured and unstructured data–to modern LLM-powered applications.

What You Will Do

Design and build scalable platform components leveraging advanced retrieval via query planning, semantic and hybrid search, metadata-aware search, and LLM generation. Optimize latency, throughput and cost across large-scale inference and retrieval workloads.

Why It Might Be a Fit

This role is ideal for someone who loves backend system architecture, distributed systems, and applied AI infrastructure. You'll have significant ownership across architecture, performance, and system reliability.

Requirements

• 6+ years of shipping production-grade backends for large-scale systems
• Experience building high-throughput indexing pipelines
• Direct experience in semantic search, vector databases, hybrid retrieval strategies, or with traditional search engines like Elastic or OpenSearch
• Experience with Retrieval-Augmented Generation (RAG) patterns
• Expertise in at least one major language like Go, Rust, C++, Java, or Python
• Familiarity and experience with modern infrastructure tools, such as Kubernetes, cloud-native architectures, and observability frameworks

Benefits

• Comprehensive health coverage
• 401(k) Plan
• Equity award
• Flexible time off
• Paid parental leave
• Annual Company Retreat
• WFH Equipment Stipend

Originally posted on Himalayas