Inference Optimization — Member of Technical Staff
Indexed description
Inference Optimization — Member of Technical Staff
Berlin, Full-time, In person
Who Are We
Models should learn from what happens after deployment. We're building the loops that make this possible.
We will be the default inference provider for specialized tokens, running models that continuously adapt to each customer and workload. That means serving many continuously adapting models with frontier-level performance and attractive economics.
The Work
- Finding novel, hardware-informed quantization methods across model architectures
- Writing and tuning Triton and CUDA kernels
- Finding bottlenecks across compute, memory, and communication
- Efficiently serving LoRAs, learned memory, specialized weights, and other forms of model adaptation
Great candidates might come from ML systems, compilers, mathematics, physics, competitive programming, security, or HPC. The common thread is strong first-principles reasoning, an obsession with efficiency, and a habit of going deep on hard problems for the fun of it.
We work together in person from our office in Berlin.
Interview process
- Two technical interviews
- An onsite interview at our Berlin office
Tell us about exceptional work you've done.
First nameLast name
EmailLinkedIn URLWhat exceptional work have you done?
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search