Data Scientist
Indexed description
ADVANCE.AI is part of Advance Intelligence Group, a Series D-backed Tech Unicorn valued at US$2 billion, and also one of the largest independent technology startups based in Singapore. Founded in 2016, the Group has presence across South and Southeast Asia, Latin America and Greater China. The Group is backed by top tier investors SoftBank Vision Fund 2, Warburg Pincus, Northstar,Vision Plus Capital, Gaorong Capital, Pavilion Capital, GSR Ventures and Singapore-based global investor EDBI.
Ranked among LinkedIn's Top 15 Startups in Singapore in 2022 (the third year in a row we've been on the list), we are partners with 700+ enterprise clients across Southeast Asia, South Asia and Mexico in sectors such as banking, financial services, fintech, payment, retail and e-commerce.
Advance Intelligence Group employees are united by a shared vision and purpose: to Advance with Intelligence for a Better Life--for our customers, colleagues and communities.
Our culture is built on values that are core to who we are and what we stand for:
- We foster an INNOVATION mindset
- We achieve results with EFFICIENCY and excellence
- We take pride in the QUALITY of our work
- We uphold INTEGRITY in all we do
- We embrace COLLABORATION to work across business lines and borders
Responsibilities
- Design and run offline and online evaluations for different LLM routing strategies.
- Analyze user interaction, model usage, quality signals, cost, and budget-related metrics.
- Support A/B testing and controlled experiments to compare routing strategies.
- Build datasets, evaluation pipelines, dashboards, and monitoring metrics.
- Investigate failures and identify opportunities to improve routine decisions.
- Work closely with engineering and product teams to turn analysis into practical improvements.
- Bachelor’s or Master’s degree in Computer Science, Data Science, Statistics, Mathematics, or a related field.
- Strong fundamentals in Python, SQL, statistics, and data analysis.
- Good understanding of experimentation, hypothesis testing, and A/B testing.
- Comfortable working with imperfect real-world data and open-ended problems.
- Strong analytical thinking and willingness to learn quickly.
- Interest in LLMs, AI agents, model evaluation, or AI infrastructure.
- Experience with LLM evaluation, recommendation/ranking systems, experimentation platforms, or machine learning projects.
- Familiarity with data visualization and building lightweight evaluation pipelines.
- Hands-on experience with LLM APIs or AI coding tools.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search