Back to search
webook.com Himalayas · Posted 3d ago

Prompt Engineer (LLM Systems, Evals & Safety)

Full time Remote

Prompt Engineering Machine Learning Engineering NLP Engineer AI Safety
Continue to application Add your email once, then Caio opens the original posting.

Indexed description

Do you want to love what you do at work? Do you want to make a difference, an impact, and transform peoples lives? Do you want to work with a team that believes in disrupting the normal, boring, and average?

If yes, then this is the job you are looking for , webook.com is Saudi’s #1 event ticketing and experience booking platform in terms of technology, features, agility, revenue serving some of the largest mega events in the Kingdom surpassing over 2 billion in sales.

Role Overview

Design high-quality prompts, system instructions, and tooling that make our LLM features accurate, safe, and cost-effective. You’ll own evaluation, prompt versioning, and continuous improvement.

Key Responsibilities:

  • Author, refactor, and chain prompts (system/tool/policy) for varied tasks.
  • Create offline/online evaluation harnesses (rubrics, golden sets, metrics).
  • Build prompt libraries with versioning, A/B testing, and telemetry.
  • Reduce hallucinations via verification, constrained decoding, and tool use.
  • Implement safety: jailbreak/prompt-injection tests, content policy checks, PII handling.
  • Partner with engineers to integrate prompts into production features.

Requirements

  • Demonstrated prompt design across multiple task types and models.
  • Experience building eval datasets and automated scoring (e.g., accuracy, faithfulness, utility, cost/latency).
  • Familiarity with retrieval-augmented generation concepts and tool/function calling.
  • Strong scripting (Python/TypeScript) for data prep, evals, and analysis.
  • Clear writing; ability to translate business goals into measurable prompt specs.

Nice-to-Haves

  • Experience with LangChain/LLM orchestration, vector stores, and rerankers.
  • Knowledge of safety tooling and red-teaming techniques.
  • Experiment platforms (feature flags, A/B tests), analytics.

Originally posted on Himalayas

Free. 20 seconds. No password. See every match in this search.

Create a free Caio profile to unlock more results and save your role and location preferences.

Unlock free search
Want help applying to roles like this? Search Caio for free. If repetitive applications get heavy, Managed Job Search adds supervised execution for $99/month.
View Managed Job Search