Data Scientist

We’re Hiring: Data Scientist – AI/LLM Evaluation & Cybersecurity

We are looking for a Data Scientist with strong experience in AI/ML, Large Language Models, and data analysis to develop and own solutions for evaluating the capabilities of AI models, particularly in the cybersecurity domain.

🔍 What You’ll Do

• Design and develop benchmarks and evaluation methodologies to assess the capabilities of AI/LLM models.
• Build and own a data-driven solution to determine whether a model demonstrates cybersecurity capabilities, including advanced cyber capabilities.
• Define evaluation criteria, datasets, test scenarios, and metrics to measure model performance and capabilities.
• Execute model evaluations and analyze results to identify patterns, trends, and capability levels.
• Develop robust analytical approaches to interpret model outputs and generate meaningful insights.
• Work with AI/ML evaluation frameworks and tooling
• Collaborate with ML and software engineering teams to build scalable model evaluation pipelines.
• Continuously improve benchmarks and evaluation approaches based on experimental findings.

🛠️ Mandatory Skills

• Strong experience in Data Science, Machine Learning, and statistical/data analysis.
• Hands-on experience with Large Language Models (LLMs).
• Fine-tuning Large Language Models
• LLMOps
• Prompt Engineering
• Retrieval-Augmented Generation (RAG)
• Strong Python/programming and software engineering skills.
• Experience designing experiments, benchmarks, and evaluation methodologies.

⭐ Good to Have

• Experience with DeepEval or similar LLM/model evaluation frameworks.
• Experience evaluating Generative AI/LLM capabilities.
• Knowledge of AI security, cybersecurity, or cyber threat domains.
• Experience working with LLM benchmarks, model safety, red teaming, or capability assessments.

If you are passionate about Data Science, Generative AI, LLM evaluation, and cybersecurity, and enjoy solving complex problems through experimentation and data-driven approaches, we’d love to hear from you!

📩 Apply now or reach out to learn more.

#Hiring #DataScientist #DataScience #AI #MachineLearning #LLM #GenerativeAI #LLMOps #RAG #PromptEngineering #AIResearch #Cybersecurity #LLMEvaluation