AI DevEngineer - Compliance Focused
Indexed description
General Overview
We are seeking an experienced AI Dev Engineer - Compliance Focused) to spearhead the buildout of our internal, company-wide compliance AI ecosystem. This role operates in a strict, privacy-first, and highly regulated environment. You will be responsible for designing and deploying enterprise-grade AI solutions using open-source models engineered entirely on our internal, high-performance hardware clusters—ensuring absolute data isolation with zero reliance on external cloud or SaaS-based AI APIs.
If you excel at extracting maximum performance from local silicon and architecting secure, air-gapped AI systems, this is your next project.
Key Responsibilities
Core duties and responsibilities include the following.
- Architect Local AI Infrastructure: Design, deploy, and optimize open-source LLMs and frameworks tailored for our custom bare-metal/private hardware clusters.
- Build Core AI Pipelines: Construct and maintain robust local model inference pipelines, advanced fine-tuning/embedding workflows, and highly secure Retrieval-Augmented Generation (RAG) systems.
- Optimize for Bare Metal: Drive maximum efficiency in latency, throughput, and compute resource utilization (CPU/GPU/memory tracking).
- Enforce Complete Data Isolation: Ensure all AI capabilities integrate seamlessly with internal data sources and compliance workflows without violating PII or regulatory constraints.
- Evaluate the Open-Source Stack: Select and implement local-first tooling across the AI ecosystem, including vector databases, orchestration frameworks, and model serving layers.
- Collaborate on Strategy: Partner with engineering leadership and compliance stakeholders to translate complex regulatory requirements into production-ready AI solutions.
- May perform other additional duties and responsibilities as assigned.
- Remote position
- Frequently required to sit
- Frequently required to talk or hear
- Continually utilize visual acuity to operate equipment, read technical information, and/or use a keyboard and mouse.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search