Senior Engineer, Platform Engineering and Architecture
Indexed description
- To lead the engineering, architecture, and run-state ownership of the bank's enterprise AI & Agentic Platform, ensuring it operates as a reliable, secure, observable, and bank-grade production platform supporting agents and AI workloads across the Group.
- The role is the senior technical authority for platform engineering and architecture across the agentic runtime, model gateway, integration fabric, identity layer, and infrastructure backbone of the platform.
- It operates in a two-in-a-box model with the existing Platform Product Owner to provide concurrent technical ownership and organizational resilience for the platform, with shared accountability for platform availability, performance, cost, security posture, and architectural evolution.
- The role is deeply technical in nature, requiring hands-on engineering depth across distributed systems, agentic protocols, LLM infrastructure, identity and access management, and cloud-native platform engineering.
- Own the end-to-end technical architecture of the AI & Agentic Platform's five-layer stack: Action Gateway, Agent Kernel, Control Plane, Knowledge Foundation, and the Users and Channels layer.
- Architect and evolve the agentic runtime to natively support the emerging multi-protocol stack: Model Context Protocol (MCP) for agent-to-tool access, Agent-to-Agent (A2A) for inter-agent coordination and task delegation, Agent Communication Protocol (ACP) and equivalent emerging standards, ensuring the platform is interoperable with hyperscaler agent fabrics (Azure AI Foundry agents, AWS Bedrock Agents, Google ADK).
- Design the platform's agent kernel, including agent lifecycle management, planning and reasoning loops, memory architecture (short-term, long-term, episodic), state management, session affinity, scratchpad persistence, and execution chains.
- Architect the platform's knowledge foundation, including vector store selection and topology, hybrid retrieval (BM25, dense, graph), embeddings strategy, knowledge graph integration (FIBO, OWL, SHACL, SPARQL), context engineering, and grounding patterns.
- Design the platform's control plane, including policy-gated execution, Know Your Agent (KYA) enforcement at runtime, agent registries, tool registries, capability discovery, evaluation pipelines, and tracing and lineage at agent and tool granularity.
- Architect and engineer the platform's LLM gateway and model abstraction layer, providing a unified interface across foundation model providers (Azure AI Foundry, AWS Bedrock, OpenAI, Anthropic, Google Vertex AI, Cohere) with intelligent routing, fallback, retries, prompt and response caching, semantic caching, rate limiting, token accounting, cost attribution, and tenant isolation.
- Design model serving patterns for managed APIs, dedicated capacity (PTUs / provisioned throughput), and self-hosted open-weight models on GPU infrastructure (vLLM, TGI, Triton, or equivalent), with appropriate trade-offs across cost, latency, sovereignty, and compliance.
- Lead the integration architecture between the AI Platform and the bank's core estate, including core banking, payments, treasury, credit and risk systems, the enterprise data platform (Azure, Cloudera, Databricks), enterprise APIs, ESB, event streaming (Kafka, Event Hubs), and the data product layer.
- Engineer the platform's tool layer and MCP server estate, including tool packaging, versioning, capability advertisement, schema enforcement, and runtime tool discovery across Wholesale, Retail, and Group functions.
- Architect and own the agent identity and workload identity model for the platform, including non-human identity (NHI) management, agent identity lifecycle, blended user-plus-agent identity for delegated actions, and the identity propagation chain across multi-agent flows.
- Implement zero-trust principles across the agentic stack, including least-privilege scoping per agent and per task, real-time policy evaluation, behavioral posture checks, and continuous authorization rather than static service-account-style access.
- Engineer the platform's runtime governance controls, including KYA enforcement, prompt and output guardrails (PII, PHI, MNPI, prompt injection defense), sensitive action approval flows, and human-in-the-loop escalation patterns.
- Harden the platform to meet CBUAE, internal model risk, and Group governance requirements, including auditability, lineage, data residency, model risk controls, third-party model governance, and OWASP LLM Top 10 alignment.
- Key Accountabilities — Infrastructure & Run-State
- Lead the platform's cloud and infrastructure architecture across Azure (primary) and AWS, including infrastructure as code (Terraform), networking (private endpoints, peering, egress control), Kubernetes (AKS) and container orchestration, secrets management, and CI/CD pipelines.
- Own platform Site Reliability Engineering (SRE), including SLO design, error budget management, observability (OpenTelemetry, traces, metrics, logs at agent and tool granularity), incident response, post-mortems, capacity planning, and cost governance for a growing fleet of agents and AI workloads in production.
- Drive engineering excellence across the platform team, including testing discipline (unit, integration, evaluation, red-teaming), documentation, infrastructure as code maturity, operational readiness reviews, and technical mentorship of platform engineers.
- Represent the platform in senior technical forums with Enterprise Architecture, Cyber, Model Risk, Internal Audit, and the Group CTTO's office on architecture and engineering matters.
- Engage with hyperscale, model provider, and framework vendor technical teams on platform-level integration, performance, sovereignty, and cost optimization.
- Deep, current expertise in agentic AI architecture and the modern multi-protocol stack: Model Context Protocol (MCP), Agent-to-Agent (A2A), Agent Communication Protocol (ACP), and the engineering patterns required to build interoperable agentic systems on top of them at platform scale.
- Deep technical knowledge of LLM serving and inference architecture, including managed model APIs (Azure AI Foundry, AWS Bedrock, OpenAI, Anthropic, Google Vertex AI), provisioned throughput / PTUs, self-hosted open-weight models, GPU scheduling, vLLM / TGI / Triton, KV-cache management, batching strategies, and the cost-latency-quality trade-offs that drive model selection.
- Strong working expertise in LLM gateway and AI gateway architecture, including model routing, fallback and retry, prompt and semantic caching, rate limiting, tenant isolation, token accounting, and policy enforcement at the gateway boundary.
- Deep experience in retrieval and knowledge architecture, including vector databases (pgvector, Azure AI Search, Pinecone, Weaviate, Qdrant, or equivalent), hybrid retrieval, reranking, embeddings model selection, knowledge graphs (FIBO, RDF, OWL, SHACL, Neo4j, Apache Jena), and context engineering at scale.
- Deep proficiency in cloud-native platform engineering on Azure (preferred) and AWS, including Terraform, Kubernetes (AKS / EKS), Helm, service mesh (Istio, Linkerd), API gateways (APIM, Kong, Envoy), private networking, and policy-as-code (OPA, Azure Policy).
- Strong Site Reliability Engineering background, including production on-call, incident leadership, post-mortem discipline, SLO and error-budget design, capacity planning, and observability tooling (Open Telemetry, Prometheus, Grafana, Datadog, or equivalent) tuned for non-deterministic AI workloads.
- Strong grounding in security engineering for regulated industries, including OWASP LLM Top 10, prompt injection defence, model supply-chain security, secrets management, network segmentation, data residency, and audit logging.
- Demonstrated ability to operate effectively in a two-in-a-box model with another senior technical owner, including shared accountability, shared on-call, and shared decision-making.
- Track record of raising engineering standards across a platform team through standards, design reviews, documentation, and direct technical mentorship.
Minimum Experience
- 10+ years in software and platform engineering, with significant time spent at senior, staff, or principal engineering / architect level.
- Substantive experience in financial services, banking, or another comparably regulated industry.
Track record of building, integrating, or operating LLM-based or agentic systems in production.
Minimum Qualifications
- Bachelor's degree in computer science, Software Engineering, Electrical Engineering, or a related technical discipline.
- Master's degree (MSc / MTech / MEng) in Computer Science, Software Engineering, Distributed Systems, or a related discipline preferred.
- Relevant professional certifications in cloud engineering (Azure Solutions Architect Expert, Azure DevOps Engineer Expert, AWS DevOps Professional, AWS
- Solutions Architect Professional, Certified Kubernetes Administrator), security (CISSP, CCSP), or SRE considered an advantage.
Create a free Caio profile to unlock more results and save your role and location preferences.
Unlock free search