Enterprise AI Application Architect

Enterprise AI Application Architect

Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets. An ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence. Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Work® Institute and recognized as a ‘Cool Vendor’ and a ‘Vendor to Watch’ by Gartner.

Please visit Fractal | Intelligence for Imagination for more information about Fractal.

Note: This position is not eligible for Immigration Sponsorship at this time.

Position Overview:

We are seeking an experienced AI Apps Architect on AWS to lead the design, development, and deployment of enterprise-scale AI-powered applications on Amazon Web Services. This role combines deep cloud architecture expertise with emerging AI/ML capabilities and agentic AI tools to build innovative solutions. The ideal candidate will have a proven track record of delivering complex microservices-based systems, leading cross-functional technical teams, translating business requirements into scalable technical solutions, and crucially, understanding the economics of AI systems—including LLM costs, agent architecture trade-offs, ROI analysis, and cost optimization strategies.

Key Responsibilities:

Architecture & Design

• Design and architect enterprise AWS solutions integrating AI/ML services (SageMaker, Bedrock, Lambda) with microservices-based applications
• Define cloud-native patterns, scalability strategies, and deployment models (ECS, EKS, Fargate) for AI-powered applications
• Establish security, compliance, and data governance frameworks for AI/ML workloads on AWS
• Evaluate and integrate agentic AI tools (Claude, Copilot, custom agents) to enhance development velocity and application intelligence

Development & Delivery

• Lead end-to-end development of microservices and REST APIs leveraging Spring Boot, Spring Integration, and event-driven architecture (Kafka, SNS/SQS)
• Partner with business stakeholders to elicit requirements, define technical solutions, and establish delivery roadmaps
• Own application health, release readiness, and production deployment via CI/CD pipelines (Jules, Spinnaker, CodePipeline)
• Leverage AI productivity tools (Claude Code, Copilot) with skills and coordinator frameworks to accelerate development and improve delivery consistency

AI Agent Economics & Architecture

• Design agentic AI systems with deep understanding of LLM economics—token costs, model pricing tiers, and cost optimization across Claude, GPT, and other providers
• Conduct ROI analysis and business case development for AI agent implementations vs. traditional API-based solutions, including performance benchmarks and cost trade-offs
• Architect scalable agent frameworks with built-in cost controls, caching strategies, and token optimization techniques; evaluate tool use, RAG patterns, and fine-tuning economics
• Define agent evaluation metrics (accuracy, latency, cost-per-transaction, token efficiency) and establish governance frameworks for responsible AI deployment
• Lead cost analysis and capacity planning for multi-model environments, balancing model capabilities with AWS infrastructure costs (Bedrock, SageMaker, Lambda pricing models)

Leadership & Cross-Functional Collaboration

• Lead and mentor technical teams; drive architectural decisions and technical excellence standards
• Facilitate requirements grooming, roadmap planning, risk identification, and stakeholder alignment
• Coordinate across developers, QA, DevOps, and end users for quality assurance and production readiness

Required Qualifications:

• 15+ years of software engineering experience, with at least 5 years in enterprise architecture or lead technical roles
• Deep expertise in AWS services: ECS, EKS, Fargate, Lambda, S3, RDS/Aurora, SageMaker, or Bedrock
• Strong proficiency in Java/J2EE, Spring Boot, Spring Integration, and RESTful microservices architecture
• Proven experience designing and deploying event-driven systems using KAFKA, SNS, or SQS
• Hands-on experience with CI/CD pipelines and container orchestration (Kubernetes/EKS, Docker)
• Strong track record of translating business requirements into scalable technical solutions
• Excellent cross-functional leadership, communication, and stakeholder management skills

AI Agent Economics & LLM Expertise

• Demonstrated expertise in agentic AI design, including hands-on experience building, deploying, or evaluating AI agents (OpenAI Assistants, Anthropic Claude agents, LangChain, AutoGen, or similar frameworks)
• Strong understanding of LLM economics: token counting, model pricing models, cost analysis across providers (Claude, GPT-4, Llama, etc.), and optimization techniques for reducing inference costs
• Ability to conduct ROI analysis and business case development for AI solutions, including cost-per-transaction modeling, performance benchmarking, and trade-off analysis between agent complexity and cost
• Experience designing and evaluating agent performance metrics: accuracy, latency, token efficiency, cost per operation, and failure rates; understanding of evaluation frameworks and guardrails
• Knowledge of agent architecture patterns: tool use, RAG (Retrieval-Augmented Generation), function calling, prompt caching, multi-turn conversations, and cost implications of each pattern

Preferred Qualifications:

• Published or open-source contributions in agentic AI, LLM optimization, or cost management for AI systems
• Experience with AWS data services: Databricks, Redshift, Glue, or Lake Formation
• Background in retail, fintech, or e-commerce platforms with high-volume transaction processing
• Knowledge of semantic layers, ontology modeling, or graph databases for enterprise data architecture
• AWS certification (Solutions Architect Professional or DevOps Engineer Professional)
• Experience with prompt engineering, fine-tuning strategies, and model evaluation for cost optimization

Technical Skills Required:

Cloud & Infrastructure:

• AWS (ECS, EKS, Fargate, Lambda, S3, RDS/Aurora, SageMaker, Bedrock, CodePipeline, CloudFormation)
• Docker, Kubernetes, container orchestration
• Infrastructure as Code (Terraform, CloudFormation)

Backend Development:

• Java/J2EE, Spring Framework (Boot, Integration, Cloud, MVC)
• RESTful APIs, microservices, event-driven architecture
• KAFKA, SNS/SQS, asynchronous messaging patterns

AI & Agent Economics:

• Agentic AI frameworks and APIs (Claude API, OpenAI, LangChain, AutoGen, LlamaIndex, custom agents)
• AI productivity tools (Claude Code, Copilot, skills and coordinators)
• LLM cost analysis and optimization: token counting, model pricing comparison, caching strategies, batch processing
• Agent architecture patterns: tool use, RAG, function calling, prompt caching, multi-turn orchestration
• Agent evaluation frameworks and metrics (accuracy, latency, cost-per-transaction, token efficiency)
• Prompt engineering, model fine-tuning, and performance optimization techniques
• Responsible AI governance and ethical guardrails for agent deployments

Databases:

• PostgreSQL, MySQL, AWS Aurora, Redis, Cassandra, Oracle

Education & Certifications:

• Bachelor's degree in Computer Science, Information Technology, or related field (or equivalent professional experience)
• AWS Solutions Architect Professional or equivalent certification (preferred)

Pay:

The wage range for this role takes into account the wide range of factors that are considered in making compensation decisions, including but not limited to skill sets; experience and training; licensure and certifications; and other business and organizational needs. The disclosed range estimate has not been adjusted for the applicable geographic differential associated with the location at which the position may be filled. At Fractal, it is not typical for an individual to be hired at or near the top of the range for their role and compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range is: $145,000 - $215,000. In addition, you may be eligible for a discretionary bonus for the current performance period.

Benefits:

As a full-time employee of the company or as an hourly employee working more than 30 hours per week, you will be eligible to participate in the health, dental, vision, life insurance, and disability plans in accordance with the plan documents, which may be amended from time to time. You will be eligible for benefits on the first day of employment with the Company. In addition, you are eligible to participate in the Company 401(k) Plan after 30 days of employment, in accordance with the applicable plan terms. The Company provides for 11 paid holidays and 12 weeks of Parental Leave. We also follow a “free time” PTO policy, allowing you the flexibility to take the time needed for either sick time or vacation.

Fractal provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.