Java Backend Developer

We are looking for an experienced Java Backend Developer with AI integration experience to join a financial services technology team in Toronto. You will design and maintain high-performance backend services while integrating generative AI and large language model capabilities into enterprise workflows.

What You'll Do

• Design, develop, and maintain backend services using Java 17, Spring Boot, and microservices architecture
• Build and expose RESTful and event-driven APIs supporting enterprise scale applications
• Integrate generative AI and large language model capabilities into backend workflows
• Design and optimize prompt templates, prompt pipelines, and prompt orchestration strategies
• Develop retrieval augmented generation services and AI inference orchestration layers
• Implement secure API integrations with AI platforms and internal data sources
• Apply prompt versioning, evaluation, and monitoring techniques to improve AI output quality
• Contribute to CI/CD pipelines, containerization, and cloud-native deployments
• Ensure scalability, resiliency, performance, and observability across backend systems
• Participate in code reviews, architecture discussions, and technical design decisions
• Support production systems and troubleshoot complex backend and AI integration issues

What You Bring

• 5 or more years of hands-on Java backend development experience
• Strong expertise in Java 11 and 17, Spring Boot, Spring MVC, and Spring Security
• Solid experience with microservices, REST APIs, and OpenAPI or Swagger design
• Hands-on experience integrating large language models into backend systems
• Strong understanding of prompt engineering techniques including zero-shot, few-shot, and chain of thought prompting
• Experience building retrieval augmented generation solutions using vector stores and embeddings
• Experience with Docker, Kubernetes, OpenShift, and cloud platforms such as Azure or AWS
• Strong knowledge of SQL and NoSQL databases including DB2, PostgreSQL, and MongoDB
• Experience implementing OAuth 2.0, JWT, and secure API patterns
• Awareness of data privacy, PII handling, and AI governance in regulated environments

Nice to have

• Familiarity with AI orchestration frameworks or SDKs
• Experience in banking or financial services environments
• Background in prompt evaluation for quality, bias, and consistency

Work setup

• 6 to 12 month contract based in Toronto, ON
• Hybrid with 4 days onsite per week