Senior Software Engineer, AI

Sr. Software Engineer, AI

Location: Brooklyn, NY (Hybrid) Experience: 5+ years in ML/AI Engineering

About the Role

We're looking for a Sr. Software Engineer, AI to own the machine learning and AI efforts across our platform. You'll work directly with our CTO to define and build AI-powered features that will shape Agent North, our customer-facing AI assistant, as well as drive advancements in cost and usage forecasting, financial modeling, and multi-service provider rightsizing.

This is a hands-on, senior-level role, perfect for someone who thrives in a fast-moving startup environment, has built ML-powered products before, and is comfortable taking a project from 0 to 1. If you're a high-energy, motivated engineer passionate about LLMs, cloud infrastructure, and deploying AI systems at scale, we'd love to hear from you.

What You'll Do

• Design, build, and deploy ML models for cloud automation and optimization.
• Work with LLMs, fine-tuning, optimizing, and integrating them into our platform.
• Develop AI chatbots and customer-facing AI solutions to automate and enhance cloud finance management.
• Ensure security and compliance in AI model deployment, implementing best practices for secure AI infrastructure.
• Set up and maintain ML infrastructure across GCP, AWS, and Azure, optimizing for scale and efficiency.
• Drive ML project development from 0 to 1, making key decisions on architecture, tooling, and implementation.
• Collaborate with engineering, product, and leadership teams to align AI development with business goals.
• Experiment with and implement cutting-edge ML techniques, including prompt engineering, model security, continuous evaluation, and monitoring frameworks.
• Provide thought leadership, driving AI strategy and identifying opportunities to improve and expand North's AI capabilities.

What We're Looking For

• 5+ years of hands-on experience in ML, AI model development, and infrastructure deployment.
• Experience deploying ML models at scale on AWS (cloud-based, distributed systems, or edge deployments).
• Strong programming skills in Python and SQL, with demonstrated ability to write production-quality code.
• Proficiency with ML frameworks and the judgment to determine when and where to apply them based on data complexity.
• Ability to move fast and iterate, taking ideas from concept to production.
• Comfortable with Git.
• Excellent communication skills, with the ability to clearly convey progress, methodology, solution approach, and results.
• Strong analytical background, capable of sifting through complex cost patterns and making sense of intricate financial cloud modeling.

Nice to Have

• Experience working in a startup.
• Experience working with financial cloud data across GCP, AWS, or Azure, or complex large financial and logging datasets.
• Experience deploying models in Amazon Bedrock or on AWS.
• Experience deploying infrastructure with Terraform.
• AWS technical certification (or equivalent cloud certification).

Work Setup

Hybrid role based in New York City, with an office in Dumbo, Brooklyn.

Benefits

• Unlimited PTO
• 16 weeks of paid parental leave (birthing parents receive an additional 4 weeks at 50% pay)
• Two company-wide breaks per year: one around Labor Day and one at the end of the year
• Aetna Medical PPO plan with the majority of the premium covered by North
• Dental and vision insurance
• Flexible spending account (FSA) for health expenses and commuter benefits
• 30 day sabbatical every 4 years

Compensation

$230,000 – $270,000 base salary, depending on experience Equity included

If you're a ML engineer who loves building AI-powered products, deploying at scale, and shaping the future of cloud financial automation, we'd love to hear from you.

If you're a ML engineer who loves building AI-powered products, deploying at scale, and shaping the future of cloud financial automation, we'd love to hear from you.