Sr Engineer (Backend)

We are looking for a mid to senior level API Platform Engineer.

In this role, youll architect and scale the foundation that powers delightful developer experiences and production-grade AI systems. You'll work at the intersection of high-performance APIs, scalable infrastructure, and cutting-edge machine learningdelivering tools that enable developers and partners to build on top of Menlos intelligent platform.

Responsibilities

• Design and build the Menlo API Platform, focusing on high reliability, performance, and a world-class developer experience
• Develop intuitive APIs and SDKs that make it easy for developers to access and integrate multimodal AI capabilities
• Deploy and optimize AI/ML models into scalable, production environments, working closely with research and applied ML teams
• Manage and evolve a modern, cloud-native infrastructure stack, using Kubernetes, Docker, and infrastructure-as-code (IaC) tools
• Ensure platform reliability, including designing and implementing telemetry, monitoring, alerting, autoscaling, failover, and disaster recovery mechanisms
• Contribute to developer and operations workflows, including CI/CD pipelines, release management, and on-call rotations
• Collaborate across teams to implement secure APIs with fine-grained access control, usage metering, and billing integration
• Continuously improve platform performance, cost-efficiency, and observability as we scale to serve millions of users worldwide

Requirements

• 3+ years of experience building and operating large-scale, production systems with real-world usage and uptime expectations
• Strong experience with containerization and orchestration: Kubernetes, Docker, Helm, and service mesh technologies (e.g., Istio or Linkerd)
• Proficiency with cloud platforms: AWS, GCP, or Azure including experience with IAM, networking, and serverless tooling
• Hands-on coding skills in Python and JavaScript/TypeScript, with familiarity in backend frameworks (e.g., FastAPI, Express)
• Deep knowledge of API architecture and design patterns: WebRTC/Websockets, REST, gRPC, OpenAPI/Swagger, authentication (OAuth2, API keys), and versioning
• Experience with databases: PostgreSQL, Redis, and modern vector databases (e.g., Pinecone, Weaviate, FAISS)
• Familiarity with CI/CD pipelines, GitOps practices, and tools like GitHub Actions, Argo CD, or Jenkins
• Comfortable with monitoring and observability tools such as Prometheus, Grafana, Datadog, or OpenTelemetry

Bonus Experience

• Experience with MLOps tools and AI workflows: model versioning, inference pipelines, model registries, etc.
• Understanding of access control systems: ACLs, RBAC, multi-tenant security and isolation
• Knowledge of billing systems, rate limiting, chargeback models, quota enforcement, and usage metering
• Prior experience working on developer platforms or API products with a strong focus on UX and documentation

Originally posted on Himalayas