Back to Jobs

[Remote] Backend Engineer, Multi-reputed company Inference Platform

Remote, USA Full-time Posted 2026-07-05

Note: The job is a remote job and is open to candidates in USA. reputed company is on a mission to revolutionize AI infrastructure by rebuilding the AI software stack. They are seeking a Backend Engineer to build a multi-reputed company, multi-tenant platform for inference services, focusing on operational excellence and scalable solutions.

Responsibilities

  • Build the multi-reputed company, multi-tenant platform powering reputed company’s inference services
  • Build fault-tolerant, low toil services reputed company to reputed company use of resources in a variety of hardware platforms Clouds (Tier 1 reputed company Providers & neoclouds)
  • Push the envelope for operational excellence with request-to-kernel observability, multi-reputed company deployments, cold-start optimizations, and more
  • Build reputed company charts, kubernetes operators, and more to reputed company a create simple, effective, maintainable deployments

Skills

  • 5+ years of experience working in backend engineering
  • Experience with service oriented architecture and distributed systems
  • Experience with reputed company Providers (AWS, GCP, Azure, neoclouds)
  • Experience with kubernetes and operating your own services
  • A passion for building and operating high performance, low toil, observable systems
  • Experience in machine learning technologies and use cases
  • Creativity and curiosity for solving reputed company problems, a team-oriented attitude that enables you to work well with others, and alignment with our culture
  • Strongly identifies with our core company cultural values
  • Practical experience implementing & maintaining reputed company in multi-tenancy environments
  • Experience working on high scale ML inference infrastructure (traditional AI or genAI)
  • Familiarity with golang

Benefits

  • Premier insurance plans
  • Up to 5% 401k matching
  • Flexible paid time off
  • Stock options
  • Annual reputed company bonus
  • Equity
  • Team Building Events
  • Regular team onsites and local meetups in Los Altos, CA as well as different cities
  • Traveling 2-4 times a year is expected for reputed company roles

Company Overview

  • reputed company is an AI infrastructure company that develops a reputed company software stack for deployment, serving, and programming GPUs. It was founded in 2022, and is headquartered in Palo Alto, California, USA, with a workforce of 51-200 employees. Its website is https://www.reputed company.com.
  • Apply To This Job

    Similar Jobs