ML Infrastructure Engineer
Free daily job alerts: new jobs like this one, by email.
We confirm your address first. Every email has a one-click unsubscribe.
See a sample email
Sample email, with real jobs open today
Your new matches
New jobs that fit the role, pay and location you choose.
Top-paying open roles
Pay as posted by the employer.
- Engineering Manager, Hardware Platform SecurityAnthropic, San Francisco, CA$485k–625k/yr
- Chief Information Security OfficerMETR, Berkeley$493k–579k/yr
- Principal, AI Transformation, CyberOde with Anthropic, San Francisco$450k–600k/yr
Cleared roles
Postings that mention a clearance requirement.
- Cyber Operations SpecialistDelta Solutions & Strategies, Schriever SFB, CO$95k–100k/yr
- Sr. SQL Database Administrator I (6893)MetroStar, Washington, DC$138k–184k/yr
- Network EngineerAccenture Federal Services, Reston, VA$89k–170k/yr
Remote
- MLOps / DevOps Engineer – AI InfrastructureCreatorIQ, Remote$121k–155k/yr
- Senior Associate, Third Party Risk ManagementUpstart, Remote$91k–145k/yr
- Service Desk Level 1 Analyst (Mexico)DYOPATH, Remote
Every job links to the employer's own application page.
ML Infrastructure Engineer at zaimler, San Mateo, CA (On-site). Posted Jul 21, 2025, last seen on the employer's hiring page Nov 5, 2026. Mentioned in the posting: Visa sponsorship.
About zaimler AI agents can't reason over data they don't understand. Enterprise data today is fragmented across dozens of systems with no shared context, meaning, or structure, and that's why most enterprise AI is failing. The shift from copilots to autonomous agents is creating an entirely new...
Show full description
About the Role
You'll own our inference and model-serving infrastructure end to end. This isn't a research role. It's a build role: you're setting up and scaling the systems that let our agents actually run in production, fast and reliably, at increasing concurrency.
You report to Sofus and work closely with our ML and infra teams.
What You’ll Own
- Set up and scale inference/Ray Serve for ML and LLM model serving, integrated with our data analysis and agent workflows
- Scale agent GPU infrastructure for concurrency and efficiency across multiple agent workloads
- Optimize and improve the engine builder and model server that power scalable agent orchestration
What You Need
- Proven ability to build scalable ML/AI platforms from scratch, end-to-end, for production use cases. You've owned a zero-to-one build before, or can show you're capable of it
- Deep understanding of the inference stack: vLLM, KV cache, and the optimization layers underneath model serving
- Experience building distributed systems for AI/ML workloads at scale, connecting them to real product or vertical integrations
- 3+ years of relevant experience. We care about capability, not tenure
Nice to Have
- Ray / Ray Serve experience
- Familiarity with AIBrix
Why Join
- A rare chance to shape both company and product direction as an early team engineer
- Work alongside engineers and researchers from LinkedIn, Visa, Meta, and Branch
- Onsite culture in San Mateo, built for deep collaboration and high-velocity building
- Full benefits (medical, dental, vision, 401k)
- We sponsor H-1B visas and assist with immigration
Hiring for this role? Feature it
Source: zaimler on Lever. FortHire is not the employer and doesn't take applications. Report a problem or request removal.