Skip to content

ML Engineer - Inference & Model Deployment

Hiring CafeCupertino

First seen Jun 5 · open 170 days · posted once$250k–$310k/yr

HirQ verdict

59/100 · Fair. Based on age, reposts, pay, the company's hiring and ghost signals.

Low ghost risk
True age
170 days
Reposts
Posted once

See the evidence behind this score.

Pro shows each part of the score, the reasons, the pay percentile and the listing history.

HirQ's ghost-risk estimate and company labels are automated opinions based on what we observe on employers' public job boards: how long a listing has been open, whether it was re-listed, wording in the description, and how often roles on that board close. They are not statements about an employer's intent, and a high-risk listing can still be a real opening. Figures are as of the date shown. How we measure

At a glance

Pay
$250k–$310k/yr
Level
Mid level
Type
FullTime
Team
Founding Engineer
Work setup
On-site

Hiring Cafe hiring

Company page
SteadyHiring47· WeakHospitality, Food & Travel
Open roles
9
New in 30 days
0
Closed in 30 days
0
Hiring trend, 13 weeksPro
Follow-through: ••%Pro

About the role

From Hiring Cafe's careers page, checked Nov 22

Job discovery is broken. Indeed and LinkedIn want to keep it that way. Join our team and help millions of people put food on the table by finding the perfect job.

HiringCafe.com https://hiringcafe.com is building a 100× better job search engine — fast, comprehensive, honest, and actually useful. We index millions of jobs, remove noise, rank what matters, and help people find real opportunities without dark patterns, ads, or pay-to-win placement.

We are looking for a founding ML engineer who can help us turn powerful AI and ML models into fast, reliable production systems. You will own the bridge between model development and real user-facing infrastructure: deploying models, optimizing inference latency and throughput, scaling serving systems, and making sure our models run efficiently in production.

This is a hands-on engineering role for someone who loves the details of model performance, GPU utilization, inference architecture, and production reliability.

What You’ll Do

  • Deploy and integrate researcher-trained model checkpoints into our cloud infrastructure and production pipelines.
  • Profile and benchmark model performance to identify latency, throughput, memory, and compute bottlenecks.
  • Implement optimization techniques such as quantization, pruning, batching, caching, efficient attention, and precision trade-offs while preserving model quality.
  • Build scalable multi-GPU inference systems for search, ranking, recommendations, agents, and other AI-powered product experiences.
  • Design reliable model-serving architecture that can support millions of users.
  • Develop efficient training and fine-tuning workflows where needed, including distributed training, mixed precision, and parallelism strategies.
  • Work closely with our search & engineering teams to make model deployment a smooth part of our development workflow.

You May Be a Strong Fit If You

  • Have deployed and optimized deep learning models in production environments.
  • Have experience with large-scale model serving, multi-GPU inference, or high-throughput inference systems.
  • Understand inference optimization techniques such as quantization, pruning, compilation, batching, caching, and memory optimization.
  • Have strong instincts for profiling, benchmarking, and debugging model performance.
  • Are familiar with efficient attention mechanisms, transformer optimization, or modern LLM/embedding/ranking model infrastructure.
  • Have worked with inference frameworks or serving stacks such as SGLang, vLLM, TensorRT, or equivelant.
  • Can write clean, production-quality code and integrate ML systems into backend infrastructure.
  • Are comfortable with cloud platforms, distributed systems, storage systems, and modern ML training or serving workflows.
  • Want ownership, leverage, and responsibility from day one.

Logistics

This role is based in Cupertino, where we work in person. We believe the best ideas come from being in the same room.

We offer generous health, dental, and vision coverage, paid parental leave, and relocation support.

Don’t meet every single qualification? That’s okay. We care more about your trajectory than checking every box. If the role excites you and the mission resonates, we’d love to hear from you.

Skills mentioned

  • Machine Learning
  • Distributed Systems
  • Deep Learning
  • LLMs
Apply on Hiring Cafe's siteOpens Hiring Cafe's own application page.

Similar jobs

Same role or field, nearby or remote, ranked by HirQ score.

More at Hiring Cafe

All roles

Keep exploring

ML Engineer - Inference & Model Deployment

$250k–$310k/yr · HirQ 59

Apply