Skip to content

AI Inference Infrastructure Software Engineer (Kubernetes / Cloud)

ElastixAI INC.Seattle, WAHybrid

First seen May 4 · open 200 days · posted onceNo pay listed

HirQ verdict

44/100 · Weak. Based on age, reposts, pay, the company's hiring and ghost signals.

Medium ghost risk
True age
200 days
Reposts
Posted once

See the evidence behind this score.

Pro shows each part of the score, the reasons, the pay percentile and the listing history.

HirQ's ghost-risk estimate and company labels are automated opinions based on what we observe on employers' public job boards: how long a listing has been open, whether it was re-listed, wording in the description, and how often roles on that board close. They are not statements about an employer's intent, and a high-risk listing can still be a real opening. Figures are as of the date shown. How we measure

At a glance

Pay
No pay listed
Level
Mid level
Experience
3+ years
Type
FullTime
Team
Engineering
Work setup
Hybrid

“Location: Seattle, WA (Hybrid - 3 days/week in office)”

Pay vs market

Employer-posted ranges for Software Engineering roles in WA in the last 12 months (785 postings).

$150k
25th pct/yr
$190k
Median/yr
$222k
75th pct/yr
$130k · 10th90th · $258k

This job: No pay listed

ElastixAI INC. hiring

Company page
FrozenHiring41· WeakAI & Machine Learning
Open roles
6
New in 30 days
0
Closed in 30 days
0
Hiring trend, 13 weeksPro
Follow-through: ••%Pro

About the role

From ElastixAI INC.'s careers page, checked Nov 21

Location: Seattle, WA (Hybrid - 3 days/week in office)

About ElastixAI

ElastixAI is an early-stage Software startup on a mission to reinvent AI inference infrastructure from the ground up. We're building a next-generation inference platform that delivers unprecedented efficiency by tightly integrating machine learning, software stack, and custom hardware. Our philosophy is simple: the best performance comes from holistic co-design, where every layer, from model architecture to kernels to silicon, works in harmony.

If you're excited about pushing AI performance to physical limits and shaping the future of large-scale inference, we'd love to meet you.

Role Summary

We're looking for an Inference Infrastructure Software Engineer to own and evolve the cloud and Kubernetes backbone behind our Token-as-a-Service platform. You'll be the connective tissue between our inference engine and the production environments where customers actually consume tokens — making sure our accelerated workloads run reliably, scale predictably, and deploy seamlessly across managed and self-hosted clusters.

This is a hands-on role with broad surface area. You'll touch everything from cluster bring-up, automating the software releases, and AI Accelerator scheduling to service reliability and cost optimization, working closely with our ML, runtime, and hardware teams to expose the full performance of our co-designed stack to end users.

Key Responsibilities

  • Build, operate, and evolve ElastixAI's Kubernetes infrastructure powering our Token-as-a-Service capability.
  • Run accelerated inference workloads in production at scale, with strong SLAs around latency, throughput, and availability.
  • Manage and harden our AWS, GCP, and on-prem infrastructure, including networking, storage, IAM, and observability layers tied to our services.
  • Develop tooling and automation in Python, Bash, Rust, and Go to streamline deployments, rollouts, autoscaling, and incident response.
  • Partner with the ML and runtime teams to productionize new inference capabilities, model deployments, and routing strategies.
  • Contribute to capacity planning, cost optimization, and reliability engineering across multi-cloud and self-hosted environments.
  • Help define the platform roadmap as we scale from early customers to broad production deployments.
  • Be a member of the Elastix On-Call rotation

Required Qualifications

  • Minimum BS in Computer Science, Software Engineering, or a related field.
  • 3–5 years of hands-on Kubernetes experience, including EKS, GKE, and/or self-hosted clusters.
  • 2–3 years of production experience operating workloads on AWS or GCP.
  • Proven track record running ML or inference services at scale on Kubernetes in production.
  • Strong experience running accelerated workloads in Kubernetes, scheduling, drivers, device plugins, MIG, networking, and storage considerations.
  • Solid coding skills in Python, Bash and proficiency in Go
  • Proficient in configuring and leveraging Linux OS in production
  • Experience with infrastructure-as-code (Terraform, Pulumi), OS configuration state (Ansible, Puppet, Salt) and GitOps workflows (Argo CD, Flux).
  • Experience in OS configuration tooling.
  • Familiarity with AI inference and/or training workflows and the operational patterns around them.
  • Pragmatic, ownership-oriented mindset; comfortable operating in early-stage ambiguity and shipping iteratively.

Preferred/Bonus Qualifications

  • MS/PhD in Computer Science, Software Engineering, or a related field.
  • Experience with inference servers and runtimes (e.g., Triton, vLLM, TGI) and model-serving patterns (batching, streaming, KV-cache aware routing).
  • Exposure to heterogeneous accelerators beyond GPUs (FPGAs, custom ASICs).
  • Background in observability, SRE, or performance engineering for latency-sensitive services.
  • Experience building customer facing API platforms including onboarding, API keys/auth management, and usage metering.

What We Offer

  • A chance to be a foundational engineer in an innovative AI startup.
  • A dynamic and collaborative work environment and the change to have a significant impact on new technology
  • The opportunity to work on challenging problems at the intersection of ML, software, and systems.
  • Competitive compensation and startup equity package
  • Comprehensive medical, dental, and vision coverage (premiums 100% paid by employer)
  • Flexible Time Off (FTO)
  • Paid parental leave
  • Gym or fitness benefit
  • Commuter benefit
  • Investment in employee learning & development

Skills mentioned

  • Kubernetes
  • Machine Learning
  • Python
  • Bash
  • AWS
  • GCP
  • Observability
  • Go
  • Rust
  • Terraform
  • Ansible
  • Linux
  • SRE
  • IAM
  • Incident Response
Apply on ElastixAI INC.'s siteOpens ElastixAI INC.'s own application page.

Similar jobs

Same role or field, nearby or remote, ranked by HirQ score.

Senior Software Engineer, Cloud Payments

MongoDBAtlanta; Austin; Boston; Chicago; Dallas; Denver; Los Angeles; New York City; Palo Alto; Princeton; San Francisco; Seattle; United States; Washington DC

$126k–$248k/yr2d ago86· Excellent

More at ElastixAI INC.

All roles

Keep exploring

AI Inference Infrastructure Software Engineer (Kubernetes / Cloud)

No pay listed · HirQ 44

Apply