Skip to content

Member of Technical Staff — Performance

RadixArkPalo Alto, CA

First seen May 17 · open 187 days · posted once$200k–$400k/yr

HirQ verdict

54/100 · Fair. Based on age, reposts, pay, the company's hiring and ghost signals.

Medium ghost risk
True age
187 days
Reposts
Posted once

See the evidence behind this score.

Pro shows each part of the score, the reasons, the pay percentile and the listing history.

HirQ's ghost-risk estimate and company labels are automated opinions based on what we observe on employers' public job boards: how long a listing has been open, whether it was re-listed, wording in the description, and how often roles on that board close. They are not statements about an employer's intent, and a high-risk listing can still be a real opening. Figures are as of the date shown. How we measure

At a glance

Pay
$200k–$400k/yr
Level
Lead
Team
Member of Technical Staff
Work setup
On-site

Pay vs market

Employer-posted ranges for Member of Technical Staff roles in CA in the last 12 months (74 postings).

$201k
25th pct/yr
$235k
Median/yr
$284k
75th pct/yr
$175k · 10th90th · $307k

This job: $200k–$400k/yr

Where this pay sits: ••th percentilePro

RadixArk hiring

Company page
FrozenHiring45· WeakAI & Machine Learning
Open roles
20
New in 30 days
0
Closed in 30 days
0
Hiring trend, 13 weeksPro
Follow-through: ••%Pro

About the role

From RadixArk's careers page, checked Oct 7

About the Role

RadixArk is hiring a Member of Technical Staff — Performance in Palo Alto, CA — someone who can push LLM inference and training systems to the limit across real production workloads.

You’ll work on the performance-critical path of SGLang, Miles, and the RadixArk infrastructure stack: latency, throughput, GPU utilization, memory efficiency, scheduling, batching, kernel behavior, distributed execution, and cost-per-token. This is not a generic benchmarking role. You’ll be working on the systems that determine whether frontier-scale AI workloads are actually usable, affordable, and reliable in production.

Our customers care about real numbers: P99 latency, TTFT, tokens/sec/GPU, throughput under long-context workloads, cost-per-million tokens, RL rollout efficiency, and training-inference consistency. You’ll help us measure, debug, and improve these systems across NVIDIA, AMD, Google TPU, and cloud partner environments.

This role is for someone who loves performance debugging, understands that small systems details can create massive product impact, and wants to work at the frontier of AI infrastructure.

What You'll Do

  • Analyze and improve performance across SGLang, Miles, and RadixArk production deployments
  • Benchmark LLM inference and training workloads across GPUs, TPUs, and cloud environments
  • Optimize latency, throughput, memory usage, batching, scheduling, routing, and GPU utilization
  • Investigate performance regressions in real customer environments
  • Work closely with kernel, runtime, distributed systems, and product engineers
  • Build internal tooling for profiling, tracing, benchmarking, and regression detection
  • Translate customer workload characteristics into concrete performance tuning strategies
  • Help define performance metrics that matter commercially, including cost-per-token and serving efficiency
  • Partner with customers and cloud partners on deep technical evaluations
  • Contribute performance insights back to open-source SGLang and Miles

What We're Looking For

  • Strong systems engineering background, especially in performance-critical software
  • Experience with GPU systems, distributed systems, inference serving, ML runtimes, or high-performance computing
  • Familiarity with profiling tools, performance debugging, tracing, and benchmark methodology
  • Comfort working with Python and C++
  • Experience with CUDA, Triton, Pallas, ROCm, XLA, or kernel-level optimization is a strong plus
  • Understanding of LLM inference concepts such as batching, KV cache, prefill/decode, speculative decoding, MoE, long context, and P99 latency
  • Ability to debug messy real-world performance issues across software, hardware, and infrastructure layers
  • Strong communication skills — you should be able to explain performance tradeoffs to both engineers and customers
  • Prior experience with production AI infrastructure, cloud GPU environments, or open-source ML systems is a plus

About RadixArk

RadixArk is an infrastructure-first company built by engineers who've shipped production AI systems, created SGLang (30K+ GitHub stars, the fastest open LLM serving engine), and developed Miles (our large-scale RL framework). Founded by AI infrastructure veterans from xAI and NVIDIA, we're on a mission to democratize frontier-level AI infrastructure by building world-class open systems for inference and training. Our team has optimized kernels serving billions of tokens daily, designed distributed training systems coordinating 10,000+ GPUs, and contributed to infrastructure that powers leading AI companies and research labs.

Compensation

Depending on background, skills, and experience, the expected annual salary range for this position is $200,000 - $400,000 USD + equity.

Equal Opportunity

RadixArk is an Equal Opportunity Employer and is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and more.

Skills mentioned

  • LLMs
  • Distributed Systems
  • Machine Learning
  • Python
  • C++
Apply on RadixArk's siteOpens RadixArk's own application page.

Similar jobs

Same role or field, nearby or remote, ranked by HirQ score.

More at RadixArk

All roles

Keep exploring

Member of Technical Staff — Performance

$200k–$400k/yr · HirQ 54

Apply