Skip to content

Runtime Engineer

NormalComputingMountain View, CA

First seen Oct 20 · open 32 days · posted once$200k–$300k/yr

HirQ verdict

71/100 · Strong. Based on age, reposts, pay, the company's hiring and ghost signals.

Low ghost risk
True age
32 days
Reposts
Posted once

See the evidence behind this score.

Pro shows each part of the score, the reasons, the pay percentile and the listing history.

HirQ's ghost-risk estimate and company labels are automated opinions based on what we observe on employers' public job boards: how long a listing has been open, whether it was re-listed, wording in the description, and how often roles on that board close. They are not statements about an employer's intent, and a high-risk listing can still be a real opening. Figures are as of the date shown. How we measure

At a glance

Pay
$200k–$300k/yr
Level
Mid level
Type
FullTime
Team
Software
Work setup
On-site

Pay vs market

Employer-posted ranges for Software Engineering roles in CA in the last 12 months (6,482 postings).

$174k
25th pct/yr
$210k
Median/yr
$253k
75th pct/yr
$140k · 10th90th · $300k

This job: $200k–$300k/yr

Where this pay sits: ••th percentilePro

NormalComputing hiring

Company page
Actively hiringHiring61· FairAI & Machine Learning
Open roles
38
New in 30 days
7
Closed in 30 days
6
Hiring trend, 13 weeksPro
Follow-through: ••%Pro

About the role

From NormalComputing's careers page, checked Nov 21

NORMAL COMPUTING | BUILD WITH US

Normal Computing is building a new paradigm of AI hardware to power human progress. We build inference servers and rack-scale systems designed to increase efficiency and interactivity. We use AI to accelerate silicon co-design and product development.

Our primary offices are in New York City, London, and Mountain View.

THE ROLE

Normal's hardware runs the most memory-bound parts of large-model inference inside memory itself, rather than shuttling weights to a processor. The software that makes this programmable doesn't exist yet in any standard form. The runtime is the layer the rest of that software runs through: it is how compiled programs get loaded, scheduled, and executed on our hardware. You will own its design and much of its implementation, and set its technical direction.

This is a senior, hands-on role. Our chip is pre-silicon, so you will build the runtime against our simulators and FPGA prototypes first, behind one interface, so that software above the runtime doesn't change when silicon arrives.

WHAT YOU WILL OWN

  • Runtime Architecture: Own the design of the runtime: device management, memory allocation and host-device transfer, executable loading, and command submission. Success means the compiler and serving layers program our hardware through one stable interface.
  • Hardware Abstraction: Hide the differences between simulators, FPGA prototypes, silicon, and later hardware generations behind that interface.
  • Device State: Manage the state that lives on our hardware between requests, such as resident model weights, so the serving layer can rely on it.
  • Performance: Keep runtime overhead off the critical path for LLM inference, measured by end-to-end latency and throughput.
  • Cross-Team Interfaces: Define the boundary with the compiler above the runtime, and with the driver and firmware below it, which our hardware team owns.
  • Technical Leadership: Set the runtime's technical direction, review designs that depend on it, and work with compiler and serving engineers so the interface serves them.

WHAT MAKES YOU A GREAT FIT

  • Experience building runtimes, drivers, or hardware abstraction layers for accelerators or other non-standard hardware
  • Strong systems programming in C++ or Rust: memory management, concurrency, and low-level performance
  • Track record of owning a complex systems component end to end, from design through production, and driving technical decisions across teams
  • Understanding of LLM inference workloads and what they demand of a runtime
  • Comfort building software for hardware that is still evolving, from simulation through bring-up

BONUS POINTS

  • Experience with open runtime designs such as IREE's HAL, or with CUDA or ROCm runtime internals
  • Experience with in-memory compute or other non-von-Neumann hardware
  • Experience integrating a runtime with an inference server such as vLLM
  • Contributions to open-source runtime or systems infrastructure

Equal Employment Opportunity Statement

Normal Computing is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other legally protected status.

Accessibility Accommodations

Normal Computing is committed to providing reasonable accommodations to individuals with disabilities. If you need assistance or an accommodation due to a disability, please let us know at [email protected].

Privacy Notice

By submitting your application, you agree that Normal Computing may collect, use, and store your personal information for employment-related purposes in accordance with our Applicant Privacy Notice https://normalcomputing.com/applicant-privacy-notice.

Skills mentioned

  • LLMs
  • Rust
  • C++
  • Accessibility
  • Embedded Systems
  • Leadership
Apply on NormalComputing's siteOpens NormalComputing's own application page.

Similar jobs

Same role or field, nearby or remote, ranked by HirQ score.

More at NormalComputing

All roles

Keep exploring

Runtime Engineer

$200k–$300k/yr · HirQ 71

Apply