Skip to content

Compiler Backend Engineer

NormalComputingMountain View, CA

First seen Oct 20 · open 32 days · posted once$200k–$300k/yr

HirQ verdict

71/100 · Strong. Based on age, reposts, pay, the company's hiring and ghost signals.

Low ghost risk
True age
32 days
Reposts
Posted once

See the evidence behind this score.

Pro shows each part of the score, the reasons, the pay percentile and the listing history.

HirQ's ghost-risk estimate and company labels are automated opinions based on what we observe on employers' public job boards: how long a listing has been open, whether it was re-listed, wording in the description, and how often roles on that board close. They are not statements about an employer's intent, and a high-risk listing can still be a real opening. Figures are as of the date shown. How we measure

At a glance

Pay
$200k–$300k/yr
Level
Mid level
Type
FullTime
Team
Software
Work setup
On-site

Pay vs market

Employer-posted ranges for Software Engineering roles in CA in the last 12 months (6,482 postings).

$174k
25th pct/yr
$210k
Median/yr
$253k
75th pct/yr
$140k · 10th90th · $300k

This job: $200k–$300k/yr

Where this pay sits: ••th percentilePro

NormalComputing hiring

Company page
Actively hiringHiring61· FairAI & Machine Learning
Open roles
38
New in 30 days
7
Closed in 30 days
6
Hiring trend, 13 weeksPro
Follow-through: ••%Pro

About the role

From NormalComputing's careers page, checked Nov 21

NORMAL COMPUTING | BUILD WITH US

Normal Computing is building a new paradigm of AI hardware to power human progress. We build inference servers and rack-scale systems designed to increase efficiency and interactivity. We use AI to accelerate silicon co-design and product development.

Our primary offices are in New York City, London, and Mountain View.

THE ROLE

Normal's hardware runs the most memory-bound parts of large-model inference inside memory itself, rather than shuttling weights to a processor. The software that makes this programmable doesn't exist yet in any standard form. Getting a model correct on that hardware is the frontend's job; making it fast is yours. Our hardware does not look like a CPU or GPU, so its compiler backend can't be borrowed from one. As a Compiler Engineer focused on the backend, you will help design and build the custom compilation that maps LLM inference onto it, from scheduling and memory planning to the code our hardware actually executes.

You will work at the boundary between the compiler and the hardware, closely enough to know when an optimization belongs at a different layer, or when the right answer is a new abstraction. Our chip is pre-silicon, so you will measure your work against our simulators and FPGA prototypes first, and against silicon as it arrives.

WHAT YOU WILL OWN

  • Code Generation: Build the passes that turn lowered programs into the code our hardware executes, designing new compilation approaches where conventional ones don't fit. Success means correct, efficient code for every operation our models need.
  • Scheduling and Memory Planning: Own how work and data are scheduled and placed across our hardware's resources, measured by utilization and end-to-end latency on LLM inference.
  • Fusion and Dispatch: Own fusion and dispatch decisions for LLM inference, so the hardware spends its time computing rather than moving data.
  • Hardware Co-Design: Work the abstraction layer between the compiler and the hardware, and feed compiler constraints back to our hardware architects while the design can still change.
  • Profiling and Validation: Validate every optimization with measured results from simulators, FPGA prototypes, and then silicon, and maintain a performance regression suite the team trusts.
  • Cross-Team Handoffs: Take lowered programs from our frontend compiler engineers, and decide with the team which operations the compiler generates and which use hand-tuned kernels.

WHAT MAKES YOU A GREAT FIT

  • Deep experience with compiler optimization or code generation for accelerators or other non-CPU targets: scheduling, tiling, fusion, or resource allocation
  • Comfort working close to hardware: you think in terms of memory bandwidth and utilization as well as asymptotic complexity
  • Willingness to design compilation approaches from first principles when existing ones don't fit the hardware
  • Track record of shipping optimizations that moved a measured performance number
  • Comfort building software for hardware that is still evolving, from simulation through bring-up
  • Fluency in Python, and familiarity with C, C++, or Rust

BONUS POINTS

  • Experience with PyTorch's compilation stack (TorchDynamo, FX, Inductor, torch.export) or other ML compilers, such as IREE, TVM, or XLA
  • Experience compiling for in-memory, spatial, or other non-von-Neumann compute targets
  • Background in hardware design tools such as logic synthesis or place-and-route
  • Experience building or using cycle-level or performance simulators to guide optimization decisions
  • Contributions to open-source compiler or kernel infrastructure (e.g., PyTorch, Triton, TVM, MLIR, LLVM)
  • Publishing or presenting compiler or performance work at venues such as MLSys, ASPLOS, or CGO

Equal Employment Opportunity Statement

Normal Computing is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other legally protected status.

Accessibility Accommodations

Normal Computing is committed to providing reasonable accommodations to individuals with disabilities. If you need assistance or an accommodation due to a disability, please let us know at [email protected].

Privacy Notice

By submitting your application, you agree that Normal Computing may collect, use, and store your personal information for employment-related purposes in accordance with our Applicant Privacy Notice https://normalcomputing.com/applicant-privacy-notice.

Skills mentioned

  • LLMs
  • PyTorch
  • Python
  • Rust
  • C++
  • C
  • Machine Learning
  • Accessibility
Apply on NormalComputing's siteOpens NormalComputing's own application page.

Similar jobs

Same role or field, nearby or remote, ranked by HirQ score.

More at NormalComputing

All roles

Keep exploring

Compiler Backend Engineer

$200k–$300k/yr · HirQ 71

Apply