Skip to content

GPU Kernel Engineer

SciforiumSan Francisco, CA

First listed Aug 6 · open 106 days · reposted 2×$190k–$250k/yr

HirQ verdict

69/100 · Strong. Based on age, reposts, pay, the company's hiring and ghost signals.

Low ghost risk
True age
106 days
Reposts
Reposted 2×

See the evidence behind this score.

Pro shows each part of the score, the reasons, the pay percentile and the listing history.

HirQ's ghost-risk estimate and company labels are automated opinions based on what we observe on employers' public job boards: how long a listing has been open, whether it was re-listed, wording in the description, and how often roles on that board close. They are not statements about an employer's intent, and a high-risk listing can still be a real opening. Figures are as of the date shown. How we measure

At a glance

Pay
$190k–$250k/yr
Level
Mid level
Experience
5+ years
Type
FullTime
Team
Engineering
Work setup
On-site

Pay vs market

Employer-posted ranges for Software Engineering roles in CA in the last 12 months (6,482 postings).

$174k
25th pct/yr
$210k
Median/yr
$253k
75th pct/yr
$140k · 10th90th · $300k

This job: $190k–$250k/yr

Where this pay sits: ••th percentilePro

Sciforium hiring

Company page
Actively hiringHiring56· FairAI & Machine Learning
Open roles
15
New in 30 days
5
Closed in 30 days
4
Hiring trend, 13 weeksPro
Follow-through: ••%Pro

About the role

From Sciforium's careers page, checked Nov 21

Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.

ABOUT THE ROLE

We are seeking a highly skilled GPU Kernel Engineer who is passionate about pushing the limits of performance on modern accelerators. In this role, you will design and optimize custom GPU kernels that power next-generation large-scale AI systems. You will work across the hardware–software stack, from low-level kernel development to integrating optimized ops into high-level ML frameworks used for large-scale training and inference.

This role is ideal for someone who thrives at the intersection of GPU programming, systems engineering, and cutting-edge AI workloads, and who wants to make meaningful contributions to the efficiency and scalability of our ML platform.

KEY RESPONSIBILITIES

  • Design, implement, and optimize custom GPU kernels using C++, PTX, CUDA, ROCm, Triton, and/or JAX Pallas.
  • Profile and optimize end-to-end performance of ML operations, with a focus on large-scale LLM training and inference.
  • Integrate low-level GPU kernels into frameworks such as PyTorch, JAX, and custom internal runtimes.
  • Develop performance models, identify bottlenecks, and deliver kernel-level improvements that significantly accelerate AI workloads.
  • Collaborate with ML researchers, distributed systems engineers, and model-serving teams to optimize compute performance across the stack.
  • Work closely with hardware vendors (NVIDIA/AMD) and stay current on the latest GPU architecture capabilities and compiler/toolchain improvements.
  • Contribute to tooling, documentation, benchmarking suites, and testing frameworks to ensure correctness and performance reproducibility.

MUST-HAVES

  • 5+ years of industry or research experience in GPU kernel development or high-performance computing.
  • Bachelor’s, Master’s, or PhD in Computer Science, Computer Engineering, Electrical Engineering, Applied Mathematics, or a related field.
  • Strong programming skills in C++, Python, and familiarity with ML frameworks.
  • Deep expertise in CUDA/ROCm, GPU memory models, and performance optimization strategies.
  • Hands-on experience with Triton and/or JAX Pallas for custom kernel development.
  • Strong understanding of PTX, GPU ASM, and low-level GPU execution.
  • Extensive experience writing and optimizing custom GPU kernels in C++ and PTX.
  • Proven ability to integrate low-level kernels into PyTorch, JAX, or similar frameworks.
  • Experience working with large-scale LLM workloads (training or inference).

NICE-TO-HAVES

  • Experience with AMD GPUs and ROCm optimization.
  • Familiarity with JAX FFI and custom ML operator development.
  • Experience with efficient model serving frameworks (e.g., vLLM, TensorRT).
  • Experience with TPUs, XLA, or similar accelerator programming environments.
  • Contributions to open-source ML systems, compilers, or GPU kernels.

BENEFITS INCLUDE

  • Medical, dental, and vision insurance
  • 401k plan
  • Daily lunch, snacks, and beverages
  • Flexible time off
  • Competitive salary and equity

EQUAL OPPORTUNITY

Sciforium is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Skills mentioned

  • Machine Learning
  • C++
  • LLMs
  • PyTorch
  • Python
  • Distributed Systems
  • Electrical Engineering
Apply on Sciforium's siteOpens Sciforium's own application page.

Similar jobs

Same role or field, nearby or remote, ranked by HirQ score.

More at Sciforium

All roles

Keep exploring

GPU Kernel Engineer

$190k–$250k/yr · HirQ 69

Apply