hirq
← All jobs

jobgether

Senior Software Engineer (AI Inference & Runtime Platform)

US · Remote · Full-time · IT

Apply well, not just fast

Create a free account and upload your resume to get a match score, keyword gaps, a tailored resume, a cover letter and interview prep for this job.

About the role

PythonRustKubernetesServerlessDistributed Systems
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer (AI Inference & Runtime Platform) based in the United States. Join a mission-driven engineering team building advanced AI infrastructure to address complex challenges across critical industries, including energy, sustainability, logistics, and climate technology. In this role, you will own the runtime foundations that power AI workloads, from high-performance model inference to secure execution environments for AI-generated code. You will design and operate scalable systems across Kubernetes clusters, GPU infrastructure, and cloud platforms. Working across Rust, Python, distributed systems, and infrastructure automation, you will help deliver reliable, cost-efficient, and secure AI services. This opportunity is ideal for an engineer who has built and operated production-grade inference or serverless GPU platforms and enjoys solving challenging systems problems. You will also contribute to open-source software and help establish engineering standards as the platform evolves.