Skip to content

RL Environments Engineer

Bespoke LabsMountain View, CA

First seen Aug 27 · open 85 days · posted once$250k–$300k/yr

HirQ verdict

63/100 · Fair. Based on age, reposts, pay, the company's hiring and ghost signals.

Low ghost risk
True age
85 days
Reposts
Posted once

See the evidence behind this score.

Pro shows each part of the score, the reasons, the pay percentile and the listing history.

HirQ's ghost-risk estimate and company labels are automated opinions based on what we observe on employers' public job boards: how long a listing has been open, whether it was re-listed, wording in the description, and how often roles on that board close. They are not statements about an employer's intent, and a high-risk listing can still be a real opening. Figures are as of the date shown. How we measure

At a glance

Pay
$250k–$300k/yr
Level
Mid level
Type
FullTime
Team
RL Environments
Work setup
On-site

Pay vs market

Employer-posted ranges for Software Engineering roles in CA in the last 12 months (6,482 postings).

$174k
25th pct/yr
$210k
Median/yr
$253k
75th pct/yr
$140k · 10th90th · $300k

This job: $250k–$300k/yr

Where this pay sits: ••th percentilePro

Bespoke Labs hiring

Company page
SteadyHiring52· FairAI & Machine Learning
Open roles
4
New in 30 days
0
Closed in 30 days
0
Hiring trend, 13 weeksPro
Follow-through: ••%Pro

About the role

From Bespoke Labs's careers page, checked Nov 21

ABOUT BESPOKE LABS

Bespoke Labs is an applied AI research lab pioneering data and RL environment curation for training and evaluating agents.

Recently, we curated Open Thoughts https://open-thoughts.ai/, one of the best open reasoning datasets used by multiple frontier labs, trained SOTA specialized models such as Bespoke-MiniChart-7B https://www.bespokelabs.ai/blog/bespoke-minichart-7b and Bespoke-MiniCheck https://www.bespokelabs.ai/bespoke-minicheck, and taught https://www.bespokelabs.ai/blog/improving-multi-turn-tool-use-with-reinforcement-learning agents to do multi-turn tool-calling with reinforcement learning.

Bespoke is uniquely positioned to capture a large market share of data and RL environment curation.

About the Role
This is a delivery role. We want an engineer who has built the machinery that turns environment ideas into hundreds or thousands of validated agentic coding tasks, and who can do it here, fast.

You will not be studying environments in the abstract. You will build the pipelines that mass-produce them, design the complex coding worlds agents train inside, and keep pushing throughput: more environments, higher quality, less manual work per task. We will measure you on the volume and quality of environments you ship, not on papers.

The thing we care about most is whether you have done this before. If you have stood up an environment-generation pipeline, scaled agentic task creation into the hundreds or thousands, and shipped it, we want to talk.

WHAT YOU'LL DO

  • Build environment-generation pipelines. Own the systems that produce RL environments programmatically, including templating, automated grading, verification, and QA, so the team ships environments at scale instead of one at a time.
  • Create complex coding worlds. Build high-fidelity environments around real codebases, with the conventions, dependencies, tooling, and technical debt that real software actually has.
  • Scale agentic task creation to thousands. Take task generation from handfuls to hundreds and thousands of validated agentic coding tasks, with automation doing the heavy lifting.
  • Build tools that raise throughput. Find the bottlenecks in environment production and remove them. Build the internal tooling and infrastructure that makes everyone on the team faster.
  • Own the full task lifecycle. Prompt, environment, grader, running frontier models against the task, failure analysis, and iteration, until each task is rigorous, fair, and hard to game.
  • Defend quality at scale. Catch reward hacking and grader loopholes, and build the verification and standards that hold the bar as volume grows.
  • Direct coding agents heavily. Use frontier coding agents to build and validate environments faster, judging their output and catching the subtle failures.

Direct frontier coding agents heavily to build and validate environments, judging their output and catching the quiet failures they produce.

WHAT WE'RE LOOKING FOR

A record of shipped volume. You have built agentic coding tasks or environments and can show us how many you personally drove and what they cost to produce.

Experience scaling that output through automation rather than through more people doing more manual work.

Strong software engineering fundamentals and fluency in several languages that holds up in production code.

Real experience with production software. Large codebases, build systems, testing, deployment, on-call, and root cause analysis. You know what real engineering work feels like because you have done it.

An adversarial mindset. You look at a grader and ask how a model would cheat it, and then you fix that.

A clear sense of what frontier coding agents can and cannot do, and where they cut corners.

Ownership. You build, debug, and ship without much supervision.

YOU MAY BE A GOOD FIT IF YOU ALSO

  • Have worked on RL training systems, post-training, verifiers, or tool-use harnesses
  • Come from developer tooling, CI/CD, sandboxes, or code execution infrastructure
  • Have built large-scale automated test generation, fuzzing harnesses, or benchmark suites, which is close cousin work even if it was never called an RL environment
  • Have contributed to a public agentic benchmark such as Terminal-Bench
  • Have open-source work that other people depend on

WHAT WE OFFER

  • Location: Mountain View, CA or San Francisco, CA (Onsite)
  • Base Salary: $250,000 – $300,000 USD / year
  • Additional Comp: 25% performance-based bonus + equity

Benefits & Perks

  • Health, dental, and vision coverage
  • 401(k)
  • Daily onsite lunch provided
  • Visa sponsorship and relocation support available
  • Direct impact on how the industry trains and evaluates agents

We value different backgrounds and paths into this work. If this role excites you but you do not check every box, apply anyway.

Skills mentioned

  • CI/CD
  • Quality Assurance
Apply on Bespoke Labs's siteOpens Bespoke Labs's own application page.

Similar jobs

Same role or field, nearby or remote, ranked by HirQ score.

More at Bespoke Labs

All roles

Keep exploring

RL Environments Engineer

$250k–$300k/yr · HirQ 63

Apply