Skip to content

Research Engineer, Benchmarks

CleraSingapore

First listed Oct 3 · open 48 days · reposted 5×$100k–$170k/yr

HirQ verdict

68/100 · Strong. Based on age, reposts, pay, the company's hiring and ghost signals.

Medium ghost risk
True age
48 days
Reposts
Reposted 5×

See the evidence behind this score.

Pro shows each part of the score, the reasons, the pay percentile and the listing history.

HirQ's ghost-risk estimate and company labels are automated opinions based on what we observe on employers' public job boards: how long a listing has been open, whether it was re-listed, wording in the description, and how often roles on that board close. They are not statements about an employer's intent, and a high-risk listing can still be a real opening. Figures are as of the date shown. How we measure

At a glance

Pay
$100k–$170k/yr
Level
Mid level
Type
FullTime
Team
Engineering
Work setup
On-site
Visa
Mentions sponsorship

“Visa sponsorship is available.”

Clera hiring

Company page
Low follow-throughHiring61· FairSoftware & SaaS
Open roles
304
New in 30 days
1,158
Closed in 30 days
1,167
Hiring trend, 13 weeksPro
Follow-through: ••%Pro

About the role

From Clera's careers page, checked Nov 21

ABOUT THE ROLE

Join a small, technical team building benchmarks to evaluate frontier AI agents on realistic, domain-specific workflows. You will own evaluation design and implementation, helping ensure benchmark results are rigorous, credible, and relevant to real-world performance.

WHAT YOU'LL DO

  • Design, implement, and maintain benchmarks for evaluating frontier agents on domain-specific tasks.
  • Work with subject-matter experts to translate real workflows into realistic tasks and evaluation criteria.
  • Build reliable infrastructure for running models and agents against benchmark tasks at scale.
  • Develop metrics and analyses to assess benchmark difficulty, reliability, and failure modes.
  • Validate whether benchmark results correlate with real-world evaluations and user needs.
  • Write clear documentation and reports for technical audiences.

WHAT WE'RE LOOKING FOR

  • Two or more years of experience in research engineering or machine learning engineering, building AI benchmarks, evaluation infrastructure, or agent environments.
  • Technical education or equivalent grounding, with strong first-principles reasoning about task design, scoring, and failure modes.
  • Proficiency in Python, Docker, and Linux, including experience operating infrastructure for AI models or agents.
  • Hands-on experience designing and running evaluations for AI agents or large language models, with relevant, focused experience in benchmarks or evaluation.
  • Experience developing metrics, statistical analyses, or validation studies, and translating workflows across domains into benchmark tasks.
  • Strong technical writing and communication skills. Published papers or technical writing on benchmarking, evaluation, or model failure modes are valued.
  • Experience with reinforcement learning pipelines, data generation, or agent evaluation is a plus.
  • Comfort working independently in an early-stage, fast-paced environment and navigating open-ended problems.

COMPENSATION & BENEFITS

Base salary: $100,000 to $170,000 annually. Visa sponsorship is available.

LOCATION

On-site in Singapore, Singapore.

Skills mentioned

  • Technical Writing
  • Python
  • Docker
  • Linux
  • Machine Learning
  • LLMs
Apply on Clera's siteOpens Clera's own application page.

Similar jobs

Same role or field, nearby or remote, ranked by HirQ score.

More at Clera

All roles

Keep exploring

Research Engineer, Benchmarks

$100k–$170k/yr · HirQ 68

Apply