Skip to content

Multilingual Audio Evaluator

Anyone AiRemote

First seen Oct 12 · open 40 days · posted onceNo pay listed

HirQ verdict

49/100 · Weak. Based on age, reposts, pay, the company's hiring and ghost signals.

Medium ghost risk
True age
40 days
Reposts
Posted once

See the evidence behind this score.

Pro shows each part of the score, the reasons, the pay percentile and the listing history.

HirQ's ghost-risk estimate and company labels are automated opinions based on what we observe on employers' public job boards: how long a listing has been open, whether it was re-listed, wording in the description, and how often roles on that board close. They are not statements about an employer's intent, and a high-risk listing can still be a real opening. Figures are as of the date shown. How we measure

At a glance

Pay
No pay listed
Level
Mid level
Type
FullTime
Team
AI Training
Work setup
Remote

“Argentina - Fully Remote”

Anyone Ai hiring

Company page
Low follow-throughHiring43· WeakAI & Machine Learning
Open roles
227
New in 30 days
24
Closed in 30 days
10
Hiring trend, 13 weeksPro
Follow-through: ••%Pro

About the role

From Anyone Ai's careers page, checked Nov 22

Help shape the future of AI by evaluating how conversational AI agents communicate and perform across different languages.

  • Location: Remote / Global, subject to project location restrictions
  • Type: Independent contractor / Project-based
  • Commitment: To be confirmed
  • Compensation: To be confirmed
  • Project duration: 2–3 months

ABOUT THE ROLE

At Anyone AI, we create high-quality training and evaluation data for frontier AI models.

We’re looking for multilingual audio evaluators with strong spoken-language proficiency and technical literacy to assess conversational AI agents.

In this role, you’ll participate in live, real-time roleplay scenarios, capture session recordings and technical logs, label conversation transcripts, and evaluate interactions using structured rubrics. Your feedback will help improve the quality and reliability of AI conversations across languages.

WHAT YOU’LL DO

  • Prepare and confirm the required tools and access before each live session.
  • Conduct live, real-time roleplay scenarios with conversational AI agents.
  • Capture recordings, session IDs, and tool-call or console logs.
  • Label conversation transcripts according to project guidelines.
  • Score interactions against structured evaluation rubrics.
  • Provide clear written explanations supporting your scores.
  • Read, validate, and troubleshoot JSON, identifying structural and formatting issues.

WHAT WE’RE LOOKING FOR

  • C1/C2 spoken fluency in at least one of the target languages listed below.
  • Ability to demonstrate language proficiency through a speaking and listening assessment.
  • Strong JSON skills, including reading, validation, troubleshooting, and identifying structural or formatting errors.
  • Comfort using digital tools and collecting recordings and technical logs.
  • Strong attention to detail and the ability to follow evaluation guidelines consistently.
  • Clear written communication and sound judgment when assessing AI interactions.

LANGUAGES WE’RE HIRING FOR

  • Welsh
  • Dutch
  • Greek
  • Italian
  • French
  • German
  • Portuguese

NICE TO HAVE

  • Experience in AI evaluation, audio annotation, or transcript labeling.
  • A background in technical support, quality assurance, or software development.
  • Familiarity with conversational AI, APIs, and structured data.

Skills mentioned

  • Quality Assurance
  • French
  • German
  • Portuguese
Apply on Anyone Ai's siteOpens Anyone Ai's own application page.

Similar jobs

Same role or field, nearby or remote, ranked by HirQ score.

More at Anyone Ai

All roles

Keep exploring

Multilingual Audio Evaluator

No pay listed · HirQ 49

Apply