Skip to content

Applied AI Engineer

LevelAustin, TXHybrid

First seen Oct 15 · open 36 days · posted onceNo pay listed

HirQ verdict

60/100 · Fair. Based on age, reposts, pay, the company's hiring and ghost signals.

Low ghost risk
True age
36 days
Reposts
Posted once

See the evidence behind this score.

Pro shows each part of the score, the reasons, the pay percentile and the listing history.

HirQ's ghost-risk estimate and company labels are automated opinions based on what we observe on employers' public job boards: how long a listing has been open, whether it was re-listed, wording in the description, and how often roles on that board close. They are not statements about an employer's intent, and a high-risk listing can still be a real opening. Figures are as of the date shown. How we measure

At a glance

Pay
No pay listed
Level
Mid level
Experience
7+ years
Type
FullTime
Team
Corporate
Work setup
Hybrid

“- Hands-on experience in a production environment with retrieval: chunking, embeddings, hybrid search, re-ranking, metadata filtering, and the failure modes of each.”

Pay vs market

Employer-posted ranges for Applied AI Engineer roles in the US in the last 12 months (77 postings).

$200k
25th pct/yr
$213k
Median/yr
$248k
75th pct/yr
$174k · 10th90th · $279k

This job: No pay listed

Level hiring

Company page
Actively hiringHiring56· FairSoftware & SaaS
Open roles
26
New in 30 days
8
Closed in 30 days
14
Hiring trend, 13 weeksPro
Follow-through: ••%Pro

About the role

From Level's careers page, checked Nov 21

Applied AI Engineer

What You'll Do

  • Ship production agentic systems- Design and build agents and agentic workflows that solve a defined problem end to end. You own prompts, tools, retrieval, guardrails, observability, cost and latency budgets, and rollout.
  • Provide governance and security guidance surrounding AI designs, strategy, and usage.
  • Automate SME workflows- Identify high-leverage operational toil (review pipelines, content QA, labeling and ops loops, support triage, internal copilots) and partner with the SMEs running those workflows to define success criteria, validate outputs, and replace meaningful chunks of that work with AI systems they trust. SMEs are co-owners of quality from the start of the project.
  • Make AI features safe- Treat what you deliver as a regulated product. Design for relevant compliance frameworks (e.g., COPPA, FERPA, NIST CSF 2.0) from day one, run safety and bias evals before launch and continuously after, and build the human-in-the-loop and content-filtering controls AI features need before they reach end users.
  • Hand off what you ship- Production features leave your hands with documentation, runbooks, an eval harness, and dashboards.
  • Make AI features easier for the teams to utilize- foster a culture of safe AI adoption with manageable ecosystems that integrate and enable cross-functional teams to create and enhance their own workflows and automations.

What You Need

  • 7+ years professional experience as an Engineer with at least 1+ years of hands-on experience building agentic systems on at least one modern stack (LangGraph, the Anthropic SDK / Claude Agent SDK, OpenAI Agents SDK, Pydantic-AI, Mastra, LlamaIndex, CrewAI, or a homegrown stack). We care that you have built and operated agentic systems in production, not which framework.
  • Strong Python familiarity plus one typed language for production services (TypeScript, Go, or similar). Cloud experience (AWS or GCP) and containerized deployment.
  • Software engineering foundation (formal or autodidact), with several years of production environment experience and a track record of leading systems to launch.
  • Multiple shipped LLM-powered features in a production environment, with concrete stories about what broke, how you fixed it, and what you would do differently.
  • Practical knowledge of common agentic patterns: ReAct, tool use with structured schemas, prompt chaining, routing, orchestrator-workers, evaluator-optimizer / reflection, and human-in-the-loop. You can decide when a deterministic workflow is the right answer instead of an autonomous agent.
  • Hands-on experience in a production environment with retrieval: chunking, embeddings, hybrid search, re-ranking, metadata filtering, and the failure modes of each. Working knowledge of grounding techniques that anchor generated answers in retrieved evidence (citation and quote extraction, faithfulness and refusal evals, post-hoc consistency checks).
  • Strong prompt-engineering practice: zero-shot, few-shot, and many-shot patterns; example selection and ordering; in-context learning and chain-of-thought.
  • Comfort with structured output and validation in production (provider-native structured outputs, Instructor, Pydantic-AI, Outlines, or a comparable approach).
  • Disciplined evaluation practice. You do not rely on subjective review to decide whether a system is ready.
  • Experience in standing up local models and creating and testing closed local model solutions.
  • Strong written and verbal communication. You can explain an architectural trade-off to an executive and to a junior engineer in the same week.
  • You are comfortable using AI coding tools heavily in your implementation workflow while you own problem framing, design choices, and verification. We measure your output by working systems delivered, not lines of code written.

Nice to Have

  • Advanced retrieval experience: GraphRAG, agentic retrieval, evaluation-driven retrieval tuning, and hybrid retrieval at scale.
  • Direct or transferable experience with safety, privacy, and policy constraints in user-facing AI. K-12 or other regulated-domain experience is a strong plus.
  • Experience with prompt-optimization frameworks (DSPy, TEXTGRAD, AdalFlow) where they paid off in production.
  • A public repo, package, gist, or technical write-up of meaningful AI work, or a representative project you can describe in detail under your confidentiality constraints.
  • Open-source contributions to AI tooling (frameworks, agents, evals, MCP servers).

Skills mentioned

  • Python
  • TypeScript
  • Go
  • React
  • AWS
  • GCP
  • Observability
  • LLMs
  • Quality Assurance
  • Communication
Apply on Level's siteOpens Level's own application page.

Similar jobs

Same role or field, nearby or remote, ranked by HirQ score.

More at Level

All roles

Keep exploring

Applied AI Engineer

No pay listed · HirQ 60

Apply