← All jobs
Staff Engineer, Agentic AI
San Francisco · On-site · FullTime · Engineering
$160K – $250K
Apply well, not just fast
Create a free account and upload your resume to get a match score, keyword gaps, a tailored resume, a cover letter and interview prep for this job.
About the role
LLMsPythonObservabilityUser ResearchCADMechanical Engineering
ABOUT THE ROLE
Lead the development of agent intelligence that helps mechanical engineers complete complex, multi-step workflows across desktop engineering software. As a hands-on technical lead on a small AI engineering team, you will shape the agent architecture, connect user research with product development, and improve the reliability and cost efficiency of real-world workflows.
WHAT YOU'LL DO
- Own agent task success metrics, establish performance baselines, and systematically improve completion rates.
- Build rigorous, reproducible evaluation infrastructure grounded in validated user stories and real engineering workflows.
- Set per-task token budgets and track the cost of completed workflows.
- Work with researchers and engineering domain experts to map, interview about, and validate user workflows.
- Translate validated user stories into testable evaluations and prioritize workflow coverage by customer value and technical feasibility.
- Make architecture decisions across tool calling, state management, error recovery, model routing, and context management.
- Set technical direction for a small team, review designs and code, unblock teammates, and contribute production code.
- Collaborate with product, integrations, and customers to align agent behavior with real-world use.
WHAT WE'RE LOOKING FOR
- At least 7 years of software engineering experience, including 2 or more years building and shipping LLM-based agents that take real-world actions.
- Deep experience with LLM application architecture, including model selection, context management, retrieval, tool calling, and orchestration.
- Strong Python skills and familiarity with function calling, tool APIs, tracing or observability, and evaluation tooling.
- Experience building benchmarks for task completion, cost efficiency, and failure analysis.
- Hands-on technical leadership and code review experience on a small engineering team.
- Experience applying AI or LLM tooling to proprietary engineering data or desktop engineering software, with background in mechanical engineering, CAD, CAE, PLM, or a related domain.
- Familiarity with desktop automation and enterprise workstation constraints is valuable.
COMPENSATION & BENEFITS
Salary range: $160,000 to $250,000 USD annually. Visa sponsorship is not available.
LOCATION
On-site in San Francisco, California, United States.