Hiring: AI Engineer | Agentic AI, AWS Bedrock AgentCore & Langfuse | 15+ Years

Job Title: AI Engineer / Generative AI Engineer Location: Los Angeles, CA (Hybrid) Duration: 3+ Months (Extension Possible) Experience: 15+ Years Job Summary We are seeking a hands-on AI Engineer with expertise in Python, Agentic AI, AWS Bedrock AgentCore, and LLM evaluation to build, deploy, monitor, and continuously improve production-grade AI agents. Key Responsibilities - Develop AI agents using Python and Claude Agent SDK. - Deploy agents using AWS Bedrock AgentCore Runtime. - Design golden datasets and implement LLM-as-a-Judge evaluations. - Integrate automated evaluations into CI/CD pipelines as quality gates. - Implement Langfuse/OpenTelemetry for AI observability and tracing. - Evaluate agent accuracy, task completion, tool execution, and performance. - Support RAG pipelines and AWS data processing workflows. Required Skills - Python and Agentic AI development. - AWS Bedrock AgentCore Evaluations / Bedrock evaluation. - Golden-dataset design and curation. - LLM-as-a-Judge design and calibration against human labels. - Automated evaluation and CI gate integration. - Langfuse and/or OpenTelemetry. Good to Have - RAGAS or equivalent evaluation frameworks. - Trajectory evaluation and agentic red-teaming. - Bedrock Guardrails, Strands Agents SDK, and GitHub Actions. Qualifications - 6–8+ years of software engineering, cloud engineering, or AI/ML experience. - Hands-on experience with production AI agents and continuous evaluation. - Strong problem-solving and troubleshooting skills. All your information will be kept confidential according to EEO guidelines.