Senior Software Engineer – LLM Evaluation

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Software Engineer – LLM Evaluation based in United States. This part-time consulting opportunity is designed for experienced software engineers interested in advancing the evaluation of large language models. You will curate high-quality code, develop technical solutions, and evaluate AI-generated software against real-world engineering standards. The role spans multiple programming languages and covers the complete software-development lifecycle, from architecture and prototyping through production and maintenance. You will design verification mechanisms and contribute to benchmarks that make AI evaluation more rigorous, consistent, and reproducible. Your engineering expertise will help research teams identify model strengths, weaknesses, and recurring coding errors. You will collaborate remotely with technical and research professionals on projects at the intersection of software engineering and AI. The flexible contractor structure requires a minimum of 10 hours per week, with the possibility of working up to 40 hours depending on project needs.