Role Overview: We are looking for a scrappy, creative, and detail-oriented AI Model Testing Engineer to build, manage, and continuously enhance our infrastructure for testing and evaluating AI models from leading providers such as OpenAI, Google, and Anthropic. This role will have a particular focus on LLMs & transcription model testing and optimization. You’ll collaborate closely with our medical team to craft targeted test cases, enabling veterinarians to identify and select the most accurate and effective AI-generated outputs.

Key Responsibilities:

• Design, develop, and maintain testing pipelines and logic primarily focused on transcription models, while also covering other AI models such as LLMs and real-time inference models.
• Collaborate closely with the veterinary medical team to translate clinical scenarios into structured transcription and AI model test cases.
• Implement frameworks for comparative analysis, allowing veterinarians to systematically review and select optimal AI outputs.
• Balance and optimize accuracy, quality, speed, and cost-efficiency of AI model usage.
• Manage end-to-end infrastructure for AI model testing and experimentation, ensuring scalability and reliability.
• Continuously identify creative solutions to enhance AI performance and usability based on testing feedback and outcomes.