ai evaluation engineer

This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for an AI Evaluation Engineer based in Ireland. As a founding AI Evaluation Engineer, you will design and build the evaluation, testing, and observability infrastructure that ensures production-grade AI agents perform reliably,...

Mercor in Ireland is seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across policy-sensitive topics. Please read the information in this job post thoroughly to understand exactly what is expected of potential candidates. You will assess AI-generated responses and provide structured feedback...

About the jobMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Generalist Expert Type: Contract Compensation: $70/hour Location: RemoteResponsibilitiesEvaluate...

Lever, Inc. — AI Trainers Network position in Ireland for native English speakers. Contribute to AI training, annotation, evaluation, and prompt creation across remote projects.Join a global contributor network with varied tasks and clear timelines, choosing assignments that fit your availability. Responsibilities include reviewing content, ensuring...

We are seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive, and ambiguous ("grey-area") topics. You will assess AI-generated responses, apply safety policies, and help improve model behavior through structured evaluations and feedback.ResponsibilitiesEvaluate...

About the jobMercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey .Position: AI Safety Practitioner Type: Contract Compensation: $60–$70/hour Location: RemoteRole...

G2i is seeking a Senior/Staff- or Principal-level software engineer to evaluate AI-assisted coding interactions. This isn’t a traditional engineering role—you won’t write production code but will judge whether the model thinks like a great engineer.You’ll assess usefulness, correctness at a high level, and the quality of explanations, giving clear,...

YO AI Labs in Ireland is seeking a Research Engineer for code generation, software engineering, and AI model evaluation. This remote contractor role emphasizes building and evaluating real-world coding tasks to train next-generation AI systems.You will work with Python, Java, Rust, C++, Go, or TypeScript to analyze codebases, implement features, and optimize...

Obsidian is seeking experienced AI Safety Practitioners to evaluate the safety, quality, and alignment of frontier AI models across complex, policy-sensitive topics. Find out exactly what skills, experience, and qualifications you will need to succeed in this role before applying below. You will assess AI-generated responses, apply safety policies, and...

Mercor is seeking experienced English Linguistic Experts to join a cutting-edge AI research project conducted in partnership with a leading research lab. Find out if this opportunity is a good fit by reading all of the information that follows below. You will evaluate LLM-generated English text across diverse tasks and curate high-quality linguistic data...

# Principal Design Evaluation Engineer# Consumer Custom Silicon (CSS) Team**The Group:**The charter of the CSS team is to lead the market in selected technology domains with highly differentiated sensing and signal processing solutions.Today these technology areas include Capacitive Sensing, Optical Image Stabilization, Optical Sensing and Power that drive...

Principal Design Evaluation Engineer Consumer Custom Silicon (CSS) TeamAbout Analog Devices Analog Devices, Inc. (NASDAQ: ADI) is a global semiconductor leader that bridges the physical and digital worlds to enable breakthroughs at the Intelligent Edge. ADI combines analog, digital, AI, and software technologies into solutions that combat climate change,...

RWS Group is seeking a web-savvy evaluator to enhance AI data and improve search engine results for major platforms. Work from home in Ireland, with flexible, part-time hours and a pay rate of up to 18 USD/hour.No prior experience required, but you will pass training and NDA requirements. You'll provide feedback on text, audio, images and videos to help...

Alignerr Corp. is seeking experienced entrepreneurship educators and business experts to evaluate AI-generated startup scenarios, business plans, and entrepreneurship content.Your real-world knowledge will shape how AI understands and communicates the principles of building and scaling businesses—making a meaningful impact on the next generation of...

YO AI Labs is seeking experienced Technical Writers and Editors to contribute to a customer project focused on evaluating and improving AI systems. You will review AI-generated content, assess clarity, tone, accuracy, coherence, and instructional value, and provide clear scores, rationales, and actionable feedback.This remote role supports collaboration with...

YO AI Labs is seeking experienced Product Managers and Product Owners to contribute to a customer project focused on evaluating and improving advanced AI systems.You will assess AI-generated content, specifications, and product documentation, apply strong product judgment, and provide detailed rationales and actionable feedback. No prior AI experience is...

YO AI Labs seeks a skilled Technical Writer / Editor on a contracting basis to evaluate and improve AI system outputs. You will assess clarity, tone, accuracy and usefulness, and provide clear scores, rationales, and actionable feedback that helps refine model behavior.Work is remote and asynchronous, collaborating with project managers and reviewers. Strong...

Alignerr is seeking finance lecturers and economists to shape how AI understands money, markets, and economic reasoning. This fully remote, flexible contract lets you work around your schedule.Ideal candidates have 3+ years teaching finance or economics at the postsecondary level and can critically evaluate written financial reasoning at scale. Join a...

G2i is seeking a senior software engineer to help evaluate interactions with AI coding agents. This is not a traditional coding role; you won't write production software but will judge how the model reasons and whether its outputs reflect engineering judgment.You will assess AI-generated coding interactions end to end, provide written, opinionated feedback,...

Mercor is seeking a Generalist Expert for a contract role focused on evaluating AI-generated responses to strengthen model reasoning and correctness. You will provide structured feedback to improve training data and downstream performance, and develop precise, well-evidenced rationales in line with strict evaluation guidelines.You will work remotely,...