Judge Jobs
1 - 15 of 157
Search Results - Judge Jobs
DataAnnotation-Brossard
DataAnnotation is seeking an experienced Management Consultant to help train AI models. You’ll test models on business problems from your practice, judge outputs, and explain where they hold up and where they fall apart.
This role focuses...
Read more
appcast.io -
Prolific-Mississauga
tasks involving Hindi language analysis and editing
• Judge the output of AI on Hindi language prompts
• Help refine advanced AI systems
Requirements:
• Proven fluency in Hindi
• Solid English understanding
• Willingness to take...
Read more
2 similar jobs: Toronto, Québec
DataAnnotation-Toronto
DataAnnotation is seeking an experienced Management Consultant to help train AI models. You’ll test the newest models on business problems from your practice, judge results with a consultant’s eye, and explain where they hold up and where they fail...
Read more
appcast.io -
Prolific-Edmonton
Write and analyze Arabic for AI models
• Judge the performance of AI in arabic contexts
• Contribute to the refinement of AI systems
Requirements:
• Advanced fluency in Arabic
• Experience with AI training tasks
• Access...
Read more
1 similar jobs: Mississauga
PAIRS-Canada
investor’s preferences
• Keep founder and investor relationships current and qualified
• Judge which opportunities deserve network attention
Requirements:
• Active founder and direct investor relationships built personally
• Experience bringing a company...
Read more
appcast.io -
MFA Technologies-Vancouver
and iterate on production system prompts - structured role framing, output constraints, and few-shot design - not just prompt tinkering Build eval and observability into every agent you ship : golden datasets, RAGAS-style metrics, LLM-as-judge (as both...
Read more
Hired-Ottawa
to voice tasks.
• Record your ratings using project guidelines and flag examples that are difficult to judge.
Requirements
• Confident spoken English and clear written communication.
• Ability to compare basic content details with close attention...
Read more
DataAnnotation-North Vancouver
We’re looking for an experienced Management Consultant to help train AI models. You’ll test the newest models on business problems from your own practice, judge what they produce with a consultant’s eye, and tell us exactly where they hold up...
Read more
Mercor-Toronto
Position: Study Domain Expert — Judge Calibration — Sales
Type: Contract
Compensation: $90/hour
Location: Remote
Duration: September 12–15, 2026
Commitment: 13 hours
Role Responsibilities
• Sign an NDA before receiving study materials.
• Complete...
Read more
careers-page.com -
Spring Financial-Winnipeg
and validation harnesses to verify AI‑generated output quickly (unit, integration, and end‑to‑end coverage).Use AI across the full workflow, from investigating bugs to refactoring to documentation, and judge when not to use it.Walk us through AI‑built projects...
Read more
Neighbourhood Holding Company-Vancouver
across the technology estate
• Judge consolidation opportunities across separately developed systems
• Check whether shipped systems achieve measurable business outcomes
Requirements:
• Five-plus years in product management
• Experience with lending...
Read more
appcast.io -
Work Vista-Ottawa
on assessing the quality and relevance of AI‑generated content. You will act as a critical judge, reviewing model outputs against strict guidelines to ensure they are helpful, honest, and harmless. Your feedback provides the essential data signals needed...
Read more
1 similar jobs: Montréal
Verily Life Sciences LLC-Toronto
development team. The platform supports golden datasets, code assertions, LLM-as-a-judge evaluations, error analysis, and customer feedback signals. Your work will serve healthcare customers across life sciences, health systems, health plans, and patients...
Read more
appcast.io -
2 similar jobs: Ottawa, London
Noble Corporation-Brampton
assortment of leading brands.
While we've grown and continue to expand, one thing about Noble that hasn't changed is our commitment to delivering the best service in our industry.
Today, we still judge our success by our customers' successes. That's why our...
Read more
BIMM-Toronto
and skill outputs including LLM‑as‑judge scoring, regression test suites, and golden dataset validation so that prompt and model changes are measurable before they ship.
• Define strict input/output contracts for MCP tools and agent skills using typed...
Read more
12345678910
Companies now hiring:
More jobs – Legal:
Don’t miss out on new job vacancies!
Create a job alert for: Judge
It's free, and you can cancel email updates at any time
12345678910