Judge Jobs in Montréal
1 - 15 of 37
Search Results - Judge Jobs in Montréal
RBC-Montréal
in the data science function responsible for how RBC measures model and agent quality, safety, risk, and performance. You will design, build, and continuously improve evaluation datasets, sourcing methods, LLM judge design, deterministic scorers, human...
Work Vista-Montréal
on assessing the quality and relevance of AI‑generated content. You will act as a critical judge, reviewing model outputs against strict guidelines to ensure they are helpful, honest, and harmless. Your feedback provides the essential data signals needed...
ODAIA-Montréal
science function responsible for how RBC measures model and agent quality, safety, risk, and performance. You will design, build, and continuously improve evaluation datasets, sourcing methods, LLM judge design, deterministic scorers, human evaluation...
Poka EN-Montréal
usage: actual user questions, expected behavior and the edge cases that show up in production.
• Defining with the team what a good answer looks like for our users, writing scoring rubrics and using LLM-as-judge where it makes sense, calibrated against...
appcast.io -
Naboo-Montréal
You have built a campaign engine from scratch: lists, sequences, tracking and reporting.
• You design segmented, multi-channel campaigns, not just run them, and you judge them on pipeline, not opens.
• You set up and run your own stack: HubSpot, Clay...
Mizo-Montréal
and LLM observability/tracing stacks.
• Familiarity with building eval pipelines, LLM-as-judge, and prompt/version management at scale.
• Experience with retrieval-augmented generation (RAG), vector stores, and context engineering.
• Familiarity...
appcast.io -
Sweat Pants Agency LLC-Montréal · Remote
is yours. Nobody here is on a time clock. We judge you on output.
If you want a lane, a ticket queue, and a scope document, this is a bad fit and we will both know it fast.
If you want to own the whole picture and be judged on whether the number moved...
INTO Inc.-Montréal
manual work and it is part of the job. You know when an LLM-as-judge is validated enough to trust, and when it is not.
Own the behavior of the system. You write and evolve the production prompts: the template, the input variables, the output schema...
appcast.io -
Hrstalentsolutions-Montréal
to detail are welcome, and the employer can train you on its form requirements and workflow. The role does not require you to judge eligibility or interpret policy independently.
Submitting your application
Your resume can point to any experience checking...
LawZero-Montréal
Data Governance policies, and legal obligations.
• Develop and refine the scoring and filtering toolchain: heuristics, LLM‑as‑a‑judge evaluators, ML classifiers, metadata extraction modules, and human‑in‑the‑loop review workflows required for data...
LinkedIn Job Wrapping-Montréal
curation, SFT, LoRA/PEFT, and rigorous evaluation of results against baselines.
• Build evaluation suites for LLM systems: benchmarks, LLM-as-judge patterns, and regression tests.
• Work with embeddings and retrieval where they affect answer quality...
appcast.io -
LawZero-Montréal
Data Governance policies, and legal obligations.
• Develop and refine the scoring and filtering toolchain: heuristics, LLM-as-a-judge evaluators, ML classifiers, metadata extraction modules, and human-in-the-loop review workflows required for data...
Welcome to the Jungle-Montréal
curation, SFT, LoRA/PEFT, and rigorous evaluation of results against baselines.
• Build evaluation suites for LLM systems: benchmarks, LLM-as-judge patterns, and regression tests.
• Work with embeddings and retrieval where they affect answer quality...
appcast.io -
Volga Partners-Ottawa · Remote
Volga Partners is seeking Medical AI Evaluators to assess AI-generated healthcare content across General Practice, Family Medicine, Internal Medicine, NP, and PA pathways. You will review medical scenarios, judge reasoning quality, and provide...
AMA-Montréal
transient and steady-state analysis, and heavy‐traffic and diffusion approximations. You can fit queueing models to real data and judge when their assumptions hold.
• You have in-depth knowledge of simulation science, including discrete-event and/or agent...
123
Companies now hiring in Montréal:
More jobs – Legal in Montréal:
Don’t miss out on new job vacancies!
Create a job alert for: Judge, Montréal
It's free, and you can cancel email updates at any time
123