244 jobs
Mercor
2 months agoEvaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models. You'll assess end-to-end coding sessions produced with AI-assisted developer tools — judging correctness,
Mercor
2 months agoEvaluate the quality, correctness, and reproducibility of software-engineering benchmark tasks used to train and evaluate a frontier AI lab's models. You'll assess repository-level tasks, reference patches, test harnesses, and grading integ
Mercor
2 months agoEvaluate the quality, correctness, and methodological rigor of applied machine-learning tasks used to train and evaluate a frontier AI lab's models. You'll assess experiment design, model-selection reasoning, and evaluation methodology — an
Mercor
2 months agoEvaluate the quality, correctness, and cloud-architecture soundness of AWS serverless and infrastructure-as-code tasks used to train and evaluate a frontier AI lab's models. You'll assess multi-service serverless designs, IaC fidelity, and
Mercor
2 months agoEvaluate the quality, correctness, and production-readiness of Kubernetes tasks used to train and evaluate a frontier AI lab's models. You'll assess cluster-operations scenarios, manifest correctness, and failure-mode troubleshooting — and
Mercor
2 months agoSupport a high-priority technical-expert panel for a frontier AI lab as an Expert Interviewer. Overview We're seeking an experienced interviewer to help vet shortlisted engineers across GPU kernel development, security & vulnerability resea
Mercor
2 months agoEvaluate the quality, correctness, and hardware-appropriateness of Neuron Kernel Interface (NKI) development tasks used to train and evaluate a frontier AI lab's models. You'll assess CUDA→NKI migration fidelity, Trainium-specific performan
Mercor
2 months agoEvaluate the quality, correctness, and completeness of GPU/accelerator kernel development tasks used to train and evaluate a frontier AI lab's models. You'll assess numerical correctness, performance-benchmarking fairness, task scoping, and
Mercor
2 months agoEvaluate the quality, fidelity, and completeness of vulnerability-reproduction and remediation tasks used to train and evaluate a frontier AI lab's models. You'll assess whether CVE reproductions are faithful, fixes are sound, verification
Mercor
2 months agoJoin a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models. 1\. Overview Join a leading AI lab's cutting-edge GenAI team and
Mercor
2 months agoMercor is partnering with a frontier AI research lab to engage experienced software engineers with deep expertise in legacy codebase migration and modernisation. We are looking for engineers who have personally executed complex migrations a
Mercor
2 months agoAbout the Role Mercor is hiring experienced News Analysts, Reporters, and Journalists to help evaluate and improve cutting-edge AI systems. In this role, you'll evaluate AI-generated news content and workflows, leveraging your real-world ex
Showing 169–180 of 244 jobs