server administrator
Title posted on Talent.com - DevOps Engineer - AI Model Evaluator
Posted on July 27, 2026 by Employer details Mercor
Job details
<p><strong>About the job</strong></p> <p><strong>Mercor</strong> connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include <strong>Benchmark</strong>, <strong>General Catalyst</strong>, <strong>Peter Thiel</strong>, <strong>Adam D'Angelo</strong>, <strong>Larry Summers</strong>, and <strong>Jack Dorsey</strong>.</p> <p><strong>Position:</strong> DevOps / SRE / Cloud Engineer (Coding Agent Experience)<br/> <strong>Type:</strong> <strong>Contract</strong><br/> <strong>Compensation:</strong> <strong>$85/hour</strong><br/> <strong>Location:</strong> <strong>Remote</strong></p> <p><strong>Role Responsibilities</strong></p> <ul> <li>Use frontier <strong>AI coding agents</strong> to complete and evaluate complex <strong>infrastructure engineering</strong> tasks.</li> <li>Review model-generated implementations involving <strong>cloud platforms</strong>, <strong>Kubernetes</strong>, <strong>CI/CD systems</strong>, and <strong>infrastructure automation</strong>.</li> <li>Identify bugs, edge cases, reliability issues, and failure modes in model outputs.</li> <li>Compare outputs from multiple frontier models to assess strengths and weaknesses.</li> <li>Apply professional engineering judgment to realistic <strong>infrastructure engineering</strong> scenarios.</li> </ul> <p><strong>Qualifications</strong></p> <p><strong>Must-Have</strong></p> <ul> <li><strong>2+ years</strong> of professional <strong>DevOps</strong>, <strong>SRE</strong>, or <strong>Cloud Engineering</strong> experience.</li> <li>Experience with <strong>AWS</strong>, <strong>Azure</strong>, <strong>GCP</strong>, <strong>Kubernetes</strong>, <strong>Terraform</strong>, <strong>CI/CD pipelines</strong>, or observability tooling.</li> <li>Regular use of <strong>AI coding agents</strong> like <strong>Cursor</strong>, <strong>Claude Code</strong>, <strong>Codex</strong>, <strong>Windsurf</strong>, <strong>Gemini CLI</strong>, or similar tools.</li> <li>Ability to evaluate model-generated <strong>infrastructure</strong> and <strong>reliability engineering</strong> solutions.</li> </ul> <p><strong>Preferred</strong></p> <ul> <li>Experience supporting <strong>production-scale systems</strong>.</li> </ul> <p><strong>Compensation & Legal</strong></p> <ul> <li><strong>$400 per accepted task</strong>.</li> <li>Compensation is tied to accepted work.</li> </ul> <p><strong>Application Process (Takes 20?30 mins to complete)</strong></p> <ul> <li>Upload resume</li> <li>AI interview based on your resume</li> <li>Submit form</li> </ul> <p><strong>Resources & Support</strong></p> <ul> <li>For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome</li> <li>For any help or support, reach out to: support@mercor.com</li> </ul> <p><em>PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.</em></p>- Location Toronto, ON
- Work location On site
- Salary$85.00HOUR hourly
- Terms of employment Part time
- Starts as soon as possible
- vacancies 1 vacancy
- Source Talent.com #626159744669460843
Important notice: This job posting has been provided by a partner site. Job Bank is not responsible for this content.
Report a problem with this job posting
Page details
- Date modified: