server administrator
Title posted on Talent.com - DevOps Engineer - AI Model Evaluator
Posted on November 17, 2026 by Employer details Mercor
Job details
<p><strong>About the job</strong></p> <p><strong>Mercor</strong> connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include <strong>Benchmark</strong>, <strong>General Catalyst</strong>, <strong>Peter Thiel</strong>, <strong>Adam D'Angelo</strong>, <strong>Larry Summers</strong>, and <strong>Jack Dorsey</strong>.</p> <p><strong>Position:</strong> DevOps / SRE / Cloud Engineer (Coding Agent Experience)<br/> <strong>Type:</strong> <strong>Contract</strong><br/> <strong>Compensation:</strong> <strong>$85/hour</strong><br/> <strong>Location:</strong> <strong>Remote</strong></p> <p><strong>Role Responsibilities</strong></p> <ul> <li>Use frontier <strong>AI coding agents</strong> to complete and evaluate complex infrastructure engineering tasks.</li> <li>Review model-generated implementations involving <strong>cloud platforms</strong>, <strong>Kubernetes</strong>, <strong>CI/CD systems</strong>, <strong>observability</strong>, and <strong>infrastructure automation</strong>.</li> <li>Identify bugs, edge cases, reliability issues, and failure modes.</li> <li>Compare outputs from multiple frontier models and assess their strengths and weaknesses.</li> <li>Apply professional engineering judgment to realistic infrastructure engineering scenarios.</li> <li>Work <strong>independently and asynchronously</strong> to meet sprint-based project deadlines.</li> </ul> <p><strong>Qualifications</strong></p> <p><strong>Must-Have</strong></p> <ul> <li><strong>2+ years</strong> of professional <strong>DevOps</strong>, <strong>SRE</strong>, or <strong>Cloud Engineering</strong> experience.</li> <li>Experience with <strong>AWS</strong>, <strong>Azure</strong>, <strong>GCP</strong>, <strong>Kubernetes</strong>, <strong>Terraform</strong>, <strong>CI/CD pipelines</strong>, or <strong>observability tooling</strong>.</li> <li>Regular use of <strong>AI coding agents</strong> such as Cursor, Claude Code, Codex, Windsurf, Gemini CLI, or similar tools.</li> <li>Ability to evaluate model-generated infrastructure and reliability engineering solutions.</li> </ul> <p><strong>Preferred</strong></p> <ul> <li>Experience supporting production-scale systems.</li> </ul> <p><strong>Compensation & Legal</strong></p> <ul> <li><strong>$400 per accepted task</strong>.</li> <li>Compensation is tied to accepted work.</li> </ul> <p><strong>Application Process (Takes 20?30 mins to complete)</strong></p> <ul> <li>Upload resume</li> <li>AI interview based on your resume</li> <li>Submit form</li> </ul> <p><strong>Resources & Support</strong></p> <ul> <li>For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome</li> <li>For any help or support, reach out to: support@mercor.com</li> </ul> <p><em>PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.</em></p>- Location Toronto, ON
- Work location On site
- Salary$85.00HOUR hourly
- Terms of employment Part time
- Starts as soon as possible
- vacancies 1 vacancy
- Source Talent.com #626159744669460843
Important notice: This job posting has been provided by a partner site. Job Bank is not responsible for this content.
Report a problem with this job posting
Page details
- Date modified: