Remote Contract AI Prompt Writer&Evaluator

<p><strong>Role Overview<br><br></strong>Collaborating with a leading AI lab to contract experienced professionals for an AI model evaluation project. Contractors will assess the quality, accuracy, and safety of AI-generated responses across specialized domains such as finance, law, medicine, and accounting. The project offers an opportunity to directly improve the reliability of AI systems in high-stakes contexts where inaccurate information carries serious risk.</p><p><strong>Role Overview<br><br></strong>Collaborating with a leading AI lab to contract experienced professionals for an AI model evaluation project. Contractors will assess the quality, accuracy, and safety of AI-generated responses across specialized domains such as finance, law, medicine, and accounting. The project offers an opportunity to directly improve the reliability of AI systems in high-stakes contexts where inaccurate information carries serious risk.<br><br><strong>Key Responsibilities<br><br></strong><ul><li>Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance</li><li>Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness</li><li>Identify fabricated claims, incorrect references, or misleading reasoning across model outputs</li><li>Score and rank multiple model responses using structured rubrics across dimensions</li><li>Provide written justifications with specific evidence for each evaluation<br><br></li></ul><strong>Ideal Qualifications<br><br></strong><ul><li>Master’s degree or higher in a relevant professional field (e.g., Finance, Accounting, Law, Medicine, Healthcare, Engineering)</li><li>Professional experience applying domain expertise in a practitioner or advisory capacity</li><li>Familiarity with industry-specific standards, regulations, or clinical guidelines</li><li>Strong written communication and critical reasoning skills<br><br></li></ul><strong>More About The Opportunity<br><br></strong><ul><li>Expected commitment: ~20 hours/week<br><br></li></ul><strong>Application Process<br><br></strong><ul><li>Complete the platform application and required screening assessments.</li><li>Complete a Training Assessment<br><br></li></ul><strong>Contract and Payment Terms<br><br></strong><ul><li>You will be engaged as an independent contractor.</li><li>This is a fully remote role that can be completed on your own schedule.</li><li>Projects can be extended, shortened, or concluded early depending on needs and performance.</li><li>Payments will be issued according to the payment method and schedule outlined in your contract.</li></ul></p>#J-18808-Ljbffr