Prompt Specialist | $22.64/hr Remote

<div><ul><li>Evaluate LLM-generated responses for accuracy, relevance, and effectiveness across diverse topics.</li><li>Conduct fact-checking using trusted public sources and external tools.</li><li>Generate high-quality human evaluation data by annotating response strengths, gaps, and factual inaccuracies.</li><li>Assess reasoning quality, clarity, tone, and completeness of AI-generated responses.</li><li>Ensure outputs align with expected conversational behavior and system guidelines.</li><li>Apply consistent annotations using defined taxonomies, benchmarks, and evaluation frameworks.</li></ul><p><b>Position:</b>Generalist – English&Arabic</p><p><b>Type:</b>Hourly contract</p><p><b>Compensation:</b>$22.64/hour</p><p><b>Location:</b>Remote</p><p><b>Commitment:</b>10–40 hours/week</p><h3>Role Responsibilities</h3><ul><li>Evaluate LLM-generated responses for accuracy, relevance, and effectiveness across diverse topics.</li><li>Conduct fact-checking using trusted public sources and external tools.</li><li>Generate high-quality human evaluation data by annotating response strengths, gaps, and factual inaccuracies.</li><li>Assess reasoning quality, clarity, tone, and completeness of AI-generated responses.</li><li>Ensure outputs align with expected conversational behavior and system guidelines.</li><li>Apply consistent annotations using defined taxonomies, benchmarks, and evaluation frameworks.</li></ul><h3>Requirements</h3><ul><li>Should hold Bachelor’s degree completed.</li><li>Native-level or near-native fluency in Arabic (ILR 5 / CEFR C2) with strong English proficiency.</li><li>Proven experience using large language models and understanding real-world LLM usage.</li><li>Excellent writing skills with the ability to provide clear, nuanced, and structured feedback.</li><li>Strong attention to detail and analytical thinking abilities.</li><li>Comfortable working across multiple topics, domains, and evolving requirements.</li><li>Background in structured analytical fields such as research, policy, analytics, linguistics, or engineering.</li><li>Strong college-level mathematics skills.</li></ul><h3>Application Process (Takes 20 Min)</h3><ul><li>Upload resume</li><li>Interview (15 min)</li><li>Submit form</li></ul></div>#J-18808-Ljbffr