Applied Research Scientist

<div><p><b>About Us</b><br/>At Sully.ai,<b>We’re Building the Most Impactful Healthcare Company on Earth</b></p><p>We believe that access to a great doctor is a basic human right. Today, that’s not a reality. Delays, misdiagnoses, administrative chaos, and burnout plague the system.</p><p><b>Our Mission:</b>One Human, One Doctor. We build AI teammates that augment clinicians — scribes, nurses, receptionists, translators — all powered by our own world-class models and deployed in real-world care.</p><p><b>Our Traction</b></p><ul><li><p>450+ organizations signed 16 months</p></li><li><p>AI agents cut admin by ~2.8 hours daily and reduce onboarding 85%.</p></li><li><p>5M+ Clinical Tasks completed to date, serving 36+ specialties.</p></li><li><p>Raised $25M from YC, Eric Yuan, Amity, Semper Virens</p></li><li><p>Patented AI architecture (MedCon-1)<b>outperforms GPT-4.5, Gemini, Claude</b>on clinical reasoning tasks</p></li></ul><p><b>Sully requires A-players capable of 4 months = 1 year output.</b></p><h3>Key Responsibilities</h3><ul><li><p>Build and scale automated evaluation pipelines (LLM-as-judge + human review) with clinical-grade benchmarks.</p></li></ul><h3>Hard Requirements</h3><ul><li><p>Proven experience designing agentic processes and LLM evaluation/benchmarking frameworks.</p></li><li><p>Strong Python and ML background (PyTorch/TensorFlow, Hugging Face, LangChain/LlamaIndex).</p></li><li><p>Demonstrated ability to design rigorous experiments and translate findings into production.</p></li><li><p>Track record of published research or deep applied work in LLMs and agent evaluation.</p></li><li><p>Strong communication and technical writing skills to articulate complex findings clearly.</p></li><li><p><b>First-Month Focus</b></p></li><li><p>Audit existing evaluation approaches for clinical and agentic tasks.</p></li><li><p>Define initial benchmarks and build early automated pipelines.</p></li><li><p>Partner with engineering to land first set of CI gates for accuracy, factuality, and safety.</p></li><li><p><b>90 Days</b></p></li><li><p>Deliver a repeatable evaluation framework with automated pipelines in production.</p></li><li><p>Demonstrate measurable improvements in robustness, hallucination reduction, or safety.</p></li><li><p>Publish or present internal research findings that directly shape product reliability.</p></li><li><p>If you’ve ever said, “I want to do work that actually matters”, this is it. Let’s build something life-changing, together.</p></li></ul><h3>Key Results (First 90 Days)</h3><ul><li><p>Deliver a repeatable evaluation framework with automated pipelines in production.</p></li><li><p>Demonstrate measurable improvements in robustness, hallucination reduction, or safety.</p></li><li><p>Publish or present internal research findings that directly shape product reliability.</p></li></ul><p><b>Who Thrives Here</b></p><ul><li><p><b>Entrepreneurial to your core</b>: You think in outcomes, thrive in chaos, and take ownership without limits</p></li><li><p><b>Mission-obsessed</b>: You’re here to save lives, not just ship features — patients and doctors are your why.</p></li><li><p><b>Impact-driven&fast-moving</b>: You sprint toward hard problems and ship with sharp judgment.</p></li><li><p><b>Elite teammate</b>: You raise the bar through high standards, direct feedback, and craft excellence.</p></li></ul><p><b>Why Join</b><b>Sully.ai</b><b>?</b><br/>🔥Revolutionizing the antiquated $800B+ Healthcare market</p><p>🧠50%+ of us are ex-founders. We hire A-players, not passengers</p><p>⚡️ Speed matters - we operate with urgency, autonomy, and ownership</p><p>🧪You’ll work on real, first-of-their-kind problems at the edge of AI and medicine</p><p>❤️ Your work helps doctors reclaim their time - and patients get better, faster care</p><p>Sully.ai is an equal opportunity employer. In addition to EEO being the law, it is a policy that is fully consistent with our principles. All qualified applicants will receive consideration for employment without regard to status as a protected veteran or a qualified individual with a disability, or other protected status such as race, religion, color, national origin, sex, sexual orientation, gender identity, genetic information, pregnancy or age. Sully.ai prohibits any form of workplace harassment.</p></div>#J-18808-Ljbffr