How Well Do AI Models Understand Wet Lab Work? With Benchling’s Nicholas Larus-Stone

<p><a rel="noopener noreferrer nofollow" href="https://nlarusstone.com/" target="_blank">Nicholas Larus-Stone</a> is Benchling’s Head of AI and coauthor of a new benchmarking study putting large language models (LLMs) like Claude and ChatGPT to work redesigning wet lab protocols. </p><p></p><p>The models did just fine, but didn’t blow the Benchling team away. “They can certainly be helpful at certain biological tasks, but they've by no means solved some of the kind of biology problems that people really care about,” Larus-Stone said.</p><p></p><p>That said, he believes that pharmaceutical companies should be spending more on AI usage. That’s just one of several spicier takes we got into in our conversation. </p><p></p><p>Listen for more of Larus-Stone’s thoughts on why benchmarking LLMs is important, how open-source models can be competitive against proprietary ones, how he has fostered cross-pollination between software engineers and scientists by founding Bits in Bio, and whether he likes the term “TechBio.” </p><h3>Show Notes</h3><p>Benchling’s Bench-Bench protocol study <a rel="noopener noreferrer nofollow" href="https://assets.ctfassets.net/kzeezny59h5p/1spGaR3QP9B9CBfuXHMrLl/0ba5a1de599daf1e57faabc62564eb88/BenchBench-Protocol.pdf" target="_blank">white paper</a></p><p></p><p>Benchling <a rel="noopener noreferrer nofollow" href="https://www.benchling.com/blog/can-llms-work-in-the-wet-lab" target="_blank">blog post</a> about the benchmarking study</p><p></p><p>Bits in Bio <a rel="noopener noreferrer nofollow" href="https://www.bitsinbio.org/" target="_blank">Website</a></p><p></p><p>Bits in Bio <a rel="noopener noreferrer nofollow" href="https://cdn.prod.website-files.com/673b37268149bcb7fc36f4bd/6a08c1e10c27c681cf1bea30_2025_Annual_Report%20-%20Bits%20in%20Bio.pdf" target="_blank">2025 Annual Report</a></p><p></p><p>Other AI benchmarking studies </p><p></p><p>From Jure Lescovec’s <a rel="noopener noreferrer nofollow" href="https://www.iongenomics.bio/p/more-on-biomni-and-claude-science?r=3ihla5" target="_blank">lab and the Biomni team</a>:</p><p>Qu <i>et al</i>. <a rel="noopener noreferrer nofollow" href="https://www.biorxiv.org/content/10.64898/2026.05.12.724604v2" target="_blank">“BiomniBench: Process-level Evaluation of LLM Agents for Real-world Biomedical Research” </a><i>bioRxiv</i>. May 12, 2026.</p><p></p><p>Guo <i>et al.</i> <a rel="noopener noreferrer nofollow" href="https://www.biorxiv.org/content/10.64898/2026.05.05.723092v2.full" target="