Advanced computing models can reconstruct complex molecular structures with high accuracy, but predicting how potential drug compounds behave remains a challenge, according to a new medicinal chemistry benchmark introduced by OpenAI.
Called MedChemBench, the evaluation tests whether models can connect molecular structures with experimental evidence to explain research findings, compare compounds, and predict their properties.
The benchmark draws on 117 published papers and patents and includes 761 distinct molecular structures across 99 problems.
At the xhigh reasoning setting, GPT-6 Astra earned 95.4 percent of the available credit for reconstructing molecular structures. However, the model earned only about half the available credit for selecting compounds and predicting their numerical properties.
The findings highlight a gap between identifying chemical structures correctly and understanding how changes to those structures influence a potential drug’s behavior.
Medicinal chemists routinely balance competing properties when developing drug candidates. A compound may effectively block a disease-related protein but perform poorly when absorbed by the body or break down too quickly.
Improving one characteristic can also weaken another, making it difficult to identify compounds that meet several requirements simultaneously.
MedChemBench evaluates four capabilities: molecular structure reconstruction, scientific reasoning, compound ranking and selection, and numerical property prediction.
One of its problems draws on research into inhibitors of PRMT5, a protein studied in cancer drug discovery.
Models receive molecular structures and experimental results from earlier stages of the research. They must predict how three related compounds will perform in terms of PRMT5 inhibition in cells, permeability across a cell barrier, and breakdown by liver enzymes.
Source link







