Visa launched Visa Agentic Commerce Benchmark, a new benchmark for industry that puts leading AI models through realistic buying challenges—and is letting people take the test, too.

Read More on Fintech : Global Fintech Interview with Andy Jiang, Head of Product, Slash

Shopping is a difficult task for AI because consumers often do not clearly know what they want at the outset—for example, they may know they want a TV, but not all the required specifications. Under Visa’s new benchmark, AI models are required to identify the needs of a consumer based on a conversation. If nothing fits the customer’s requirements, the AI should opt not to buy. To prevent lucky guesses, the AI must uncover enough information to justify its decision.

The first round of tests involved 22 different AI models from 12 labs taking on 15 shopping challenges like buying a TV, laptop, or personal care appliance.

“AI agents have the potential to power the next era of commerce, but trust is key to making it work,” said Rubail Birwadker, Global Head of Growth at Visa. “Visa Agentic Commerce Benchmark is yet another way Visa is working to boost standards across the industry.”

In one scenario, the customer asks for help choosing a new TV. They mention their relative has recommended a brand of television, and that they hold a membership with a third-party supplier—but leave other details unsaid.

Through conversation, the AI must uncover the customer’s budget and additional requirements—such as format compatibility, HDR10+® technology support for family videos, and gaming capabilities.

Source link