CONNECT WITH US
Social Media

Social Media

Your Business Is Losing Money on AI You Don’t Control — Here’s Why.

Entrepreneur — Social Media logo

Published on

Add as a preferred source on Google
Your Business Is Losing Money on AI You Don’t Control — Here’s Why.

Every silent AI update breaks your workflow, and you pay your provider an 85% margin to fix what it broke.

As a big believer in a domesticated superintelligence, I can’t pass up the Cheeky Pint podcast where OpenAI CEO suggested it’s a terrible idea to keep processing your personal data on your personal computers because his company’s data centers could process your data more efficiently. He walked the remark back after immediate backlash.

It’s hard to recognize, yet your business likely lives in that world of centralization already. When using inference via API, you often rent access to a black box that shifts its behavior, pricing and reasoning effort without your knowledge or consent.

Ask yourself: how many times has your team asked for more budget due to inconsistent behavior from GPT or Claude? In Harvard Data Science Review, Stanford and UC Berkeley researchers Lingjiao Chen, Matei Zaharia and James Zou tested identical prompts on GPT-4 and GPT-3.5 across snapshots three months apart. GPT-4’s prime-number accuracy fell from 84.0% in March 2023 to 51.1% in June, while its chain-of-thought boost collapsed from 24.4% to -0.1%.

Everyday workflows suffered similar drops. On a happy-number task, GPT-4’s accuracy fell from 83.6% to 35.2%, while directly executable code plummeted from 52.0% to 10.0% because extra formatting broke pipelines. Instruction-following on answer extraction collapsed from 99.5% to 0.5% under the same model name and API.

2% of those drops exceeded 5 percentage points. 9% of the time even when overall accuracy rose.



Source link

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.