CONNECT WITH US
AI & Deeptech

AI & Deeptech

OpenAI built itself a new Git backend, too

TheNewStack (AI) - ArtificialIntelligence logo

Published on

Add as a preferred source on Google
OpenAI built itself a new Git backend, too

OpenAI on Monday detailed how it built a new Git backend for its monorepo to power the ever-increasing number of commits its developers and their agents now create.

Pando, as the team calls the new backend, cut push latency by nearly 5x, the company says, and it currently serves close to a petabyte of Git data per day at OpenAI.

OpenAI is obviously an early adopter of agentic coding tools. Compared to the first quarter of 2024, the quarterly commits to its monorepo will have increased by over 2,400% by the end of this year, the company says. But the issues it is facing are similar to what many other enterprises and Git forges like GitHub are now seeing.

With the pace of development increasing, Git itself is becoming a bottleneck. GitHub, for example, spent much of its recent Universe keynote on how it is improving its infrastructure to become faster and more reliable, all while serving billions of pull requests every month.

That has given rise to startups like Entire (from former GitHub CEO Thomas Dohmke) and projects like Origin from Cursor. Like OpenAI’s work, those are based on Git, but others, like Anthropic, basically start from scratch with a new client and architecture.

The OpenAI team explicitly notes that it wanted to retain compatibility with Git. The team was seeing the reliability of its Git backend fall below 90%, with slow fetches and failed merges, but decided to stay within the Git ecosystem.

” The answer for OpenAI was that the Git client and protocol weren’t really the problem (though the team is also making some tweaks there), but the way conventional Git servers are built.


Source link
Related Topics:AI & Deeptech

Disclaimer

We strive to uphold the highest ethical standards in all of our reporting and coverage. We TheMorningPulse.fyi want to be transparent with our readers about any potential conflicts of interest that may arise in our work. It's possible that some of the investors we feature may have connections to other businesses, including competitors or companies we write about. However, we want to assure our readers that this will not have any impact on the integrity or impartiality of our reporting. We are committed to delivering accurate, unbiased news and information to our audience, and we will continue to uphold our ethics and principles in all of our work. Thank you for your trust and support.