Greylock 出手 AI 新时代的基础设施 - Braintrust

Throughout history, every major technology wave has precipitated a new foundational infrastructure stack to maximize its potential. The transition to cloud computing brought about new database technologies like MongoDB, developer tooling like Github and Gitlab, and observability tools like Datadog, while the surge in web development catalyzed collaboration products like Figma. Now, as large language models (LLMs) are becoming a fundamental building block for new applications, we’re witnessing the rise of an infrastructure stack tailored for this AI-driven era.

纵观历史，每一次重大技术浪潮都催生了新的基础设施堆栈，以最大限度地发挥其潜力。向云计算的过渡带来了 MongoDB 等新的数据库技术、Github 和 Gitlab 等开发人员工具以及 Datadog 等可观测性工具，而 Web 开发的激增催化了 Figma 等协作产品。现在，随着大型语言模型 （LLM） 正在成为新应用程序的基本构建块，我们正在见证为这个 AI 驱动时代量身定制的基础设施堆栈的兴起。

One of the biggest challenges with LLM applications is that they are non-deterministic in how they behave. Enterprises cannot reliably predict the quality of a model-generated response, how a small change to prompt will affect the output, or whether the underlying model has changed. This can lead to inconsistent user behavior which significantly limits the potential of production AI. As such, AI builders need a new infrastructure toolkit to help evaluate, debug, test, and implement AI models in their products before they’re launched. Unlike prior generations of AI, where ML quality was a nice-to-have but not needed – with generative AI, you cannot ship a product to users without confidence in quality.

LLM 应用程序面临的最大挑战之一是它们的行为方式是不确定的。企业无法可靠地预测模型生成的响应的质量，无法预测对提示的微小更改将如何影响输出，也无法预测基础模型是否已更改。这可能导致不一致的用户行为，从而大大限制生产 AI 的潜力。因此，AI 构建者需要一个新的基础设施工具包，以帮助在产品发布之前评估、调试、测试和实施 AI 模型。与前几代 AI 不同，在前几代 AI 中，ML 质量是可有可无但不是必需的——使用生成式 AI，您不能在没有对质量有信心的情况下将产品交付给用户。

Today, we are thrilled to announce our seed investment in Braintrust, an enterprise-grade tool for rapidly and reliably evaluating AI. Braintrust offers developers a toolkit for instrumenting code and running evaluations, enabling teams to assess, log, refine, and enhance their AI-enabled products over time. In doing so, Braintrust becomes the nexus of the product development lifecycle for AI application developers. Crucially, Braintrust facilitates this within a customer’s cloud environment, ensuring it can be used for even their most data-sensitive tasks. In an AI landscape dominated by Twitter hype, we were struck by the quality of customers that have already adopted and standardized on Braintrust: leading applied AI companies like Zapier, Airtable, Coda, Instacart, and many more are building with Braintrust to bring their AI products to market.

今天，我们很高兴地宣布我们对 Braintrust 的种子投资，这是一款用于快速可靠评估 AI 的企业级工具。Braintrust 为开发人员提供了一个用于检测代码和运行评估的工具包，使团队能够随着时间的推移评估、记录、完善和增强其支持 AI 的产品。在此过程中，Braintrust 成为 AI 应用程序开发人员产品开发生命周期的纽带。至关重要的是，Braintrust 在客户的云环境中促进了这一点，确保它甚至可以用于他们最敏感的数据任务。在 Twitter 炒作主导的 AI 环境中，我们对已经采用并标准化 Braintrust 的客户质量感到震惊：Zapier、Airtable、Coda、Instacart 等领先的应用 AI 公司正在与 Braintrust 合作，将他们的 AI 产品推向市场。

We are fortunate to be partnering with Ankur Goyal, the founder and CEO of Braintrust, who has spent his career building products for builders. Ankur initially led the engineering team at SingleStore, then founded Impira (an ML platform for unstructured data), which was acquired by Figma where he stayed on to lead the AI platform. On a personal note, I’ve known Ankur for nearly 8 years and deeply admired his approach to company building, incredible customer centricity, and ability to cater to both developers and large enterprises. We – at Greylock – have wanted to partner with him for many years. We are delighted that we get to be part of Braintrust’s journey alongside outstanding co-investors like Elad Gil, Alana Goyal and Basecase, and a unique set of angel investors across CEO’s of some of the most forward-thinking technology companies including Clem Delangue, CEO of HuggingFace; Greg Brockman, Co-founder and President of OpenAI; Howie Liu, CEO at Airtable; Jack Altman, CEO of Lattice; Guillermo Rauch, CEO of Vercel; Simon Last, CTO at Notion; and Olivier Pomel, CEO at Datadog.

我们很幸运能与 Braintrust 的创始人兼首席执行官 Ankur Goyal 合作，他的职业生涯一直在为建筑商开发产品。Ankur 最初领导 SingleStore 的工程团队，然后创立了 Impira（一个用于非结构化数据的 ML 平台），该平台被 Figma 收购，他继续领导 AI 平台。就我个人而言，我认识 Ankur 将近 8 年了，我非常钦佩他的公司建设方法、令人难以置信的以客户为中心以及迎合开发人员和大型企业的能力。我们 - 在Greylock，多年来一直希望与他合作。我们很高兴能与Elad Gil、Alana Goyal和Basecase等杰出的共同投资者以及一些最具前瞻性的科技公司首席执行官的独特天使投资人一起成为Braintrust旅程的一部分，包括HuggingFace首席执行官Clem Delangue;OpenAI 联合创始人兼总裁 Greg Brockman;Airtable 首席执行官 Howie Liu;Jack Altman，莱迪思首席执行官;Vercel首席执行官吉列尔莫·劳赫（Guillermo Rauch）;Simon Last，Notion 首席技术官;以及 Datadog 首席执行官 Olivier Pomel。

Braintrust joins a distinguished set of companies that Greylock has partnered with from the early stages and have gone on to create and disrupt large enterprise software markets, such as Abnormal Security, AppDynamics, Figma, Okta, Palo Alto Networks, Workday, and many more. If you’re interested in using Braintrust, you can sign up for free and get started here, and if you’re interested in joining the team, see the open roles here.

Braintrust加入了Greylock从早期阶段就与之合作的一系列杰出公司，并继续创建和破坏大型企业软件市场，例如Abnormal Security，AppDynamics，Figma，Okta，Palo Alto Networks，Workday等等。如果您有兴趣使用 Braintrust，可以免费注册并在此处开始使用，如果您有兴趣加入团队，请参阅此处的空缺职位。

Translated by Microsoft via WeChat.