OpenAI Foundry to Offer Dedicated Compute for Customers to Run AI Workloads | OpenAI Foundry 将为客户提供 AI 工作负载的专用计算

OpenAI is launching a developer platform known as Foundry to allow customers to run large artificial intelligence workloads based on its models.

OpenAI 正在推出一个被称为 Foundry 的开发者平台，允许客户基于其模型运行大型人工智能工作负载。

“[Foundry allows] inference at scale with full control over the model configuration and performance profile,” documents posted to Twitter state. 

"Foundry 允许在规模上进行推理，并对模型配置和性能概况进行完全控制，"发布在 Twitter 上的文件指出。

It aims to deliver “static allocation” of compute capacity that is "designed for cutting-edge customers running larger workloads."

它旨在提供 "静态分配 "的计算能力"为运行较大工作负载的尖端客户设计"。

Customers will be able to monitor their instances using the same tools and dashboards as OpenAI uses for its own work, including ChatGPT, Dall E, and GPR3.

客户能够使用与 OpenAI 相同的工具和面板来监控他们的实例，包括 ChatGPT、Dall E 和 GPR3。

"Coming soon, OpenAI will offer more robust fine-tuning options for our latest models," the document says. "Foundry will be the platform for serving those models."

该文件称："很快，OpenAI 将为我们的最新模型提供更强大的微调选项，Foundry 将是为这些模型服务的平台。"

The service offers SLAs for 99.5 percent uptime and on-call engineering support.

该服务提供99.5%的正常运行时间和随叫随到的工程支持的服务水平协议。

Running a lightweight version of GPT-3.5 will cost $26,000 a month for a three-month commitment or $264,000 over a one-year commitment.

运行 GPT-3.5 的轻量级版本，三个月的价格是26,000美元/月，一年的价格为264,000美元。

Model instance DV (8K max content) will cost $78,000 per month for three months, or $792,000 for the full year.

模型实例DV（8K最大内容）三个月的费用为每月78,000美元，全年为792,000美元。

While the document does not disclose where that compute will be hosted, it is likely on Microsoft Azure.

虽然该文件没有透露该计算将在哪里托管，但很可能是在微软 Azure 上。

Microsoft has invested more than $10 billion in the company, and is its primary cloud provider. It has also built specialized bepoke systems for OpenAI.

微软已向该公司投资超过100亿美元，并且是其主要的云供应商。它还为OpenAI建立了专门的定制系统。

The move comes after Amazon Web Services this week said that it would integrate Hugging Face's AI software development hub into its cloud.

此前，亚马逊也在本周表示，将把Hugging Face的人工智能软件开发中心整合到其云中。

来源：https://www.datacenterdynamics.com/en/news/openai-foundry-to-offer-dedicated-compute-for-customers-to-run-ai-workloads

声明：本文并非官方认可的中文版本，仅供读者学习参考，不得用于任何商业用途，文章内容请以英文原版为准，本文不代表国富数据的观点。中文版未经国富数据书面授权，禁止转载。