{"id":26321,"date":"2024-08-29T20:10:07","date_gmt":"2024-08-29T20:10:07","guid":{"rendered":"http:\/\/108027276"},"modified":"2024-08-29T20:10:07","modified_gmt":"2024-08-29T20:10:07","slug":"openai-and-anthropic-agree-to-let-u-s-ai-safety-institute-test-and-evaluate-new-models","status":"publish","type":"post","link":"https:\/\/wp.worldtechguide.net\/openai-and-anthropic-agree-to-let-u-s-ai-safety-institute-test-and-evaluate-new-models\/","title":{"rendered":"OpenAI and Anthropic agree to let U.S. AI Safety Institute test and evaluate new models"},"content":{"rendered":"<p><span class=\"HighlightShare-hidden\"><\/span><\/p>\n<div class=\"InlineImage-imageEmbed\" id=\"ArticleBody-InlineImage-108027297\" data-test=\"InlineImage\">\n<div class=\"InlineImage-wrapper\">\n<div>\n<p>Jakub Porzycki | Nurphoto | Getty Images<\/p>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"group\">\n<p>OpenAI and Anthropic, the two most richly valued artificial intelligence startups, have agreed to let the U.S. AI Safety Institute test their new models before releasing them to the public, following increased concerns in the industry about safety and ethics in AI.<\/p>\n<p>The institute, housed within the Department of Commerce at the National Institute of Standards and Technology (NIST), said in a <span class=\"waslinkname\">press release<\/span> that it will get &#8220;access to major new models from each company prior to and following their public release.&#8221; <\/p>\n<p>The group was established after the Biden-Harris administration issued the U.S. government&#8217;s <span class=\"waslinkname\">first-ever executive order<\/span> on&nbsp;<span class=\"waslinkname\">artificial intelligence<\/span> in October 2023, requiring new safety assessments, equity and civil rights guidance and research on AI&#8217;s impact on the labor market.<\/p>\n<p>&#8220;We are happy to have reached an agreement with the US AI Safety Institute for pre-release testing of our future models,&#8221; OpenAI CEO Sam Altman wrote in a <span class=\"waslinkname\">post<\/span> on X. OpenAI also confirmed to CNBC on Thursday that, in the past year, the company has doubled its number of weekly active users to 200 million. <span class=\"waslinkname\">Axios<\/span> was first to report on the number.<\/p>\n<p>The news comes a day after reports surfaced that OpenAI is in talks to raise a funding round valuing the company at <span class=\"waslinkname\">more than $100 billion<\/span>. Thrive Capital is leading the round and will invest $1 billion, according to a source with knowledge of the matter who asked not to be named because the details are confidential.<\/p>\n<p>Anthropic, founded by ex-OpenAI research executives and employees, was most recently valued at $18.4 billion. Anthropic counts <span class=\"QuoteInBody-quoteNameContainer\" data-test=\"QuoteInBody\" id=\"RegularArticle-QuoteInBody-7\"><span class=\"waslinkname\">Amazon<\/span><span class=\"QuoteInBody-inlineButton\"><span class=\"AddToWatchlistButton-watchlistContainer\" id=\"-WatchlistDropdown\" data-analytics-id=\"-WatchlistDropdown\"><button class=\"AddToWatchlistButton-watchlistButton\" aria-label=\"Add To Watchlist\" data-testid=\"dropdown-btn\"><span class=\"AddToWatchlistButton-addWatchListFromTag\"><\/span><\/button><\/span><\/span><\/span> as a leading investor, while OpenAI is heavily backed by <span class=\"QuoteInBody-quoteNameContainer\" data-test=\"QuoteInBody\" id=\"RegularArticle-QuoteInBody-8\"><span class=\"waslinkname\">Microsoft<\/span><span class=\"QuoteInBody-inlineButton\"><span class=\"AddToWatchlistButton-watchlistContainer\" id=\"-WatchlistDropdown\" data-analytics-id=\"-WatchlistDropdown\"><button class=\"AddToWatchlistButton-watchlistButton\" aria-label=\"Add To Watchlist\" data-testid=\"dropdown-btn\"><span class=\"AddToWatchlistButton-addWatchListFromTag\"><\/span><\/button><\/span><\/span><\/span>. <\/p>\n<p>The agreements between the government, OpenAI and Anthropic &#8220;will enable collaborative research on how to evaluate capabilities and safety risks, as well as methods to mitigate those risks,&#8221; according to Thursday&#8217;s <span class=\"waslinkname\">release<\/span>.<\/p>\n<p>Jason Kwon, OpenAI&#8217;s chief strategy officer, told CNBC in a statement that, &#8220;We strongly support the U.S. AI Safety Institute&#8217;s mission and look forward to working together to inform safety best practices and standards for AI models.&#8221; <\/p>\n<p>Jack Clark, co-founder of Anthropic, said the company&#8217;s &#8220;collaboration with the U.S. AI Safety Institute leverages their wide expertise to rigorously test our models before widespread deployment&#8221; and &#8220;strengthens our ability to identify and mitigate risks, advancing responsible AI development.&#8221;<\/p>\n<p>A number of AI developers and researchers <span class=\"waslinkname\">have expressed concerns<\/span> about safety and ethics in the increasingly for-profit AI industry. Current and former OpenAI employees&nbsp;<span class=\"waslinkname\">published an open letter<\/span>&nbsp;on June 4, describing potential problems with the rapid advancements taking place in AI and a lack of oversight and whistleblower protections.<\/p>\n<p>&#8220;AI companies have strong financial incentives to avoid effective oversight, and we do not believe bespoke structures of corporate governance are sufficient to change this,&#8221; they wrote. AI companies, they added, &#8220;currently have only weak obligations to share some of this information with governments, and none with civil society,&#8221; and they can not be &#8220;relied upon to share it voluntarily.&#8221;<\/p>\n<p>Days after the letter was published, a source familiar to the mater confirmed to CNBC that the FTC and the Department of Justice were&nbsp;<span class=\"waslinkname\">set to open antitrust investigations<\/span>&nbsp;into&nbsp;OpenAI, Microsoft and&nbsp;<span class=\"waslinkname\">Nvidia<\/span>. FTC Chair Lina Khan has&nbsp;<span class=\"waslinkname\">described<\/span>&nbsp;her agency&#8217;s action as a &#8220;market inquiry into the investments and partnerships being formed between AI developers and major cloud service providers.&#8221;<\/p>\n<p>On Wednesday, California lawmakers <span class=\"waslinkname\">passed<\/span> a hot-button AI safety bill, sending it to Governor Gavin Newsom&#8217;s desk. Newsom, a Democrat, will decide to either veto the legislation or sign it into law by Sept. 30. The bill, which would make safety testing and other safeguards mandatory for AI models of a certain cost or computing power, has been contested by some tech companies for its potential to slow innovation.<\/p>\n<p><strong>WATCH:<\/strong> <span class=\"waslinkname\">Google, OpenAI and others oppose California AI safety bill<\/span><\/p>\n<\/div>\n<div role=\"region\" aria-labelledby=\"Placeholder-ArticleBody-Video-108024378\">\n<div role=\"button\" id=\"Placeholder-ArticleBody-Video-108024378\" class=\"PlaceHolder-wrapper\" data-vilynx-id=\"7000349538\" data-test=\"VideoPlaceHolder\">\n<div class=\"InlineVideo-videoEmbed\" id=\"InlineVideo-0\" data-test=\"InlineVideo\">\n<div class=\"InlineVideo-wrapper\">\n<div class=\"InlineVideo-inlineThumbnailContainer\"><img decoding=\"async\" class=\"InlineVideo-videoThumbnail\" src=\"https:\/\/wp.worldtechguide.net\/wp-content\/uploads\/2024\/08\/openai-and-anthropic-agree-to-let-u-s-ai-safety-institute-test-and-evaluate-new-models.jpg\" alt=\"Google, OpenAI &amp; others oppose California AI safety bill\"><span class=\"InlineVideo-videoButton\"><\/span><span><\/span><\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Jakub Porzycki | Nurphoto | Getty Images OpenAI and Anthropic, the two most richly valued artificial intelligence startups, have agreed to let the U.S. AI Safety Institute test their new models before releasing them to the public, following increased concerns in the industry about safety and ethics in AI. The institute, housed within the Department &hellip;<\/p>\n","protected":false},"author":1,"featured_media":26322,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8],"tags":[],"hashtags":[],"class_list":["post-26321","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-tech","has-thumb","has-featured"],"_links":{"self":[{"href":"https:\/\/wp.worldtechguide.net\/wp-json\/wp\/v2\/posts\/26321"}],"collection":[{"href":"https:\/\/wp.worldtechguide.net\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/wp.worldtechguide.net\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/wp.worldtechguide.net\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/wp.worldtechguide.net\/wp-json\/wp\/v2\/comments?post=26321"}],"version-history":[{"count":0,"href":"https:\/\/wp.worldtechguide.net\/wp-json\/wp\/v2\/posts\/26321\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/wp.worldtechguide.net\/wp-json\/wp\/v2\/media\/26322"}],"wp:attachment":[{"href":"https:\/\/wp.worldtechguide.net\/wp-json\/wp\/v2\/media?parent=26321"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/wp.worldtechguide.net\/wp-json\/wp\/v2\/categories?post=26321"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/wp.worldtechguide.net\/wp-json\/wp\/v2\/tags?post=26321"},{"taxonomy":"hashtags","embeddable":true,"href":"https:\/\/wp.worldtechguide.net\/wp-json\/wp\/v2\/hashtags?post=26321"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}