US AI Safety Institute Collaborates with OpenAI and Anthropic for AI Model Testing
The U.S. Department of Commerce’s National Institute of Standards and Technology (NIST) has entered a partnership with prominent AI developers OpenAI and Anthropic to establish a formal collaboration with the U.S. AI Safety Institute (AISI). This collaboration will allow the Institute to evaluate the capabilities and safety risks of the respective AI models developed by these companies.
Formal Collaboration with Top AI Developers
The U.S. AI Safety Institute has signed agreements with OpenAI and Anthropic to receive access to major new AI models before and after their public release. OpenAI offers ChatGPT while Anthropic is working on developing Claude.
- The Institute will assess the safety risks and capabilities of the AI models
- Elizabeth Kelly, the agency director, emphasized the importance of safety in driving technological innovation
Technical Collaborations and Future Milestones
Elizabeth Kelly mentioned that these agreements mark the beginning of technical collaborations with Anthropic and OpenAI to advance AI safety. She highlighted the significance of responsible stewardship in shaping the future of AI. Jack Clark, co-founder of Anthropic, expressed excitement about the pre-deployment test with the U.S. AISI, emphasizing the critical role of third-party testing in the AI ecosystem.
- The agreements are crucial for promoting AI safety and innovation
- Anthropic and OpenAI are looking forward to the collaboration
Implications for AI Industry
The issue of AI safety has become a priority within the industry, leading to the formation of safety institutes and the departure of experts from certain organizations due to ethical concerns. Governments are also taking proactive measures to regulate AI development, as seen in the creation of the AISI in response to an Executive Order by President Biden.
- The AISI Consortium includes major tech firms like Google, Apple, and Microsoft
- Governments are collaborating to share insights and findings on AI safety
Hot Take: Collaborative Efforts for AI Safety
In a rapidly evolving technological landscape, collaborations between industry players and regulatory bodies are essential to ensure the safe and responsible development of AI technologies. The partnership between the U.S. AI Safety Institute, OpenAI, and Anthropic signifies a proactive approach towards evaluating the safety risks and capabilities of AI models, setting a precedent for future collaborations in the field of AI safety. As we navigate the complexities of AI development, such collaborations will play a pivotal role in shaping the ethical and responsible use of artificial intelligence in society.
Sources:
By
By