Superalignment: OpenAI tries to Ensure Super-intelligence Alignment with Human Intent
oknoob.substack.com
OpenAI has identified super-intelligence as the most significant and potentially dangerous technology that could be developed, and is emphasizing its alignment with human intent as a vital issue. While current techniques for aligning AI systems, like reinforcement learning from human feedback, rely on human supervision, these techniques are not scalable for superintelligence. OpenAI proposes to develop an automated alignment researcher with human-level capabilities, which can then be scaled up.
Superalignment: OpenAI tries to Ensure Super-intelligence Alignment with Human Intent
Superalignment: OpenAI tries to Ensure…
Superalignment: OpenAI tries to Ensure Super-intelligence Alignment with Human Intent
OpenAI has identified super-intelligence as the most significant and potentially dangerous technology that could be developed, and is emphasizing its alignment with human intent as a vital issue. While current techniques for aligning AI systems, like reinforcement learning from human feedback, rely on human supervision, these techniques are not scalable for superintelligence. OpenAI proposes to develop an automated alignment researcher with human-level capabilities, which can then be scaled up.