Monday, December 25, 2023

OpenAI Demos a Control Method for Superintelligent AI: The researchers asked GPT-2 to command the much more powerful GPT-4 - ELIZA STRICKLAND, IEEE Spectrum

One day, the theory goes, we humans will create AI systems that outmatch us intellectually. That could be great if they solve problems that we’ve been thus far unable to crack (think cancer or climate change), or really bad if they begin to act in ways that are not in humanity’s best interests, and we’re not smart enough to stop them. So earlier this year, OpenAI launched its superalignment program, an ambitious attempt to find technical means to control a superintelligent AI system, or “align” it with human goals. OpenAI is devoting 20 percent of its compute to this effort, and hopes to have solutions by 2027.