The new system, detailed in a blog post by Google AI chief Demis Hassabis, incorporates significant architecture improvements that allow its core model, Gemini 1.5 Pro, to perform on par with the company’s largest Gemini 1.0 Ultra model while using less computing resources. The Gemini 1.0 Ultra model was introduced last week. However, the biggest leap comes in the form of an experimental million-token context window that Google says represents a “breakthrough in long-context understanding.” The standard Gemini model analyzes prompts within a 128,000 token context. With the million-token upgrade, Gemini 1.5 can process a vastly larger amount of continuous information before generating its response.
