Hyderabad: Billionaire Elon Musk artificial intelligence(AI) startup xAI’s latest Grok-1.5, advanced version of Grok chatbot, will be available on his social media platform X next week, Musk announced in a post on X on Friday.
Musk even claimed that Grok 2 is also in training for now and will exceed current AI on all metrics. "Grok 2 should exceed current AI on all metrics. In training now," Musk said.
Capabilities and Reasoning
The company, in a blog, said that one of the most notable improvements in Grok-1.5 is its performance in coding and math-related tasks. In a test, Grok-1.5 achieved a 50.6% score on the MATH benchmark and a 90% score on the GSM8K benchmark, two math benchmarks covering a wide range of grade school to high school competition problems, xAI said. The company also informed that the chatbot scored 74.1% on the HumanEval benchmark, which evaluates code generation and problem-solving abilities.
Long Context Understanding
The company said that the advanced version of Grok, boasts of a new feature that is the capability to process long contexts of up to 128K tokens within its context window. This allows Grok to have an increased memory capacity of up to 16 times the previous context length, enabling it to utilise information from substantially longer documents.