xAIn has just rolled out an upgrade on its Grok chatbot which features enhanced reasoning, especially when performing math-related tasks, increased contextual logic, and overall performance boosts.
The xAIn company claims that its new version of Grok will place the said chatbot on par with existing market offerings and even surpass them on several performance benchmarks.
As stated by xAIn:
So, the forte of Grok-1.5 turns out to be in coding and math-related jobs. In the benchmark tests conducted, Grok-1.5 scores 50.6% on the MATH benchmark and 90% on GSM8K, a benchmark that exercises a broad set of grade school to high school competition math problems. Also, it scored 74.1% on the benchmarked HumanEval, which assesses code generation as well as problem-solving abilities.
Therefore, Grok needs to be able to come up with more intelligent, quicker answers on much more tasks. And, concurrently, I would like to have the statistics regarding how many people are actually utilizing Grok nowadays.
Launched in November but long in development, Grok is X's response to ChatGPT- where users can ask the bot questions and receive generated answers.
It places Grok in "Fun Mode," where sassier answers return, and Elon and Co. think that is a differentiator.
Well, that and Grok isn't "woke," which every other AI chatbot is, according to Musk, while Grok is also the only chatbot powered by real-time posts on X, which should provide that sort of up-to-the-minute context, etc.
Thus, theoretically Grok should be better at some tasks than other chatbots, and once again, Grok doesn't have the same level of computer power as the computer-simulated minds of either ChatGPT or Gemini or Meta's Llama-powered models.
So is Grok any good?
Well we don't actually know, since Grok access has thus far only been open to X Premium+ subscribers, of whom there are, like, very few.
X Premium has less than a million subscribers, and that counts everybody paying $8 and $3 monthly for the normal and the basic packages. A very few pay $16 a month for the Premium+, and consequently, there aren't many people that could even reach the bot to share their experience.
X is trying to change this, though, as it's making Grok available to all Premium subscribers while also gifting Premium to highly followed users.
That ideally should get things going with Grok, perhaps bringing more to the chatbot. More usage would, however, bring to light more errors and issues, which could also expose the flaws within the Grok system.
Which we've seen with every other chatbot. ChatGPT has had several major bugs that have necessitated code changes, whereas Gemini's effort to maximize diversity in its answers has resulted in many inaccuracies and problems. Meta's AI tools have been tested with "contentious" questions as well, and much of that has come from expanded access and use.
Which probably means that Grok will face the same, but we haven't yet seen the same problems with the tool because a relatively small number of people can access it.
That'll change soon, and it will be interesting to see how Grok and X handle these concerns with the tool.
But on the other hand, Grok needs to start generating revenue. xAI has reportedly spent tens of millions of dollars purchasing hardware for the project, in an effort to carve a piece out of the AI race, starting with OpenAI.
Because Elon is angry with OpenAI for not wanting him to be its chief. After he becomes one of the initial investors on the project, Elon offers to become the chief-which they also rejected OpenAI team. Now OpenAI is a for-profit project and Musk is annoyed in that they take his initial donation to the company without paying him back and rebuffed him.
So now he wants xAI, and Grok, to beat OpenAI. Which means Grok also has to bring in users, and revenue.
Which it's not yet.
Will those new expansions change that?
xAI says that Grok-1.5 will be made available very soon.