Is Google Gemini AI ChatGPT's New Competition?

Gemini's Benchmark Performance

According to recent performance tests, Gemini Ultra outperformed GPT-4V in 30 out of 32 benchmark tests

Massive Multitask Language Understanding (MMLU)

Gemini Ultra's impressive 90% score in MMLU, covering 57 subjects, compared to GPT-4V's 86.4%

Reasoning Abilities

Gemini Ultra's 83.6% score in Big-Bench Hard benchmark, demonstrating superior multi-step reasoning tasks compared to  GPT-4V

Reading Comprehension

Gemini Ultra's outstanding reading comprehension benchmark, surpassing GPT-4V's shot capability in a similar scenario

Math Skills

Gemini Ultra's 94.4% score in basic arithmetic manipulations, outshining GPT-4V's 92.0% in mathematical tasks

Check Out the Highest Paying AI Career Choices in 2024

Discover Other Google AI like Google Bard