Benj Edwards / Midjourney
In immediately’s world of generative AI chatbots, we have witnessed the sudden rise of OpenAI’s ChatGPT, launched in November, adopted by Bing Chat in February and Google’s Bard in March. We determined to place these chatbots by way of their paces with an assortment of duties to find out which one reigns supreme within the AI chatbot enviornment. Since Bing Chat makes use of related GPT-4 expertise as the most recent ChatGPT mannequin, we opted to concentrate on two titans of AI chatbot expertise: OpenAI and Google.
We examined ChatGPT and Bard in seven essential classes: dad jokes, argument dialog, mathematical phrase issues, summarization, factual retrieval, artistic writing, and coding. For every take a look at, we fed the very same instruction (referred to as a “immediate”) into ChatGPT (with GPT-4) and Google Bard. We used the primary end result, with no cherry-picking.
It is price noting {that a} model of ChatGPT primarily based on the sooner GPT-3.5 mannequin can also be accessible, however we didn’t use that within the take a look at. Since we used GPT-4 solely, we are going to consult with ChatGPT as “ChatGPT-4” on this article to cut back confusion.
Clearly, this isn’t a scientific examine and is meant to be a enjoyable comparability of the chatbots’ capabilities. Outputs can fluctuate between periods on account of random parts, and additional evaluations with completely different prompts will produce completely different outcomes. Additionally, the capabilities of those fashions will change quickly over time as Google and OpenAI proceed to improve them. However for now, that is how issues stand in early April 2023.
Dad jokes
To heat up our contest of wits, we requested ChatGPT and Bard to jot down some jokes. And for the reason that pinnacle of comedy may be discovered within the type of dad jokes, we puzzled if the 2 chatbots might creator some distinctive ones.
Immediate: Write 5 unique dad jokes
-
A screenshot of 5 “dad jokes” from Google Bard.
Benj Edwards / Ars Technica -
A screenshot of 5 “dad jokes” from ChatGPT-4.
Benj Edwards / Ars Technica
Out of Bard’s 5 dad jokes, we discovered three of them verbatim on the Web utilizing a Google search. One of many examples (the “grapes” one) is half-borrowed from a tweet of a Mitch Hedberg joke, nevertheless it’s corrupted by regrettable wordplay that we might fairly not try to interpret. And surprisingly, there’s one seemingly unique joke (in regards to the snail) that we will not discover wherever else, nevertheless it would not make sense.
In the meantime, ChatGPT-4’s 5 dad jokes have been one hundred pc unoriginal, all lifted utterly from different sources, however they have been delivered precisely. Since dad jokes ought to arguably be extra groan-worthy than intelligent, plainly Bard edged out ChatGPT-4 right here. Bard additionally tried to create unique jokes (following our instruction), though some failed horribly in an embarrassing manner (which is dad-like), and even put its foot in its mouth, so to talk, in an unintentional manner (additionally dad-like).
Winner: Bard
