Source: MishTalk, Sep 2023
<original research article>
ChatGPT can generate ides far faster than humans. This gives them a huge edge in coming up with a few great ideas. For this study the professors gave ChatGPT and the students the same prompt.
Do LLMs Enhance Productivity in Generating Ideas?
The answer to this question is straightforward. ChatGPT-4 is very efficient at generating ideas. This question does not require much precision to answer. Two hundred ideas can be generated by one human interacting with ChatGPT-4 in about 15 minutes. A human working alone can generate about five ideas in 15 minutes (Girotra et al., 2010). Humans working in groups do even worse. In short, the productivity race between humans and ChatGPT is not even close.
For the focused idea generation task itself, a human using ChatGPT-4 is thus about 40 times more productive than a human working alone.
Chat-GPT generated the best-rated idea in our sample, with an 11% higher purchase probability than the best human idea.
The average quality of the top decile in each of the three pools also follows the same pattern as average quality— seeded Chat-GPT ≻ ChatGPT ≻ Humans.
Overall, we have 400 ideas, with an equal number generated by ChatGPT and humans. In the top 40 ideas (top decile) a full 35 (87.5%) are those generated by ChatGPT.
Delightful & Distinctive COLRS 