Monday, August 3, 2020

glorified auto-complete

Naturally, this performance improvement has triggered a great deal of introspection. Does GPT-3 understand English? Have we finally created artificial general intelligence, or is it just “glorified auto-complete”? Or, a third, more disturbing possibility: Is the human mind itself anything more than a glorified auto-complete?

- What Computer-Generated Language Tells Us About Our Own Ideological Thinking

One common way of dismissing GPT’s achievement is to categorize it as mere prediction, as opposed to true intelligence. The problem with this response is that all intelligence is prediction, at some level or another.

GPT stands for Generative Pretrained Transformer

see also GPT-3: Language Models are Few-Shot Learners by Grigory Sapunov

No comments: