A new study suggests that so-called emergent abilities actually develop gradually and predictably, depending on how you measure them.

So-called “emergent” behavior in LLMs may not be the breakthrough that researchers think.

  • NounsAndWords@lemmy.worldEnglish
    121·
    4 months ago

    Emergent behavior is pretty much anything an old model couldn’t do that a new model can. Simple reasoning, creating coherent sentences, “theory of mind”, basic math, translation, I think are a few examples.

    They aren’t “amazing” in the sense that a human can’t do them, but they are in the sense that a computer is doing it.

    • just another dev@lemmy.my-box.devEnglish
      5·
      4 months ago

      They aren’t “amazing” in the sense that a human can’t do them, but they are in the sense that a computer is doing it.

      … without specifically being trained for it, to be precise.