• cynar@lemmy.world
    link
    fedilink
    English
    arrow-up
    33
    arrow-down
    1
    ·
    5 days ago

    Humans can turn information into knowledge. AI can only extract predigested knowledge. That’s why they need such large data sets.

    This is also why AGI is still a pipe dream. Most of the subsections already exist, but without a knowledge engine at its core, it’s like a person with a massive concussion. It sounds reasonable to simple conversation, but goes off on weird tangents.

    I always find it fascinating to watch children learn and grow. The mistakes they make are often completely logical, they just have holes in their knowledge, and lack critical information. It leads to wonderful conclusions, which are also completely wrong.

    • TranquilTurbulence@lemmy.zip
      link
      fedilink
      English
      arrow-up
      2
      ·
      4 days ago

      Oh, so that’s why the training part is so ridiculously inefficient. No amount of data is enough, and that sounds like a massive design flaw to me.

      • cynar@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        4 days ago

        It is. Unfortunately, no-one has come up with a viable self teaching system. They are trying to brute force it, but have run into a wall. Without a knowledge engine, you can’t close the loop. Without closing the loop, self reflection is impossible. Without self reflection, hallucination filtering is almost impossible. Such a system can’t understand the difference between a discussion down the pub, and a lawyer’s legal brief. It can see the difference, and mimic it’s structure, but not understand the why, and account for it.

        • TranquilTurbulence@lemmy.zip
          link
          fedilink
          English
          arrow-up
          2
          ·
          3 days ago

          Sounds like AGI isn’t going to happen any time soon when we have obstacles like that. I actually prefer it that way. Humanity isn’t anywhere near responsible or wise enough to wield that sort of power. Things have a tendency to go horribly wrong, and this one can go wrong in the worst way possible.