• NCSK@lemmy.world
    link
    fedilink
    arrow-up
    0
    ·
    1 month ago

    Isn’t this actually kinda what AI is good for? I mean a simple task that just takes time and has step-by-step instructions, and you can just let it handle it and do it faster. Like its almost as good as writing a long script that just does it for the user?

    • Mikina@programming.dev
      link
      fedilink
      arrow-up
      0
      ·
      1 month ago

      As someone who had his relatively fine and deterministic scripts replaced by skill.md bullshit by coworkers – no. This is exactly the things AI is the worst fit for.

      We’ve already ran into it halucinating complete result data-set, because it ran into an error but the skill mentioned that it should give the results data to the user. So it just made it up, since it couldn’t get it by following the correct process.

      It has also ran wrong builds or input parameters, because it confused their order.

      I’ve also seen it skip a step.

      I’m pretty confident that the AI running this script will eventually, for someone, run into an issue with getting one of the dependencies, and go on a wild goose chase in trying to satisfy it, eventually running into one of the typosquatting malware repositories or clones. Not to mention that there are groups that are actively poisoning AIs that search the web to feed them their malware-ridden typosquatting libraries instead.

      If you suck so much you can’t write a simple script like this (or just can’t be bothered), you should at least just ask the AI to write it for you, so you have a deterministic set of steps that you are confident will always behave the same.