• trevor@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    9
    arrow-down
    3
    ·
    12 hours ago

    I had zero interest in downloading this shit before because LLMs are just lying slop machines, but if it becomes illegal, I will go out of my way to.

    • BreadstickNinja@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      11 hours ago

      I’m with you on principle, but the thing is also like 600 GB of data. Not sure I have the disk space to take a stand on this one.

      • trevor@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        2
        ·
        11 hours ago

        No worries. I’ve got some 20TB drives i can throw these on 😁

        Now, running a model that large… Well, I’ll just have to stick with the 8-13b params.

        • Pup Biru@aussie.zone
          link
          fedilink
          English
          arrow-up
          1
          ·
          5 hours ago

          you can actually run the model, but it just goes very slowly… i run the 70b model on my m1 mbp, and it technically “requires” 128gb or VRAM - it still runs, just not super fast (though i’d say it’s useable in this case a about 1 word per ~300ms)