Just a guy doing stuff.

  • 0 Posts
  • 22 Comments
Joined 1 year ago
cake
Cake day: June 14th, 2023

help-circle



  • Hexarei@programming.devtoFunny@sh.itjust.worksIt's so over
    link
    fedilink
    arrow-up
    3
    arrow-down
    1
    ·
    5 months ago

    Analysis. It uses it, but not by “matching it”. The training data is not included in the final model. No GPT can access its training data at runtime.

    Training analyzes the contents of the training data and creates a statistical model representing the likelihoods of various tokens based on a complex series of mathematical transformations that encode various attributes of the tokens making up the training data.

    3Blue1Brown has a great series on the actual math behind it, I would highly recommend educating yourself on what GPTs actually do. It’s way more interesting than simple matching.


  • Hexarei@programming.devtoFunny@sh.itjust.worksIt's so over
    link
    fedilink
    arrow-up
    2
    arrow-down
    1
    ·
    edit-2
    5 months ago

    You said it matches text to its training data, which it does not do.

    Your single-phrase statement only works for very short, non-repetitive phrases. As soon as your phrase repeats a token more than a few times, the statistics for the tokens change and could result in nonsensical output that repeats through subsections of the training data.

    And even then for that single non-repetitive phrases, the reason you would get that single phrase back is not because it would be “matching on” the phrase. It is because the token weights would effectively encode that the statistical likelihood of the “next token” in the generated output is 100% for a given token when the evaluated token precedes it in the training phrase. Or in other words: Your training data being a single phrase maniplates the statistics so that the most likely output is that single phrase.

    However, that is a far cry from simple “matching” against the training data. Which is what you said it does.


  • Hexarei@programming.devtoFunny@sh.itjust.worksIt's so over
    link
    fedilink
    arrow-up
    4
    arrow-down
    2
    ·
    5 months ago

    They do not store anything verbatim; They instead store the directions in which various words and related concepts relate to one another in some gigantic multidimensional space.

    I highly suggest you go learn what they actually do before you continue talking out of your ass about them






  • Yep, as someone who just recently setup a hyperconverged mini proxmox cluster running ceph for a kubernetes cluster atop it, storage is hard to do right. Wasn’t until after I migrated my minor services to the new cluster that I realized that ceph’s rbd csi can’t be used by multiple pods at once, so having replicas of something like Nextcloud means I’ll have to use object storage instead of block storage. I mean. I can do that, I just don’t want to lol. It also heavily complicates installing apps into Nextcloud.






  • Hexarei@programming.devtoSelfhosted@lemmy.worldWhy docker
    link
    fedilink
    English
    arrow-up
    19
    ·
    10 months ago

    Others have addressed the root and trust questions, so I thought I’d mention the “mess” question:

    Even the messiest bowl of ravioli is easier to untangle than a bowl of spaghetti.

    The mounts/networks/rules and such aren’t “mess”, they are isolation. They’re commoditization. They’re abstraction - Ways to tell whatever is running in the container what it wants to hear, so that you can treat the container as a “black box” that solves the problem you want solved.

    Think of Docker containers less like pets and more like cattle, and it very quickly justifies a lot of that stuff because it makes the container disposable, even if the data it’s handling isn’t.