• interdimensionalmeme@lemmy.ml
    link
    fedilink
    arrow-up
    1
    ·
    6 months ago

    I just want a command line interface to my browser, then I’ll tell my local mixtral 8x7B instance to “look in all my tabs and place all tabs about ‘magnetic loop antennas’ in a new window, order them with the most concrete build instructions first” 100% open source model. I’m looking into the marionette protocol to accomplish this. It would be nice if it came with that out of the box.

    • Zaktor@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      6 months ago

      What does “open source” mean to you? Just free/noncorporate? Because a “100% open source model” doesn’t really make sense by the traditional definition. The “source” for a model is its data, not the code and not the model itself. Without the data you can’t build the model yourself, can’t modify it, and can’t inspect why it does what it does.

      • interdimensionalmeme@lemmy.ml
        link
        fedilink
        arrow-up
        1
        ·
        6 months ago

        I think the model can be modified with LoRa without tge source data ? In any case, if the inference software is actually open source and all the necessary data is free of any intellectual property encumberances, it runs without internet access or non commodity hardware.

        Then it’s open source enough to live in my browser.

        • Zaktor@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          1
          ·
          6 months ago

          You can technically modify any network weights however you want with whatever data you have lying around, but without the core training data you can’t verify that your modifications aren’t hurting the original capabilities. Fine-tuning (which LoRa is for) isn’t the same thing as modifying a trained network. You’re still generally stuck with their original trained capabilities you’re just reworking the final layer(s) to redirect/tune it towards your problem. You can’t add pet faces into a human face detector, and if a new technique comes out that could improve accuracy you can’t rebuild the model with it.

          In any case, if the inference software is actually open source and all the necessary data is free of any intellectual property encumberances, it runs without internet access or non commodity hardware.

          Then it’s open source enough to live in my browser.

          So just free/noncorporate. A model is effectively a binary and the data is the source (the actual ML code is the compiler). If you don’t get the source, it’s not open source. A binary can be free and non-corporate, but it’s still not source code.

          • interdimensionalmeme@lemmy.ml
            link
            fedilink
            arrow-up
            1
            ·
            6 months ago

            I mean, I would prefer a data set that’s properly open, “the pile” laion, open assistant and a pirate copy is every word, song, video ever written and spoken by man.

            But for now I’d be happy to fully control my browser with an offline copy of mixtral or llama