Skip Navigation
Discussion of llama source code

where can i go to learn about and discuss facebook's llama 2 source code? there aren't many comments in the code.

1
Google engineers want to make ad-blocking (near) impossible
  • this is what i'm frustrated with. why do all these engineers let themselves be told what to do even if it makes a worse-functioning tool? that's not real engineering.

    "because they'll get fired"

    not if enough of them do the thing that should've been what got them interested in engineering in the first place.

    maybe we shouldn't call them engineers, but something else relating to being the one who does the dirty work for institutions that aim to steal people's attention and decrease their quality of life.

    and if they do get fired, then they should join together and make the reasonable company that makes good tools for human use.

  • Welp that answers a lot of why all .ml are down
  • ok, you make good points, but i feel like the algorithm could work to not have the system grind to a halt. i'd have to look at other examples where this has been done. but maybe i am overly-optimistic and it's not possible.

    who would pay for those nodes you are querying

    the people who are already running nodes, like lemmy.world, lemmy.ml, me, etc. i run some services on my home server that i let anyone use, because i have the hardware and the bandwidth to be able to afford it. there are enough people who have the necessary hardware and bandwidth to contribute to it at minimal detriment to them. it's already an open-source project where people volunteer their time to code it.

    i'll read up on oxen network.

    in an anonymous way

    wait who said anything about anonymous? what are talking about being anonymous? there would still be user accounts.

    if I don’t want to aggregate all the posts in the world by myself (as you are suggesting), then I’ll have to fine someone to do it for me

    this is already what is done, except that the data is not stored in a replicated and distributed manor. you get all the posts in the world of a community of an instance. it is one server, with all the data stored on its harddrive, like a traditional website. in what i'm proposing, this is also what would happen in many cases, because the thing wouldn't requery the entire network every time you request posts, there would be a time threshold, like how posts are cached on your local mobile device for most social media apps. posts would be cached on the server.

    now, yes, this architecture would in fact result in more network traffic occurring between each and every node, as they receive updates about events on other nodes. so that would be extra burden upon the hosts. but i believe it is something we can work through.

  • Welp that answers a lot of why all .ml are down
    1. you connect to some lemmy instance on your web browser
    2. the client application (lemmy web app) authenticates your login credentials by first checking its own user database, if it doesn't find you (which it should because by default you'd be connecting to an instance that you've already used, and if done through a mobile app for example it would automatically find the best instance to use by lowest latency), it send out a message to the nodes(instances) that it knows about, searching for your user, recursively, when found, sent back and stored in each node that was part of the searching. (there'd be some threshold of tree depth so the unsuccessful branches don't keep going forever, and some other algorithmic details to prevent redundant network activity)
    3. you navigate to your subscribed communities feed, lemmy shows you the posts that are already on the node that you are directly connected to, then asynchronously sends out a request to the surrounding nodes to pull more posts from those communities, recursively reaching out to adjacent nodes, again avoiding repeatedly hitting the same node via algorithmic details which we can discuss further if you wish, sending back the info up the tree to your primary node. now a bunch of servers have duplicated community data, like a distributed storage system, but you, the user, don't know about all that stuff that just happened behind the scenes. your GUI is updated accordingly
    4. now you can interact with these posts, make new posts, and each interaction will be sent out to all the relevant nodes in a reverse process.
    5. another user on the other end can visit some community that you just posted to, and a request will again be propagated through the network, but starting from his node, and eventually reaching some node that has your new post.

    the advantages of this:

    • if a node goes down, not all of the community and user data is lost, because its neighbor nodes have replicated the data
    • if i am hosting a node, and have limited bandwidth and storage, i can specify limits so that my network is not unintentionally DoSed. so this implies that when the prior-described processes are occurring, some instances will not store the data they are pushing through, which is fine, and one of the intended features of this distributed architecture
    • similar to previous point, each instance can have a whitelist or blacklist of communities (for either storage and/or data passing), defined by the admin, if he/she wishes to tailor the content for example to keep it related to content they are interested in rather than being forced to serve everyone on the network. it's like if someone wants to help a little bit but they don't have all the bandwidth and storage in the world, they can, instead of having to handle traffic for a bunch of irrelevant-to-them communities.
  • Welp that answers a lot of why all .ml are down
  • you want to strip all that out

    i do not want to strip out the functionality of communities having mods that moderate the discourse and ban malicious users etc. it sounds like you misunderstood what i was proposing.

  • Welp that answers a lot of why all .ml are down
  • This is all different when building a social network

    wait you want censorship in a social network? also, the architecture i'm describing does not do away with moderation and social structure. what about it makes you think that to be the case?

  • People are getting fed up with all the useless tech in their cars — For the first time in 28 years of JD Power’s car owner survey, there is a consecutive year-over-year decline in satisfaction, wit...
  • so this is why i think that reasonable engineers (and most actual engineers are reasonable, hence being an "engineer") should get together and make good stuff. stuff that is not corrupted by perverse incentives. an engineer is capable of understanding the flaws of an economy and how that can be detrimental to the functionality of some tool or system.

  • Welp that answers a lot of why all .ml are down
  • to expound:

    the tankie instance or the nutballs on the fascist instance

    here you reveal a conceptual misunderstanding, or rather, a part of the lemmy architecture which i disagree with. there shouldn't be a concept of a "interest X instance" etc. it should be similar to a distributed storage model. so the concept of a community is not per-instance, it's just an abstract thing that exists in conceptual space.

  • important message to google, samsung, all android phone manufactures
  • sorry man i guess people will just never learn how the voting system works (i upvoted you). i obviously understand some people like big phones, phablets, if you will. and that's fine. i still use my phablet for media and stuff.

  • General Programming Discussion @lemmy.ml LordShrek @lemmy.world
    let's design the programmer's numpad

    i'm going to design and build a "programmer's numpad", because I'm sick of awkward hand movements for writing brackets with numbers and commas and spaces etc. here's the first draft. make your modifications here: http://www.keyboard-layout-editor.com/#/ i'm thinking of adding another column, putting something between the numbers and the plus/minus.

    19
    Meditation space @lemmy.world LordShrek @lemmy.world
    how do i find a mantra that suits me?

    or is there such a thing? should i just stick to some mantra, even if it doesn't necessarily feel "right"?

    0
    why aren't the posts for each community replicated across instances?

    !i search for a community, over all instances connected to the instance i'm using or maybe at least the posts wouldn't be replicated, but there would only be one community, and when you visit it, posts for the community are downloaded from your primary instance, as well as other instances based on some configuration that makes sense.

    21
    important message to google, samsung, all android phone manufactures

    just make normal sized cellphones again, please!

    76
    InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)LO
    LordShrek @lemmy.world
    Posts 8
    Comments 51