Skip Navigation
Very large amounts of gaming gpus vs AI gpus
  • Tflops is a generic measurement, not actual utilization, and not specific to a given type of workload. Not all workloads saturate gpu utilization equally and ai models will depend on cuda/tensor. the gen/count of your cores will be better optimized for AI workloads and better able to utilize those tflops for your task. and yes, amd uses rocm which i didn't feel i needed to specify since its a given (and years behind cuda capabilities). The point is that these things are not equal and there are major differences here alone.

    I mentioned memory type since the cards you listed use different versions ( hbm vs gddr) so you can't just compare the capacity alone and expect equal performance.

    And again for your specific use case of this large MoE model you'd need to solve the gpu-to-gpu communication issue (ensuring both connections + sufficient speed without getting bottlenecked)

    I think you're going to need to do actual analysis of the specific set up youre proposing. Good luck

  • Very large amounts of gaming gpus vs AI gpus
  • The table you're referencing leaves out CUDA/ tensor cores (count+gen) which is a big part of the gpus, and also not factoring in type of memory. From the comments it looks like you want to use a large MoE model. You aren't going to be able to just stack raw power and expect to be able to run this without major deterioration of performance if it runs at all.

    Don't forget your MoE model needs all-to-all communication for expert routing

  • Pi-hole client filtering without DHCP?
    • Custom DNS servers specified on the device to circumvent the pihole
    • dns over https or tls
    • hotspot from approved device
    • alternative YouTube front ends

    These are just off the top of my head. Best case scenario the blocking does work and the teen never tries to bypass it. They'll still just move onto "wasting" time on something else. This is treating the symptom and not the root cause.

  • Pi-hole client filtering without DHCP?
  • Pihole can set up "groups" for different blocklists. You specify client by IP or MAC address so it doesnt matter what the dhcp server is, so long as there's a static IP or static MAC address. My pihole server doesn't have dhcp set up and I'm able to do this fine

    Though from personal experience this just becomes a game of cat and mouse, and if you have a motivated teenager then they will find a way to circumvent this. For example android can rotate MAC addresses, and IP addresses are trivial to spoof as well.

  • What are the advantages/disadvantages of the different backup solutions?
  • Haven't used all of those but my recommendation would be to just start trying them. Start small, get a feel for it and expand usage or try a different backup solution. You should be able to do automatic backups for any of them either directly or setting up your own timer/cron jobs (which is how i do it with rsync).

  • Your help needed: PhD research on why people choose to self-host
  • I submitted a response but if i may give some feedback, the second portion brings up:

    I am willing to pay a substantial amount for hardware required for self-hosting.

    This seemed out of place because there were no other value related questions (iirc). Such as:

    • I believe self hosting saves me money in the short term
    • i believe self hosting saves me money in the long run

    I'm sure you could also think of more. But i think it's pretty important because between cloud service providers and any non-free apps you want to use, it can be quite costly compared to the cost of some hardware and time it takes to set things up.

    The rest of my responses don't change but if you're wanting to understand the impact of money in all of this, i think some more questions are needed

    Best of luck!

  • Website Launched!
  • For some background, it turns out organic maps had a for profit llc registered and long poised itself as free and open source. When the llc was discovered the community volunteers wrote an open letter

    When their concerns were not answered they forked the project and created CoMaps which in theory is supposed to be everything organic maps ever portrayed itself as.

  • Git Your Freedom Back: A Beginner's Guide to SourceHut
  • Why Not Use…?

    I am aware that there are many other git “forge” platforms available. Gitea, Codeberg, and Forgejo all come to mind. Those platforms are great as well. If you prefer those options instead of SourceHut that’s fine! Switching to any of those would still be a massive improvement over GitHub.

    Unfortunately, I find the need to have an account in order to contribute to projects a deal breaker. It causes too much friction for no real gain. Email based workflows will always reign supreme. It’s the OG of code contributions.

    Ive been using codeberg(a public forgejo) and it felt more familiar coming from github/gitlab. Sourcehut wasn't bad, but it did feel quite a bit different and i admittedly didn't get too far past that. I do like the idea of contributing without an account though. i know that it's a git feature to create a patch file but having a forge support it is neat.

    Semi related, I do look forward to federation of forgejo which i think helps the "needing an account" somewhat. I think it's less unreasonable to expect someone to have an account on -any federated forge- than to have an account at the specific forge my project is on.

    Good article though. It did help make sourcehut make more sense than the first time i looked at it

  • Jellyfin troubles - phone cannot reach
  • You're not connected to wifi or vpn from the looks of it. jellyfin is hosted on your local network. You need to be connected to that network for any device you want to access it. The most direct way is to connect via wifi. If you want access from outside your house you'll need to look into opening a remote connection via something like cloudflare tunnel

  • [Answered] Organic maps archived their forgejo repository
  • Wait, organic is a forprofit publicly traded company?

    Yeah, this is a surprise. And its even called out in the open letter

    The Organic Maps project has been built and promoted under the premise of being an open community project, so it's troubling to discover that the majority of shareholders consider it to be their sole property. [...] (see Addendum for the details)

    Then in Addendum:

    The role of Organic Maps OÜ

    It's a for-profit company (an LLC basically) registered in Estonia:

    ariregister.rik.ee/eng/company/16225385/Organic-Ma...

    The company holds key project assets, e.g. the trademark and the app store accounts. git.omaps.dev/organicmaps/organicmaps/src/branch/m... states that "The primary purpose of the entity is to shield the project's members from personal liability and to ensure the legal protection of the project's assets."

    Until recently there was never a mention that the shareholders treat their shares as their personal investment. Even that explanation document was only added to project's repository 4 months ago - before that the only brief mention of Organic Maps OÜ's existence was in the footer of the https://organicmaps.app/ website, so the most of users and contributors had no idea about its role and ownership structure.

    Roman @rtsisyk holds 1/3 (33%) of shares, Viktor @vng holds 2/3 (66%). Alexander @biodranik is not a registered shareholder, but allegedly Viktor holds his 1/3 (33%) nominally.

  • Self Hosted OpenSource Projectmanagement Tool
  • Logseq to some extent, but it's set up to be a journal/ meeting notes where you tag pages, add documents, etc. it would be up to how you've tagged things. Does have a graph view of your pages and whiteboard feature.

    Personally it wasn't exactly what i wanted out of a PKM but it is really powerful. It's intended to handle taking notes efficiently from meetings and then somewhat self organizing the notes as long as you tag stuff.

  • Linus Torvalds Expresses His Hatred For Case-Insensitive File-Systems
  • Python is case sensitive. I think they're saying their coworkers are writing case insensitive code which is causing errors (perhaps writing myFunction and then calling it via myfunction which would result in an undefined error)

  • Reddit infiltrators, need a shortened Lemmy link to evade Reddit filtering? DM me
  • Without knowing what reddit is doing, I'm not sure. A JS redirect could be detected, but if OPs paid shortener service is working then reddit is probably working off a simple domain block list. In that case you could use throw away domains.

    But JS redirect, proxy response, etc all could just become a game of cat and mouse. Just depends how motivated either side is. But given how big reddit is, i think you'd have the advantage at least in the beginning. Just gets expensive since each time your domain gets blocked you'll be paying to register a new one.

  • Reddit infiltrators, need a shortened Lemmy link to evade Reddit filtering? DM me
  • I'm not familiar with the reddit filtering but have you tried using cloudflare page rules? You can try capturing everything after the .tld and then forward it to a lemmy server. So for instance somedomain.tld/12345 could forward to lemmy.world/post/12345. If reddit is checking links for 301 redirects to lemmy though then that wouldn't work.

    A more advanced approach would be to use a cloudflare worker to do a proxy response so the status code is returned as 200 OK instead of 301 redirect. I haven't tried that but i think that would be much harder for them to block and you could always make more elaborate urls to make it harder to find obvious lemmy-like structure

  • Programming.dev instance: Sponsors needed

    Hi all, I'm relatively new to this instance but reading through the instance docs I found: >Donations are currently made using snowe’s github sponsors page. If you get another place to donate that is not this it is fake and should be reported to us.

    Going to the sponsor page we see the following goal: > @snowe2010's goal is to earn $200 per month > > pay for our 📫 SendGrid Account: $20 a month 💻 Vultr VPS for prod and beta sites: Prod is $115-130 a month, beta is $6-10 a month 👩🏼 Paying our admins and devops any amount ◀️ Upgrade tailscale membership: $6-? dollars a month (depends on number of users) Add in better server infrastructure including paid account for Pulsetic and Graphana. Add in better server backups, and be able to expand the team so that it's not so small.

    Currently only 30% of the goal to break-even is being met. Please consider setting up a sponsorship, even if it just $1. Decentralized platforms are great but they still have real costs behind the scenes.

    Note: I'm not affiliated with the admin team, just sharing something I noticed.

    16
    InitialsDiceBearhttps://github.com/dicebear/dicebearhttps://creativecommons.org/publicdomain/zero/1.0/„Initials” (https://github.com/dicebear/dicebear) by „DiceBear”, licensed under „CC0 1.0” (https://creativecommons.org/publicdomain/zero/1.0/)ST
    starshipwinepineapple @programming.dev
    Posts 1
    Comments 108