What instance is used as a reference for the delay? One you self-host (lemmy.management)?
Yes. lemmy.management. It is purposefully updating subscribed communities to as many as possible (via automation.) This doesn't correct for network lag, but the idea was to capture the "federation" lag. There's no code I'm aware of that allows admins to prioritize outbound federation traffic. I could be wrong though.
Sooo … what’s the deal with lemmy.ml … that seems to have gone beyond lag and is basically falling over … seems like the devs have neglected their own instance’s health?
I just collect the data.
What’s that Redash? Is it a plotly thing or some other product that just uses their graphing library? How have you found it?
https://redash.io I don't remember how I found it. Probably an "awesome" list on github.
That's fair. Also, it seems like the more narrow the focus of a community the better, since they are together for a common interest. Expecting a news aggregator to not be political is a bit of a pipe dream. :) I need more coffee.
It's just a repeating cycle. Anyone making edgy commentary about decentralization was not around in the 90s. We think the shittification was caused by corporations, but corporations are just out to make money. Since we all need our 401k's to grow, I find it insane more people don't understand we're all just playing ourselves.
The real problem going forward is how EVERY FUCKING LITTLE THING becomes a political minefield; totally devoid of any real, meaningful contribution to humanity.
Christ, I honestly can't keep up anymore. What is a tankie? Am I woke enough? Should I like soy? Can I eat meat? Are electric cars bad?
I care deeply about other people and who they are as individuals, but I am starting to lose faith in our ability to create communities that can do anything but fight with eachother about what's best for everyone.
I’d like to see or make a tool that measures “federation” quality.
Lots of servers are locally responsive, but lag or completely fail posting to remote servers or accepting remote requests.
How can i participate in a conversation when half of the instances are hours behind or may not get my comments at all :(
This seems to be a combination of software and load and it is very insidious because it doesn’t affect local functionality so admins that don’t care or check think their communities are just fine.
It’s not just a bug in the code. There are some scalability issues at play. Federation breaks silently (as in the user experience doesn’t change) under heavy load. Lemmy.world came up with a solution, but Lemmy.ml has yet to do anything. Upgrading helps with similar and other issues but doesn’t completely solve the servers being overwhelmed.
Correct. All also includes communities fetched but not subscribed to, however these are more like stubs. They are in your database but not being updated with activity since no one is subscribed. At least that’s my understanding.
You should be able to rerun it anytime. It only gets stuff that doesn’t exist on your instance. That’s how it was designed. It is dependent on browse.feddit.de however. :(
hawkwind @ hawkwind @lemmy.management Posts 8Comments 284Joined 2 yr. ago
I am actually working on that! Stay tuned. Like days though, don't get too excited. :)