Federation seems to be working fine otherwise, I’m just not seeing any content unless I am explicitly subscribed to a given community.
these two statements are contradictory in my interpretation ;)
How do you know it is working fine?
I’m just not seeing any content unless I am explicitly subscribed to a given community.
If indeed it is a brand-new instance, Lemmy starts out entirely empty and does not get any messages and comments from other servers until you join communities from your instance. It has been that with in 0.17 and continues to be that way in 0.18.1
Agreed, and the emphasis on the Lemmy GitHub page that it has "full delete" doesn't have any kind of disclaimer about this. Newcomers to the project just don't realize it.
The failures have more to do with server performance related to the quantity of new comments and activities than anything. There are periods of time that it fails worse than others and even when web browsers visiting the servers show errors.
Technically, can you trace where the comments are dropped?
There are multiple timing and resource issues with the way content is sent. Every single vote and comment has a lot of overhead, and the Lemmy servers are causing each other to slow down with the overhead of it all. There are even very tight security timings that have been hit causing rejection. And there system has no automated way to repair missing content, it just tires to keep up with each new posting, comment, vote.
have you looked for example at lemmy.world (very large but performant) and another relatively small instance?
Yes, and I run my own instance that is on a high performance server and it has no users other than myself for testing Lemmy.
Lemmy.ml is having the most problems, but really all of the big servers are dropping comment and post replication. The biggest problem is that server operators have no way to know this is happening other than to read raw Linux error logs. The post ID numbers are unique to each server, so it is not easy to identify which link is for the same postings.
Also, I’ve been living in the Internet you describe since 1990. All it takes is intentionally saying no to the corporate offerings; there have been self-hosted and crowd-hosted communities the entire time.
Yha, advertising was non-existent on social media in the 1980's, BBS systems and such were run because people like sharing information.
Facebook, Twitter were really about selling stuff and commercial advertising, people flocked to it.
Yes, thank you. And if you come up with any that cross-reference comments and postings by remote instance server better than the ones in lemmy_helper, please share. I'd really like to see if we can get "most recent hour, most recent day" queries so we can at least see federated data is flowing from which servers.
Denial of service by putting data into the system is happening just from routine user activity. And that gets into multiple servers. Lemmy scaling is beyond crisis point.
There is no built-in “real-time” methods for admins via the UI to identify suspicious activity from their users, I am only able to fetch this data directly from the database. I don’t think it is even exposed through the rest api.
The people doing the development seem to have zero concern that their all the major servers are crashing with nginx 500 errors on their front page under routine moderate loads, nothing close to a major website. There is no concern to alert operators of internal federation failures, etc.
I am only able to fetch this data directly from the database.
I too had to resort to this, and published an open source tool - primitive and non-elegant, to try and get something out there for server operators: !lemmy_helper@lemmy.ml
these two statements are contradictory in my interpretation ;)
How do you know it is working fine?
If indeed it is a brand-new instance, Lemmy starts out entirely empty and does not get any messages and comments from other servers until you join communities from your instance. It has been that with in 0.17 and continues to be that way in 0.18.1