Viewing lemmy posts by all tends to be dominated by a few communities
I've noticed that there are a few communities that tend to dominate when viewing all. Some days it gets to where looking at all isn't very different than just looking at Memes@lemmy.ml or 196@lemmy.blahaj.zone.
Before someone says "you can just block communities you don't want to see," it's not that I never want to see them, it's that I want to be able to have a view that shows me what is new and popular in a wide variety of communities. I appreciate seeing a few good memes in my feed. The problem is when that's all I see. Changing the sort from active to hot or top x days doesn't have much effect on which communities dominate, so that isn't the solution either.
"You can just subscribe to communities you like". True, but that has the effect of narrowing what I see. I'd like a view that showed me new things I never thought to subscribe to.
Lemmy devs - if you are reading this - it would be nice to have a feed that limited the number of posts showing up from any particular community. It could be a simple cutoff of 2 or 3 posts, or maybe some sort of weighting function to cause additional posts from the same community to appear lower in the sort order for that feed.
I'd love to hear what devs and other users think about this.
Edit: To everyone saying "just sort be new" - yes, that has its uses, but it only solves part of the problem. I'd like a feed that shows me what is new and popular, but from more than just one or two communities.
I read something the other day that they’re working on a new sorting algorithm that would limit it to the top few posts from each community within a given time frame. Specifically to address this issue.
No idea on timeframe or further details, or if I even summarized it correctly lol.
Idk it seems like a problem that will sort itself out as Lemmy grows, and artificially limiting how many posts from a community can reach the front page seems like a suboptimal solution that’s going to have unintended consequences down the line.
If a community has grown a lot, unfortunately it takes up all the posts on the homepage. If I were a developer, I would sort by weighted success. For example, if the "x" community has 1000 subscribers and the post gets 100 likes, it has ten percent success. If the other 'y' community has 100 people and gets 11 likes, it has 11 percent success. This overrides the post in community x because the post in community y is more successful. This is the logic of 'weighted success'. With this logic, a better ranking formula can be created.
Another, related issue to this is that I find the three frontpage categories (All/Local/Subscribed) to be too blunt of a sorting method.
I would really love if we had the option to create subcategories to our Subscribed feed, so we could group related communities and end up with different frontpages for News/Sports/Memes etc.
Note that this is one of the advantages of having an account on a smaller and/or more focused instance or having multiple accounts.
All "Alls" are not the same. Actually, the "All" displayed on a given instance is everything local to that instance and everything from other instances to which someone on that instance has subscribed. So if nobody from that instance has subscribed to a particular community on another instance, then for all intents and purposes, it just doesn't exist. Even on "All".
Granted that it's somewhat unlikely for an instance to not have someone somewhere along the way subscribe to some notably popular community, it is possible, and the smaller and more focused the instance is, the more likely it is.
I'd love some kind of per community bias adjustment even for subscribed communities. Like, I don't really want to remove them cause memes are great, but because !memes@lemmy.world and 196 post so often my subscribed feed is pretty dominated by them no matter how I sort it.
For "All" some kind of adjustment based on subscribers makes sense, but I don't even know if that's possible given the way Lemmy works. Maybe a "show me less" button that moves the same bias adjustment just for communities you're not subscribed to?
This was an issue Reddit used to have circa 2015. Front page was all League of Legends posts, and then it was all The_Donald posts. Then Reddit screwed up their algorithm and it was literally 100% The_Donald posts.
Fyi the devs aren't reading this (and probably won't be before long, since they are busy just coding a lot of features). Best place to ask for this is on the issue tracker (first check if it hasn't been asked before), even better implement it yourself if you can!
I don't know about anyone else's experience, but I've noticed that any time I click into a post view and then back out, I'm taken to the first page of posts, no matter if I was 2 or 3 pages on.
If the redirect respected where it came from instead of going to home, that could reduce the impact of post-order sorting.
Also if the list pager had more options than 'prev' and 'next' (maybe a few numbered pages between or beyond) I could get beyond that 3rd page without getting there feeling like an illustration of the schlemiel the painter's problem
I'm right there with you - I'm making an app called flemmy, and I have 12 more tasks on my list before I'm putting it on the play store - should be this weekend at the latest. Iphone build shouldn't be that far behind. I can also make a desktop build if anyone wants it, but right now have no intentions to host a site myself - I strongly feel the data the app collects shouldn't leave your device
Version 1 is about creating something close to the Reddit apps I used to use, and it's there - just needs a little more polish (and to let you post... I'm more of a commenter, so I forgot that was a thing for an embarrassingly long time)
I can support all sorts of filters, from keywords to hiding specific posts to "snoozing" communities. I can also save your place when you change sort methods or accounts - it's what I always wanted for Reddit.
Also, I have support for redirecting links - Twitter to nitter, YouTube to pipe, etc.
Version 2 is going to focus on your feed. Already I connect to multiple servers (it's a real headache, but the foundation is there), so next is stitching feeds together and custom feed algorithms. What you mention is at the top of my list - a way to tweak the feed based on all sorts of filters.
Ideally, I want it to adapt to you - using upvotes and comments to tweak your feed. All on your phone - it's amazing what you can do on a phone when you're not interested in data collection
I just made !flemmy@Lemmy.world, I'll post some screenshots when I need a longer break
Better solution: don't use Lemmy as your feed, use a feed reader (RSS). There are per-channel feeds that you can sort and filter using parameters.
Doing things this way will also help create the open web we all want to see, where "forum" is not a synonym for "Reddit" or "Lemmy", where you can also follow the goings-on in other places and not miss anything.
My suggestion is to add a view with subscriptions ordered by the selected criterion (i.e. new/active/hot/top) and below each community there is vertical list with posts from that community sorted.
This would allow see what's up with the communities we follow and then jump in those communities if we find anything interesting.
A quick, but a little dirty solution for this, would be communities having “tags” in their metadata. This wouldn’t prevent spam, or an accumulation of four trillion tags, but you could easily add “only these tags,” or “not these tags,” to any feed. User objects have metadata that is used like this (as the “bot” flag) already. I’m just familiar enough with the code to know it wouldn’t be a slam dunk, but it’s also not a breaking change or re-write!
I think there should still be a strictly chronological feed that isn't algorithmic, but blocking the bots that import a lot of low quality content from reddit would be easier than blocking the individual subs.
@dryguy The algorithm needs to be improved. It needs to adjust for the number of boosts/favorites that large communities get. You should be seeing posts from all of the subs you are subscribed too and not just the most popular ones.
What if you make an alt account that blocks big prominent communities when sorting through /all so you can view the top posts from smaller communities?
I think this problem is relegated to being registered to larger instances. On one hand you get lots to choose from when it comes to your local feed, similar to how Mastodon works, on the other hand you have the problem you just mentioned. I know you bring up the problem of narrowing what you see, but if you're going to be on a big instance, there really is no other way than to subscribe to those communities you have a specific interest in. I'm on a smaller instance and I just take the time to go through communities that I may have an even fleeting interest in and subscribe to them, avoiding larger generic communities. This is the same strategy I employ when it comes to my news feed as well. I only subscribe to RSS feeds from sites I have an interest in.