Yeah, I think this is done to provide the illusion of choice. The rate limits are high enough to allow personal emails through, but for any mass emails or corporate emails this forces you to use Google. Unfortunately a standard corporate strategy, it's why corporate office suites are so generic and tend to be from one of the big companies.
When I went to the DMV my independent mail server was immediately filtered into spam when I tried to email them my proof of insurance. It was no trivial thing for them to get it out of the spam filter, either
Thinking about starting my own personal email server, but to use it seriously I’ll have to weigh the pros and cons. If anyone has anything on this to share I’d appreciate it.
Long answer: It is a massive amount of work, not just to setup, but also to maintain. On top of the fact that the big email providers block smaller email servers like crazy. Even if you had business class Internet service at home, the IP range is most likely already in their block lists. And if you have it on a VPS, the amount of time and effort it takes to get the security and filtering going properly is nightmarish.
Even when done 100% by the book and correct. Companies like Google and Microsoft, in particular, will just randomly send the email to spam.
I gave up after years of fighting the good fight and went to googles free tier. That is now over and I probably just need to move to some other service.
Also dont use a gTLD or if you do, have a backup .com or .us as well. Many forms dont recognize things like .email as legit.
Even if you set up everything perfectly you encounter email providers that only have allow lists and you have to jump through hoops to be allowed to send emails to them (like publishing your whole name and address). I loved the fact that I had a mail server but in the end it didn't make sense.
Additionally, these days the sheer amount of flak that a self-hosted mail server gets are enough to make a lot of providers ask you to either shut it down or go somewhere else. Probably 80-90% of the server's inbound network traffic will be bots trying to brute force access (usually over POP3 or IMAP4, though occasionally SSH) to use it as a spam relay as well as relatively dumb bots just assuming that your server is an open relay and trying to send garbage through it. That kind of traffic hogs a lot of bandwidth and the hosting provider will have to do something about it to keep their infrastructure stable. Also, figure that you'll be spending about as much CPU time on the server for anti-spam processing on a 24x7 basis.
I have to agree with other commenters, it's just not worth the hassle and kinetic pattern baldness these days.
Anyone know a decent alternative at a reasonable price though? What if I have an @gmail today, and I want to move my storage elsewhere and have that just forward?
For those considering Proton Mail: There is one great benefit or disadvantage, depending on how you see it. As all traffic is encrypted, Proton Mail does not support standard IMAP or POP3. It's therefore best used with the official Proton Mail app rather than third party apps. On desktop, you can use your favourite email client (Thunderbird et al) only if you install a "bridge" which decrypts incoming emails before forwarding them to the client: this bridge is, in turn, only available to paying subscribers.
That said, it's a great service, and the fact that they have a viable business model which doesn't depend on selling out their users might be a good thing.
Any advice or hints on how to switch over? I wanted to do it years ago but I dread having to change my main mail address on everything, from apps, tools and games to bills or RL document-related stuff, it sounds like a horrible mess and ton of work
My recommendation for everyone is to use Fastmail and a custom domain.
Fastmail is extremely reliable, and since they charge money they also offer customer support. A few years ago I lost a lot of emails due to a client bug, and Fastmail support was very helpful recovering them from backup.
Use a custom domain so you can change providers in the future so you're not locked into your provider and can change if you aren't happy with them anymore.
I'm also using fastmail and I'm happy with them. Their native android email client is a little clunky but I still use it and I have the option to use other mail clients too.
I feel like step 1 is just buying a domain so you can have control over your e-mail address, and then you can switch providers whenever you want (or host it yourself).
If you already pay for extra iCloud storage you can use a custom domain for e-mail with iCloud... Many people are already paying for this, and if not it's only $1/mo. Apple's still a pretty big e-mail provider, so maybe that doesn't address all of your concerns, but it's a really cheap way to use a custom domain that more people should take advantage of imo.
I host my own e-mail and it's pretty care free these days (I don't send bulk e-mails, though, so I don't contend with rate limits at all). Honestly, more people should do it instead of buying into all of the fearmongering about e-mail... It's a little tricky to set up right, but the impossibleness of the situation is somewhat exaggerated. The best defense for self-hosted e-mail is if more people actually do it... Otherwise you're just capitulating to the large (and slightly less large) mail providers.
+1 on having your own domain. I was using gmail for a long time, and recently switched to my hosting provider's included-with-purchase email. Having my own domain made the move transparent to everyone, and relatively painless.
In my experience Office 365 is even harder to deliver to. The email envelope can be in perfect shape and sent via sendgrid (their recommended partner) and it will still silently drop mails for no obvious reason and if it does deign to deliver them it will often mark them junk.
I’m only sending low volume transactional emails. The amount of time I have to spend tweaking the email content just to persuade Microsoft to deliver the mail is absurd.
In my experience Office 365 is even harder to deliver to.
Yep, this is my experience as well.
I've had some issues with google, but at least they tend to put them in Junk, or tell me the messages are being rejected.
Microsoft will give me a 250 message, and then route the message to /dev/null.
That's contrary to the RFCs, and really annoying. Since it doesn't end up in Junk, the receiver can't say 'not junk', and since it doesn't bounce, the sender thinks it has been sent.
I'm signed up for Microsofts junk mail reporting, and when this happens the UI shows no issues with my ip, and doesn't admit to any e-mail filtering. The only way I can detect it is by sending messages to my test accounts, or waiting for users to yell.
Fwiw, anyone else who runs in to this scenario, expect your first support ticket with microsoft to be rejected. Keep responding to it. On the second or third try they might end up removing the silent ban.
The term you're looking for is 'Horizontal Conduct' and it's illegal. The hard part of course is making that claim against the team of lawyers that Google would be able to field.
And this is happening after SPF, DKIM and DMARC provided a solution to the spam problem.
Any mail system can remove practically all spam by insisting messages conform to those three standards
But that is not true at all. Spammers can easily send mail with all proper SPF, DKIM and DMARC records and signatures. A lot of spam is and will be sent like that. Those extensions do not make spam impossible, they just make it easier to track and block.
But this does not change the point of the article – in this case it is a specific domain sending very specific non-spam messages. SPF/DKIM/DMARC prove it is not someone else – GMail has no ground for blocking these (unless were are not told something).
And GMail has been breaking mail for years now. E.g. I hate them for breaking message threading by ignoring threading headers and forcing own view on how messages should be grouped.
How does one send a spam email that passes SPF and DKIM if one doesn't have access to the DKIM private key, or the DNS server to edit the SPF or DKIM records?
You can't... But you can register a domain and set up your own DKIM key and DNS records and then use it to send spam (until you get blacklisted, anyway). There's a cost to doing that, though, so it's less appealing.
Confirmation emails when they create a booking being marked as spam but is that the only email they send out. Do they send out unsolicited ones to folks like me who mark them as spam? Are bots making booking and using my email. Its great they are doing everything right but im skeptical that something else they are doing is not causing the issue. I get plenty of good email in my gmail spam but the ones that do I can bet get marked as spam for good reason. Like from my alma matter which Im sure has a good and trusted endpoint but they can be a bit annoying with their emails and some folks likely mark them as spam. I don't but I could see them getting a reputation of sorts.
Meanwhile I get spammed 100s daily from asian job posting systems that I mark as spam/unsubscribed and they still come through. Apparently it's all a scam to show need for H1B visas?
I'm not really all that surprised. Google, Microsoft, and Yahoo aren't incentived to design for a precise spam detection system, just one accurate enough to prevent spam from being a big issue.
In this position I would already be putting warning on the order page to say to explain to Google/Microsoft users that they will receive a confirmation email, but that their email provider may delay the email to up to 12 hours before they can see it in their inbox.
It would be informative to customers, avoid some support calls, and would give credit where credit is due.
I had delayed messages, kicked back messages, and messages lost in the ether. I finally gave up and went to a small hosting company that seems ok so far.
They stand to benefit by having a de facto monopoly over email by exploiting their position as one of the biggest email providers in the world
"Monopoly" may not be the right word since Microsoft and Yahoo! also seem to be engaging in similar anti-consumer practices, but basically they seek to end the days of independently hosted email providers, which is obviously not good for us
I wish they'd gone into a bit more detail about the issues they had, where they hosted, how they tried to fix their ip reputation, which providers blocked them, etc.
I've experienced the same issues in the past, but didn't find any of the insurmountable.
Though admittedly mine is more 'small business' than 'self-hosted', so I can afford to buy a small IP block and run on dedicated hardware.
Mastodon literally uses email as an analogy for how it works. You're just obfuscating the issue. Email is much more well equipped for the problems being discussed. Federation just spreads the problem to thousands of servers. I'm fine with Mastodon becoming politicized, but I'm not fine with email becoming politicized.
Mastodon offers no real benefit over email as a standard. It's the same work, except higher degree of censorship being possible.
Something in the veins of Mastodon. Still federated, but with validated peers and a better protocol.
XMPP also was a front-runner for me, but unfortunately that one died over the last decade.