M1 supports one external 4K display on laptop, two on the mini

Yea, they key here being 4K. Try connecting 1080p or 1440p which normal people tend to have around and you get terrible scaling.