It's probably limited by your internet service provider. On many plans you only get much less upload speed than download speed. I guess it's to discourage home users from running a server at home. And to discourage file sharing.
Yeah that's probable. Since changing some settings on the connections limits it has already increased, still not as much as peak download like you said.