The speed on any given connection is limited by the capabilities at both ends. Just because your ISP can deliver 20Mbps, it does not mean that the server to which you connect can send 20Mbps to you. Servers are often overloaded.