If this blog helped you in any way, please donate a dollar here

Showing posts with label GoLang. Show all posts
Showing posts with label GoLang. Show all posts

Monday, June 26, 2017

Fast download with Golang

Hey all, people keep saying about how great the concurrency is in golang. To be honest, I am pretty much a novice in this.

So just wrote a download accelerator in golang using it's much awesome parallel feature, the source of which can be found here: https://github.com/rghose/go-parallel-downloader

Here are a few results:

URL DownloadedTime taken by wgetTime taken by Golang
http://get.videolan.org/vlc/2.2.5.1/macosx/vlc-2.2.5.1.dmg1m3.375s0m26.609s

This was with GOMAXPROCS=2, threads = 5  with Chunk Size = 10 KB

So well, the chunk size of download did make a lot of difference, since the number of connections to download the thing would decrease, too many connections does not help in speed up