• Post Reply Bookmark Topic Watch Topic
  • New Topic

best, fastest way to transfer huge size file to remote location ?

 
Edward Chen
Ranch Hand
Posts: 798
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Assuming the bandwidth can't be improved, I have one picture whose size is 100G, what is the best, fastest way to transfer it to remote location ?

Any link is welcome.

thanks
 
Steve Harney
Greenhorn
Posts: 19
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

If its a once off have you considered a courier.

"Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway"

 
Rob Spoor
Sheriff
Posts: 20822
68
Chrome Eclipse IDE Java Windows
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
That may not be bad advice. Let's do a little calculation.

Assume you have a 10Mbps upload (that's already quite high). For 100GB (notice the difference between B(yte) and b(it), this is what the 8 does in the calculation) that would need 100 * 8 * 1024 / 10 = 81920 seconds. That's almost 57 hours. A good courier (e.g. UPS) can probably do it in less than 24 hours, definitely in less than 48 hours.
 
Edward Chen
Ranch Hand
Posts: 798
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Rob Prime wrote:That may not be bad advice. Let's do a little calculation.

Assume you have a 10Mbps upload (that's already quite high). For 100GB (notice the difference between B(yte) and b(it), this is what the 8 does in the calculation) that would need 100 * 8 * 1024 / 10 = 81920 seconds. That's almost 57 hours. A good courier (e.g. UPS) can probably do it in less than 24 hours, definitely in less than 48 hours.


This explanation is very clear. Thanks.

My thinking is, can we cut this huge files into small ones, and open more threads and sockets to transfer it ? Is it possible ? In the real practice, what is the way to resolve it ?

Thanks.
 
Henry Wong
author
Sheriff
Posts: 22542
109
C++ Chrome Eclipse IDE Firefox Browser Java jQuery Linux VI Editor Windows
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Edward Chen wrote:
My thinking is, can we cut this huge files into small ones, and open more threads and sockets to transfer it ? Is it possible ? In the real practice, what is the way to resolve it ?

Thanks.



The scenario that Rob discussed are based on hardware numbers -- meaning that is the transfer rate that the network cards can go... period.

Having the network cards support multiple transfers doesn't magically make the card have double the bandwidth. It just means that you have double the number of transfers sharing the same bandwidth.

Henry
 
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!