Multi-part doesn't work with batch downloads?

To the Ipswitch web site

Ipswitch Forums
Home      Members   Calendar   Who's On
Welcome Guest ( Login | Register )
      



Multi-part doesn't work with batch downloads?Expand / Collapse
Author
Message
Posted 11/11/2005 5:27:21 PM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: Forum Members
Last Login: 12/4/2005 1:53:00 PM
Posts: 4, Visits: 1
For example, if I have a folder with 3 large files and I want to download the entire folder using 8-part per file (for a total of 24 simultaneous threads (3x8=24)), I can't just highlight the folder and multi-part the entire folder? I have to do the files one by one?
Post #12048
Posted 11/11/2005 10:58:23 PM
Time Traveler

Time TravelerTime TravelerTime TravelerTime TravelerTime TravelerTime TravelerTime TravelerTime Traveler

Group: Ipswitch Employees
Last Login: Today @ 4:27:41 PM
Posts: 228, Visits: 1,379

You can do that by selecting the 3 files and downloading them while you are in multipart mode.

Claudio Robles
WS_FTP Team

 

Post #12051
Posted 11/11/2005 11:07:41 PM
Time Traveler

Time TravelerTime TravelerTime TravelerTime TravelerTime TravelerTime TravelerTime TravelerTime Traveler

Group: Ipswitch Employees
Last Login: Today @ 4:27:41 PM
Posts: 228, Visits: 1,379

Well, in fact you can use a maximum of 20 connections per site, so no more than 20 simulateneos threads. 

Make sure you set the maximum number of transfer connections to your site to the maximun (20), as well as the total maximum to all sites (program options) to at least 20.  Also, set the number of parts you want (8).

Why do you want to do that.  Is the server limiting bandwidth per connection ?

 

Claudio Robles
WS_FTP Team

Post #12052
Posted 11/12/2005 12:45:36 AM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: Forum Members
Last Login: 12/4/2005 1:53:00 PM
Posts: 4, Visits: 1
> Why do you want to do that. Is the server limiting bandwidth per connection ?

Well the server isn't limiting bandwidth but the nature of high bandwidth transfers over TCPIP with LATENCY (between Asia and North America) causes bandwidth to be capped artificially per thread. This is due to the latency taking longer than the frequency of the TCP window size asking for an ACK while transferring.

Anyway, I tried highlighting 3 files and transferring and it did work with multipart. However, I used a bad example in my original question. What I really want to do is be able to download some parent directory that has many sub-directories that contain yet more sub-directories and many files. When I activate download of the main parent directory while multipart mode toolbar key is highlighted it appears to download everything in single thread mode instead of multipart mode. Is there any way to download the entire parent directory in one shot with multipart mode?
Post #12054
Posted 11/14/2005 12:00:58 AM
Time Traveler

Time TravelerTime TravelerTime TravelerTime TravelerTime TravelerTime TravelerTime TravelerTime Traveler

Group: Ipswitch Employees
Last Login: Today @ 4:27:41 PM
Posts: 228, Visits: 1,379

No, unfortunatelly not.  The idea was that multipart downloads are not common and we wanted users to specifically select the files that they wanted to transfer in this mode.  In many cases multipart transfer can even slow down transfers.

  However, in your case if you use many connections, there will be many simulateneous transfers, but one per file.  

  I would also suggest to increase your buffer size, so that you can keep the pipe full, while waiting for ack.  To do that you would need to edit the INI file that has your sites's properties.  C:\Documents and Settings\"username"\Application Data\Ipswitch\WS_FTP\Sites\ws_ftp.ini

  In this file, find the section corresponding to you site and add "receivebuffersize=bignumber"

   By default we are using 64KB, but we have seen big speed up in some cases with large latency using buffer size of about 300000.  

Hope this help, and keep us posted.

Claudio Robles
WS_FTP Team

Post #12063
Posted 11/29/2005 9:04:37 AM
Forum Newbie

Forum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum NewbieForum Newbie

Group: Forum Members
Last Login: 12/4/2005 1:53:00 PM
Posts: 4, Visits: 1
In the file:

C:\Documents and Settings\(myusername)\Application Data\Ipswitch\WS_FTP\Sites\ws_ftp.ini

I have entered this line in the section for the site in question:

receivebuffersize=600000

However, I still seem to be only able to get at most 200KB/sec per thread. How does setting this setting relate to the RWIN (receive window size) size of windows os? Which one takes precedence? Also, how does this setting in the ini relate to the buffer setting on the FTP SERVER? Which one takes precedence in determining the buffer size? Does it matter if it's PASV or PORT?

FYI, my ftp server (Cerberus FTP Server)is run on my own private server/physical computer located in the U.S. (Windows Server 2003) and has a true symmetric 100mbps link to the internet. My local computer (ftp client) runs windows xp pro and has a downlink bandwidth of 24mbps.
Post #12475
« Prev Topic | Next Topic »


Reading This TopicExpand / Collapse
Active Users: 0 (0 guests, 0 members, 0 anonymous members)
No members currently viewing this topic.
Forum Moderators: Dave, Mark Singh, kevin r gillis, Jason Benton, Brandon Felger, Ben Henderson, Tripp Allen, Will Sansbury, Jason Williams, Hush, FTPplanet.com, LDW, Hugh Garber, WUP-PM, mmulryan@ipswitch.com, mswimm, Travis G.

PermissionsExpand / Collapse

All times are GMT -5:00, Time now is 10:01pm

Powered By InstantForum.NET v4.1.4 © 2009
Execution: 0.109. 10 queries. Compression Enabled.