FTP Download Limit?!?

[Colin]

I've been working on websites for a long while.

And the sudden stupid question arises,

What The Hell are you doing that requires you to upload more than a few files after initialling creating the website?

The FTP limit has never been an issue with me.

[negusm]

I ran into it when I was moving my large website from local backup to the new site because I changed hosters.

For one of my sites, I had 2000-3000 files between php, html and graphics.

-Mike

[Colin]

And for a complete move like that it's much less of a headache to upload a ZIP containing the complete website and unpacking it on the server.

I'm sorry, I have no sympathy here, there's no reason to run a rude program that hammers a server with a thousand connections at once.

[casimedicos]

there's no reason to run a rude program that hammers a server with a thousand connections at once.

i do not understand this
if you use a ftp program like filezilla or others, this is not a rude program

it is a ftp program
and the usual mode to upload/download files is a ftp client
then the problem there is not the program
the problem is the limitations on whb
i believe

[Alan B]

It sounds as though some FTP applications create multiple connections in an attempt to speed the transfer. Perhaps some of them create too many concurrent connections.

[negusm]

It sounds as though some FTP applications create multiple connections in an attempt to speed the transfer. Perhaps some of them create too many concurrent connections.

That appears to be the case. In which case, can't WHB set things so that FTP allows only so many connections without completely blocking the user?

-Mike

[negusm]

And for a complete move like that it's much less of a headache to upload a ZIP containing the complete website and unpacking it on the server.

I'm sorry, I have no sympathy here, there's no reason to run a rude program that hammers a server with a thousand connections at once.

It's not like that's the ONLY that scenario causes the problem. There are other times when uploading just a single directory with a bunch of files causes the problem. I haven't played with it to see exactly what the threshold seems to be.

One area I have to steer clear of is trying to do a search with Expression Web on the site. That also seems to open up a bunch of connections. The old FrontPage extensions seemed to work though. It would be nice if EW could be set to use only one connection but I don't see anyplace to set it.

-Mike

[casimedicos]

It sounds as though some FTP applications create multiple connections in an attempt to speed the transfer. Perhaps some of them create too many concurrent connections.

i do not think so
if you use a filezilla or other ftp client and you write in settings only one connection, the problem is the same
and in other companies i never have this problem

but if we believe that the problen is too many connections ( i do not think so)
you can say me what ftp client is whb friendly?? (
i can not understand why only have problems with whb, and why we have problems with all ftp clients, ...??

and ftp is a neccesary service for a webmaster

sorry for my english

thanks

[Colin]

Get FireFox.

Get FireFTP.

[negusm]

Get FireFox.

Get FireFTP.

While that may be a good option, this is really not good policy for a web hoster to push on their customers.

WHB should really figure out how their competitors handle it and determine if they can do the same. They do everything else better, why not this?

-Mike

[Colin]

Dunno, maybe artificially redirect each server's FTP access to a separate IP and subserver specifically for dealing with FTP usage?

I.E. www.mydomain.com points to 72.127.36.184 but if I go ftp.mydomain.com I get 72.127.21.184 or something like that.

[mpyusko]

Get FireFox.

Get FireFTP.

I have been locked out numerous times with FireFTP. One time saying I had over 150 connections. I rarely upload more that 50 -60 files at a time. I've used gFTP with the settings set to one at a time and I'll still get blocked. This is why I sincerely believe there is a bug in their system.

[Colin]

Theory: cPanel (or whatever is the system behind the FTP) is not freeing / releasing / deleting entries when they are completed in a timely manner.

[antoniop]

One of users tried to upload big amounts of data to the box using "multithreading" FTP client feature. 6-8 concurrent FTP connections with massive data flow were killing the server, average loads boosted up to 150.

We have set per-IP FTP connection limit to one connection. This is an emergency measure and this may lead to FTP problems if you use "multithreading", but this will let us to keep server load in acceptable range. If possible try not to use "FTP multithreading", it doesn't significantly speed up FTP transfers but definitely leads to tremendous FTP server overhead.

This happened in February. Today we are still under the 1 connection rule.
It was used as an emergency fix to avoid overloading the servers with multiple connections.
I understand that reaching hundreds of connections is way above any normal user need, but I also think that limiting to 1 connection is way below what's acceptable.
I have a site that has a photo gallery. Every time I make an update I upload multiple files (hundreds) around 1-2 Mb size (High Quality Pictures)
Having just 1 connection for doing this is absurd.
The chances that something goes really wrong with 3-5 connections are higher that with one connection but manageable.
A lot of FTP clients support multiple connections to maximize bandwidth use that is usually limited on the client side. What this allows me is to maximize my Upload BW and still have a decent upload time.
You went from all to nothing and now it seems that this has come to stay. Your settings were so loose that problems could occur. now they are so tight the invalidate functionality. 1 connection per user was the standard in 1996 when I initiated my website.

My question is simple: Are you going to raise the limit to 3-5 connections (as an example), or is the service going to have one FTP connection forever?

[antoniop]

Well,
Enough is enough. I've submitted a ticket, I've posted here waiting for a reasonable explanation and I'm trying to backup my site completely.

Due to your wonderful restriction of 1 FTP connection I'm trying for 9 hours to transfer the site.
I can't. Sometime along the way the FTP server kicks me out due to inactivity!!!!

And there we go again.
I tried the full backup. Oddly, it only backups 200Mb out of 400+. This probably means that in the event of a severe crash, my backups would be useless, because among other things my site www directories are not backed up. And as far as I can tell they are in my "home directory".

[BryanS]

I've had this happen too recently. It has temporarily blocked me using Filezilla set to a single connection

[LMaster]

I use filezilla and up to about 7 days ago I was uploading with 3 connections now 1 stops and cannot reconnect

Something is wrong !??

[OaklandR]

I have always had this problem. I used to get my connection dropped when transferring. I was then blocked from my site for 30 minutes. They said the same thing I had too many connections. Now I just zip the files up and upload the one file. Same thing with downloading.

[mpyusko]

Does anyone else have the problem where the connection closes ~270 - 300 MB when you try and download a backup?

[globalgsm]

Download speed 300.
Upload speed 80

Seems to be a limit, is it true ?