Downloading large files

[melonhead]

I'm using 2.1 b924 trying to d/l large (4gb+) from a BFTP site. However, the file remaining time is way, way too short (about 2 hours - 512 ADSL, I wish!) and after about 400-500mb it drops the connection and starts from the beginning again - this carry's on looping like this indefinatley. CuteFTP Pro (yuk!) works ok though - any ideas?


Tim

[guru_2]

Ckeck your options to see if you have always overwrite when downloading. You need to make it always resume.

HTH
guru

[melonhead]

Thanks, but that was already set. Interestingly CuteFTP had got about 2.5gb of a 4.3gb file when I lost my connection. When i reconnected I tried Flash again, to see if it would autoresume where cute left off, but it prompted to overwrite the existing 2.5gb file with one of 195mb!!! It looks like it's not getting the filesize correctly - but since cute does i assume that it's an issue with flash and not BPFTP server?

[MxxCon]

look at your status log. do you see REST command before RETR.
does REST have correct file size of your existing file?

[melonhead]

I don't think that that's the issue - I was just trying to make the point that Flash doesn't like files of that size, regardless of how I try to get them down.

It does however report the correct size in the log when initalising the transfer - maybe it's a field length issue and Flash just can't handle numbers that large?

[phyber]

That is not the case, from the features (http://www.flashfxp.com/features.php) page
Transfer files of all sizes, no 2gb/4gb size limit like some ftp clients.

[bigstar]

Older versions of BPFTP did not support large files, Please verify that the version your using does indeed support large files.

Some ftp servers support large files but they are unable to resume them.

[melonhead]

i've been assured that if it's not the latest BPFT, then it is only a point release behind. That wouldn't explain why unCuteFTP Pro works fine though :(

[bigstar]

it would be most helpful if you could include a copy of the status text also issue a raw command "SIZE <Filename>" where filename is the large file

[melonhead]

ok here is the result from the raw list:

size drp-xxxxxxx.img
213 193048576

when I start the xfer it says that the time estimate is 2:40:00 @ 24kbs, after it has got 100% it carries on for a while with the time remaining at ??:??:??. The filesize reported through FlashFXP remote view pane is 4.18gb. the log is below, I aborted after leaving it looping overnight:

Connecting to site
Connected to site -> IP=999,999,999,999 PORT=115
220 SITE FTP
USER uid
331 Password required for uid.
PASS (hidden)
230 User uid logged in.
SYST
215 UNIX Type: L8
REST 100
350 REST supported. Ready to resume at byte offset 100.
REST 0
350 REST supported. Ready to resume at byte offset 0.
PWD
257 "/" is current directory.
TYPE A
200 Type set to A.
PASV
227 Entering Passive Mode (999,999,999,999,185,51).
LIST
150 Data connection accepted from 111.111.111.111:3279; transfer starting.
226 Transfer ok
List Complete: 383 bytes in 0.63 (0.37 KBps)
CWD dir
250 CWD command successful. "/dir" is current directory.
PWD
257 "/dir" is current directory.
PASV
227 Entering Passive Mode (999,999,999,999,178,142).
LIST
150 Data connection accepted from 111.111.111.111:3280; transfer starting.
226 Transfer ok
List Complete: 2 KB in 0.64 (2.16 KBps)
CWD xxxxxxxxxx
250 CWD command successful. "/dir/xxxxxxxxxx" is current directory.
PWD
257 "/dir/xxxxxxxxxx" is current directory.
PASV
227 Entering Passive Mode (999,999,999,999,142,210).
LIST
150 Data connection accepted from 111.111.111.111:3281; transfer starting.
226 Transfer ok
List Complete: 144 bytes in 0.54 (0.14 KBps)
TYPE I
200 Type set to I.
PASV
227 Entering Passive Mode (999,999,999,999,88,70).
RETR drp-xxxxxxx.img
150 Data connection accepted from 111.111.111.111:3282; transfer starting for drp-xxxxxxx.img (4488015872 bytes).
426 Cannot retrieve. Failed. Connection reset (10054).
Transfer Failed!
PASV
227 Entering Passive Mode (999,999,999,999,48,154).
RETR drp-xxxxxxx.img
150 Data connection accepted from 111.111.111.111:4415; transfer starting for drp-xxxxxxx.img (4488015872 bytes).
426 Cannot retrieve. Failed. Connection reset (10054).
Transfer Failed!
PASV
227 Entering Passive Mode (999,999,999,999,6,71).
REST 2527232
350 REST supported. Ready to resume at byte offset 2527232.
RETR drp-xxxxxxx.img
150 Data connection accepted from 111.111.111.111:4416; transfer starting for drp-xxxxxxx.img (4488015872 bytes).
426 Cannot retrieve. Failed. Connection reset (10054).
Transfer Failed!
PASV
227 Entering Passive Mode (999,999,999,999,181,62).
REST 4199860
350 REST supported. Ready to resume at byte offset 4199860.
RETR drp-xxxxxxx.img
150 Data connection accepted from 111.111.111.111:4417; transfer starting for drp-xxxxxxx.img (4488015872 bytes).
426 Cannot retrieve. Failed. Connection reset (10054).
Transfer Failed!
PASV
227 Entering Passive Mode (999,999,999,999,17,39).
REST 25367988
350 REST supported. Ready to resume at byte offset 25367988.
RETR drp-xxxxxxx.img
150 Data connection accepted from 111.111.111.111:4420; transfer starting for drp-xxxxxxx.img (4488015872 bytes).
426 Cannot retrieve. Failed. Connection reset (10054).
Transfer Failed!
PASV
227 Entering Passive Mode (999,999,999,999,39,82).
REST 29382068
350 REST supported. Ready to resume at byte offset 29382068.
RETR drp-xxxxxxx.img
150 Data connection accepted from 111.111.111.111:4421; transfer starting for drp-xxxxxxx.img (4488015872 bytes).
(soft abort)
ABOR
426 Cannot retrieve. Failed. Aborting
226 ABOR command successful.
User Aborted

[bigstar]

from the menu, Directory > View raw directory, now compare the file size listed to the size returned by the SIZE command, do they match?

I'm not clear as to why the error reports a reset connection.

Would it be possible to give me access to the server so that I could further investigate the problem.

[melonhead]

This is the ouput from the RAW dir

-rw-r--r-- 1 ftp ftp 4488015872 Jan 25 17:26 drp-XXXXXXX.img


i'm sorry but it's not my FTP site, so i'll have to get permission.

regards,

Tim

[bigstar]

From what i'm seeing the SIZE command reports a different value then that of the raw listing.

As such BPFTP is not 100% capable of dealing with large files.

FlashFXP relies on the accuracy of the SIZE command reply, if this value is wrong FlashFXP can not reliably resume the file.

[Question]

I have exaktly the same problem!
But cuteFTP dont work for me, not even internet explorer, i would be happy if someone solves it!

[bigstar]

Originally posted by Question
I have exaktly the same problem!
But cuteFTP dont work for me, not even internet explorer, i would be happy if someone solves it!

What exactly is your problem? In the previous posts the problem was caused by the FTP Server, it didn't fully support large files.

[Question]

I connect to a FTP server wich has .img files who is about 4gigabytes big and it shows the size about 400mb. Other people on the server can see the right size but not me. I use a bit older version of Flash fxp but I have tryed the newest version but it shows the same size. We have another computer in the house wich does the same thing! When about 2-2,5gigs are downloaded, flash fxp stops downloading. When i choose resume, it downloads but the file doesent get bigger!Not even in an hour it gets bigger. I go nuts! I would be very happy if you could help me!
By the way, I love your program;)

[MxxCon]

Question, read forum posting rules for required information http://forum.flashfxp.com/showthread.php?s=&threadid=3078

[bigstar]

Which specific versions/builds of FlashFXP did you try?

[Question]

* FlashFXP v[ 2.0.908].[ ], build [ ], [yes]registered, [ ]unregistered, [ ]pirated
* OS [ ] WinXP, [ ] Win2K, [yes] Win98, [ ] WinME, [ ] Other
* Running behind NAT/router [yes] Yes & Model [dlink], [ ] No, [ ] Not sure
* Running firewall [yes, dlink router] Yes, Name [ ], Ver. [ ], or [ ] No
* Running Antivirus [yes] Yes, Name [Norton 2003] or [ ] No
* Network [ ] xDSL, [yes] CABLE, [ ] Dail-Up, [ ] Other

There we got it, i dont know what version the older one is but the new one acts the same!

[bigstar]

build 908 was a beta which may not of properly supported large files, please download the final version. http://www.flashfxp.com/download.php

[Question]

It didnt work with the new wersion either=(

[bigstar]

Do you have any idea what ftp server software is being used? More than lilkely the ftp server is to blame.

[Question]

I started to investigate in the ftp software and I am pretty sure it´s it. I changed to bulletproof v2.21 bur now it just says 0kb big files so now i an looking for something that can help the server. If you have an idea what i can do, it would be nice!


EDIT:
I have solved it, it was both flash fxp and the server that was wrong, it works now!
Thanks for the help!

[Question]

I have a problem, when i download large .img or .iso or files like that, the program keeps on downloading after the file is finished! I hade control over the compuer i am downloading from so i can see that the size is correct. So when the download is finisht and the sizes match, flash fxp keeps on downloading and the file i getting bigger! I dont know how this is possible!
I use Flash FXP 2.1, the server software is bulletproof 2.21
If i try to munt the image it works but the file is bigger then it should be and that annoys me. It doesnt go on in the file list. If i disconnect and takes go, it says, do you want to resume you file?(big) with this file(small) but i cant resume.

If i mount the image and take properties, it says that the cd is 4,32gb och it matches with the server but not with the size on my computer. It is like it downloads just nothing but the file is getting bigger!

[MxxCon]

ok you made new thread instead of continuing posting where you started..
http://forum.flashfxp.com/showthread.php?s=&threadid=3350
last thing in that thread you said fixed this problem
so is it fixed or what:confused:

[bigstar]

threads merged

[Question]

This problem is not solved:(
When i download big files the problem appears, the right size is displayed in flash fxp and I know that because i can control the server from radmin. I use windows 2000 eng with sp4. I still use flash fxp 2.1 and i dont know what build:(

[bigstar]

Originally posted by Question
This problem is not solved:(
When i download big files the problem appears, the right size is displayed in flash fxp and I know that because i can control the server from radmin. I use windows 2000 eng with sp4. I still use flash fxp 2.1 and i dont know what build:(

Can you please find out the build number, not all builds of v2.1 support big files. I would recommend upgrading to the latest just to be sure.

[Question]

The build is 920, the newest was 922, is it any difference?

[bigstar]

I'm afraid I don't have any information regarding the specific changes between build 920 and 922. Build 920 was a beta release and was not considered a stable release.

[Question]

Originally posted by bigstar
I'm afraid I don't have any information regarding the specific changes between build 920 and 922. Build 920 was a beta release and was not considered a stable release.

Ok, I update then ad try.

[Question]

I have now updated to 2.1.922 and still some files does the same=(
Some suggestions?

[Shark]

Originally posted by Question
I have now updated to 2.1.922 and still some files does the same=(
Some suggestions?

FlashFXP 2.2.966 is the current beta release and 2.1.924 is the latest non registered users build.

[Question]

I cant find a update file, I am a bit tired of reinstalling all the time.

[bigstar]

Question If build 922 don't work i'm afraid you're out of luck, the problem must be with the ftp server. However if you still have doubts and want to send me the site details privately I'd be happy to confirm this.

[Question]

Ok, do you think it will be solved if I update to 924?
Is there a update file?
The server software is 2.21 bulletproof, i think it is the latest. (Edit: Have checked and it is the latest version)
Edit 2: I have updated to 2.1.924, I dont know if it works as it should yet.

[bigstar]

v2.1 was a major release, there isn't an upgrade.

builds 922 and 924 are virtually identical the changes that were made only effect how FlashFXP behaves during the trial period. They do not effect how FlashFXP works or fix any bugs.

[Inqu]

Question If build 922 don't work i'm afraid you're out of luck, the problem must be with the ftp server. However if you still have doubts and want to send me the site details privately I'd be happy to confirm this.

Well, I use Flashfxp 2.1 build 924 and have noticed the resume error on two different ftp server's so far.

It happens everytime when you resume a large file (+4gb). The servers used were ProFTPD 1.2.8 Server (ProFTPD Default Installation) on linux and Bulletproof 2.2.1 Build 11 in windows.

I've triplechecked my rules and seen it ask for a resume everytime its supposed to and everytime the result has been that the file on my hd is bigger than the one I'm dloading, flashfxp showing ??:??:?? as remaining time.

If I dload the file nonstop it works fine.

I'm gonna try some other client if the resume works better on them but I wouldn't wanna ditch flashfxp.. :(

Fix it!


* FlashFXP v[2 ].[1 ], build [924], [x]unregistered,
* OS [x ] WinXP
* Running behind NAT/router [ x] No
* Running firewall [x ] Yes, Name [Sygate 5.5]
* Running Antivirus [ x] Yes, Name [AVG 7 pro]
* Network [x ] xDSL

[bigstar]

On the ftp server issue this raw command "SIZE <filename>" where filename is the name of a large file. More than likely SIZE is reporting the wrong size. This is where many FTP servers fall short when supporting large files. FlashFXP requires a valid result from SIZE in order to properly resume the file.

[Inqu]

The size matches excatly if I do a "size filename" on ftp or look it up on windows explorer.

It's something else.

[bigstar]

Originally posted by Inqu
The size matches excatly if I do a "size filename" on ftp or look it up on windows explorer.

It's something else.

For clairification are you uploading, downloading or fxping?

I have been unable to reproduce this problem on several other ftp servers, I will be testing proftpd shortly.

[Inqu]

Downloading.
I did the size test to bpftp, I'll do that to proftpd once I get ahold of the owner so he can verify the filesize.

[bigstar]

You sure about bpftp? According to the changelog at http://www.bpftpserver.com/?page=files/version.txt&action=view&lang=en the SIZE command didn't support 4+gb files until v2.21

[Question]

I hade still got the same problem, and as someone said, I cant remember downloading a file without resuming that has fail but the latest 4gig+ that i resumed have all gone wrong. Im going to test with cute ftp och see the results.

[Inqu]

Originally posted by bigstar
You sure about bpftp? According to the changelog at http://www.bpftpserver.com/?page=files/version.txt&action=view&lang=en the SIZE command didn't support 4+gb files until v2.21

Yes I'm sure about bpftp, like I said earlier the version is that 2.2.1.

I just got the results from ProFTPD 1.2.8, flashfxp says:
size xxxxx.img
213 4311377920

..and from linux itself the size is identical: 4.0gb (4,311,377,920)

So that can't be the source of resume probs, both seem to handle the size cmd.

[bigstar]

Is your hard drive formatted as NTFS or FAT32?

Using ftp servers that I know support large files (serv-u & ioftpd) I have been unable to reproduce or detect any problems transferring large files.

[Inqu]

Originally posted by bigstar
Is your hard drive formatted as NTFS or FAT32?

Using ftp servers that I know support large files (serv-u & ioftpd) I have been unable to reproduce or detect any problems transferring large files.

The hard drives are NTFS on both server and client.

Too bad you can't reproduce it, because I experience it all the time. :confused:

[bigstar]

Please try FlashFXP v2.2 build 971
You can download it here (http://forum.flashfxp.com/showthread.php?s=&threadid=3911)

[Question]

When is the next version released?
Every time i have to resume a dvd it makes this problem every time.

[bigstar]

Which build are you currently using now?

The latest beta build has been tested countless times against 4+GB files (including resume).

[Question]

I use 2.1.924. Every time i resume the file goes nuts.