Priority Queue (input needed)

[bigstar]

Many people have asked me to add this feature.. It's been on my TO-DO list for ages. I decided to re-visit this feature today and started thinking about how it would work, After some brain storming I've come to the conclusion that I'm not entirely sure how everyone wants it to work.

So what I would like from you is a detailed explaination of how you think it should work and I'll go from there. The basic fundamentals of what the prior queue will achieve and how it will achieve it in theory.

Due to limitations of the current design it's not possible to make it function exactly the same way as transferring *.sfv files first does.

[MidKnight]

can you make an extra tab like the skip list so extentions can be add, then flash will transfer any of these before anything else?

[DYN_DaTa]

Hummm... what about to make a dialog box where an user will type file extensions (as .txt, .nfo, .sfv, .zip, etc...) as the dialog box that appear on "Skip List"?. The first file extension will be the first file type that will be transfered (if exists on the queue), the second file extension of this list will be the second file type that will transfered (if exists on the queue) and so on...

As "Skip List" window, you could put "When to queue priority" checkboxes: Automatic File Transfers, Manaul File Transfers or Both. Also, you can create, under "Options" menu an option called "Queue priority" where it would be the dialog box, the chekboxes, etc...

[bigstar]

Hmm, I thought I explained myself rather well but now I'm not sure.

That's not what I was asking.. and your replies are irreverent to my question.

What I wanted was the basic fundamentals of what the prior queue will achieve and how it will achieve it in theory.

[voystar]

First off thx bigstar for putting this on a lil priority on the TO-DO list ;) Well let's try to give you my understanding on the priority list.

People want to upload certain files first (same for download), because some sight might specify or require to upload some files first, so this is done already with the *.sfv. Now here is what users want (speaking of myself and trying to include others).

Declare our own files/file-extensions which should be uploaded first (not only the sfv). So that you could include a new Tab next to the Skip list for "queue rules" or whatever u wanna call it and give the user an option to do the following:


User can specify certain files, global extensions, folders
Rules can be specified in a drop-down menu such as
Upload/Download first (Rewrite it as Top of queue if ya want)
Upload/Download last (or put on bottom of queue... however)
Upload/Download after {user can specify file/extension}
Upload/Download before {user can specify file/extension}
Extensions should be multiple too, meaning *.r* should be possible well u know this I bet


I hope I explained my needs a little bit. This is how I understand it. Let's take a test case: SITE needs "sample" folder first including the *.nfo and the SAMPLE*.mpg file in it; now the rules manager (woo another cool name for it) should be able to clarify it, so that I only have to take my premade folder from my harddrive shove em in the queue and flashfxp uploads them in the right order.
Another sample case: User "Mr X" wants always that the *.iloveflashfxp gets downloaded first because he has a fetish with a talkative developer. So FlashFXP should allways download that file first.


Got my point?

I don't like Rain in New York, you never know what's in it
voystar

[bigstar]

Well this isn't on the priority list and it wont be added in the immediate future. (It will not make it into the next non-beta release) However in order to add this feature I need a better understand about how people expect it to work.

Hmm so there should be two seperate lists then, an upload and a download?

Moving the file to front or back of queue wasn't even a consideration. Don't you think that's a bit overkill?

[Dazog]

it comes down to the smallest file

Mostly people want to grab the smaller of the files first then the larger ones

atleast this is what I do I que up the smaller files

OR
the begining of archives .rar .00 or .ace ... First

OR

By Time/Date uploaded of the files in the current Dir

?

Just some ideas on how to or what people want?

[voystar]

Well bigstar what was your understanding and thinking about the problem up until now? I understood the most posts like my first sample, uploading/downloading the *nfo first or Sample or so. If not moving it in the queue how else do queue rules apply.

The last post gave some other ideas I didn't consider are very possible to think of and would be nice to include too yeah.

Its dark at night
voystar

[MxxCon]

how about have <everything> entry always there and then users can add strings and move them above/below <everything>?

or..i don't know if ppl really need upload last...maybe just list of strings in which order you want files u/led 1st?

well, sort of queue is somewthing differnt from priority list..

[MidKnight]

i have to agree with voystar first post, something like this would be a hell of a feature to have. i think you would make many, many people happy if they had this type of setup..

Count me as #2

[voystar]

MxxCon wrote:
or..i don't know if ppl really need upload last...maybe just list of strings in which order you want files u/led 1st?
well, sort of queue is somewthing differnt from priority list.

I don't think so either, but I mean one more string is not that bad of a thing and maybe some weirdos need it.
And what is the difference? I seriously don't know since I prioritize some files or sort 'em in front... well I guess sorting is more complex.

bigstar: yeah I think 2 seperate lists would be appropriate here, since there might apply different rules for upload/download. And NO moving files in the queue an overkill? I'd love that.

Again I have to ask: What did you understand under a priority list? If not a queue ruling.

Even New York is dark at night
voystar

[bigstar]

Well to be honest after seeing your posts it's nothing like I had in mind. Now I'm starting to worry what you want isn't going to be possible without alot of major rewriting. In which case this feature will not be added. sorry.

Let me explain how the .sfv is transferred first.
(It's very simple)

When FlashFXP enters a folder the content is inserted into the queue directly below the folder + the index, now when it's a .sfv file it's added directly below the folder.

Obviously from what you guys are suggesting this method will not work.

[Shark]

Firstly, my impression of this issue is that it has gotten way out of hand.

The concept I (and others) had in mind is as follows:
(please understand this is a little hard to put into text bigstar)

The settings/options for this would be in the filters section, under a Priority List tab or simular. It would have the same basic look as the Skip List tab/section.

Having an enable tick box, a list of files, file mask's rather. With add/delete and possibly a right click edit option to make it a dir (if this is possible, or if not, dont bother)

My impression on priority within the priority list is not a viable option and not needed in any case, the only file which should always have supreme priority would be the .sfv file, the rest of the files within the priority list would basically be put to the top depending on which FFXP saw first when being queued.

I understand this is a little complex and I have attempted to put this all in an understandable text.

Please let me know if any clarification is needed, or any other questions about this.

P.S. I do not recommend a priority list in a backwards manner like someone suggested, ie. having a list which makes certain files go to the bottom of the queue. This is totally unneeded.

The only other option to have in the right click pop box (when file mask is selected) would be maybe, and only maybe.. a tickbox for upload / download. So you can have either or both.

[voystar]

bigstar: Itwas indeed a lot what I suggested, but as I said... only suggestions it wasn't intended to be a complete list of MUST have features,I just tried to include everything I could think of. Shark narrowed it down to the basics with which I think the most would be very happy with.
When FlashFXP enters a folder the content is inserted into the queue directly below the folder + the index, now when it's a .sfv file it's added directly below the folder.
Like Shark said... don't only look for sfv files, but our own specified files/extensions. I think the old method should work fine here too, just add a little interface as Shark suggested.

Internet Cafe Keyboards suck
voystar

[bigstar]

Like Shark said... don't only look for sfv files, but our own specified files/extensions. I think the old method should work fine here too, just add a little interface as Shark suggested.

I was under the impression that people wanted a specific order of patterns matching... say if you had *.txt and *.html but wanted *.txt to transfer first. With the existing design this isn't possible. Not just *.sfv always first.

[voystar]

Well if it's too hard doing a specific order in files it might be allright just putting everything random but transferred first. I think it would be better to specify (i like that word don't I) your own rankings of files... but if that's too much work bigstar just do it how u think it's the easiest and best!

[Shark]

Yeah, I think getting it added like I said, and then later on thinking about the other order options. But its not really needed to get the priority queue going.

Add the simple easy (less confusing) way.. then see if the other way is really needed.

[jinxdone]

This is what i suggested:

In theory that is.

1.
copy filelist to temp

2.
Compare filename1, if matches skiplist rule#1 skip instead of putting to queue and delete from temp list
Compare filename2, if matches skiplist rule#1 skip instead of putting to queue and delete from temp list

Compare filename1, if matches skiplist rule#2 skip instead of putting to queue and delete from temp list
Compare filename2, if matches skiplist rule#2 skip instead of putting to queue and delete from temp list

3,
Compare filename1, if matches priority list rule#1 dump to queue and delete from temp list
Compare filename2, if matches priority list rule#1 dump to queue and delete from temp list

Compare filename1, if matches priority list rule#2 dump to queue and delete from temp list
Compare filename2, if matches priority list rule#2 dump to queue and delete from temp list

4.
Put the rest of the files to queue


Im not talking about how efficent that would be, but its the theory of how it should work in my opinion..

[Fused]

Your current method of simply "putting it first" ahead of everything else is entirely workable from a logcal point of view.

If you have an interface for a priority list, you start from the bottom and work your way up, this way your method still works and users can do what youre worried about (txt before html).

ie. I create a Queue First list in FlashFXP like this:
Sample
*.sfv
*.nfo

Now when you enter the directory you do the same thing you're doing for the .sfv right now, but start at the bottom and loop it. ie:
- your first job with the above list is to look for *.nfo, then you move them to the top.
- your second job is to look for *.sfv, then move them to the top
- and so on.

This way you end up with your higher priority files/fodlers (Sample in the example) being the LAST thing moved to the top before the queue starts transferring. And now everything is in order and everybody's happy!

This could be done with relative ease with an external utility modifying and reloading FQF files, so i would hope it's just as simple with an internal process. You create a temporary queue (but dont draw it in the queue list), perform the sorting ops on the file, and then load that into the queue.

It sounds like a long drawn out process but in reality it is a very fast thing to accomplish.

[codex666]

Just wondering Bigstar,

Do you have any idea when you have the time to work on this?
just curious...

[indomiti]

Just send .sfv first and then the .nfo and then the rest, thats it.

Please implement it in 2.0 Final :-)

[raven]

A list would be nice to order the files with masks. This list could be parsed when you enter each directory and get the ls -al result. Something like:
*.sfv
*.nfo
*.txt
...
...
...
*(all other files)

Maybe also a choice for all other files that has lower priority than this list. I can see six choices there:
Transfer smallest files first
Transfer largest files first
Transfer oldest files first
Transfer youngest files first
Transfer alphabetically ascending (a-ö)
Transfer alphabetically descending (ö-a)

Best regards
Raven

[Jesper]

To me it seems like BigStar wont add it, unless he finds an easy solution (which makes perfectly sence to me, as re-writing a larger portion of the code for 1 little feature is plain waste of time), and that he needs a good description on how it should be done, well here is my theory:

Add a new "Xfer Method" to the options tab, which brings up a dialog window "Files First" (with an "activate" button).

Coded in as priority 1 is *.SFV (ghosted out and cant be changed).
Then you add your priority list as
*.nfo priority 2
*.php priority 3
etc etc

Then you que your dirs/files:
Then you starts to transfer your que

Correct me if im wrong on this one
When FFXP enters a dir it checks for a SFV file, before it starts the transfer, and if its there, FFXP put that in top of que.

When it perform this check it should also check if the "Files First" is activated, if it is then re-sort the que (dir by dir, and if there is no dirs in the que then just sort files to put "Files First" on top) according to the method selected in the "Files First"
If the "Files First" is inactive then transfer as it does now.

Do I make any sence atall :confused: :D

[bigstar]

Originally posted by Jesper
Correct me if im wrong on this one
When FFXP enters a dir it checks for a SFV file, before it starts the transfer, and if its there, FFXP put that in top of que.

When it perform this check it should also check if the "Files First" is activated, if it is then re-sort the que (dir by dir, and if there is no dirs in the que then just sort files to put "Files First" on top) according to the method selected in the "Files First"
If the "Files First" is inactive then transfer as it does now.

Do I make any sence atall :confused: :D

Nope, it doesn't work like that.

There is a single loop thru the file listing, files are added to the queue starting at X, each file is appended, when a .sfv is encountered its inserted at X. thus becoming the first file transfered. It's very simple however this type of design does not allow for multiple priorities.

[Jesper]

What im about to ask may sound lame :)

but when using Norton Speed Disk (disk defragmanter)
you can specify which files to place first, last etc etc

Wouldnt it be some kind of the same that FFXP needs to be able to download files according to a priority list ?

...................
Edited from here
...................

Or maybe its somehow possible to make a custom list/sort order in the FTP/Local tree windows where *.nfo is listed on top, that way it will always be #1 in que/transfer.

[NiTruS_2]

We just need the ability to queue by filesize,name,date..etc

biggest --> smallest
smallest --> biggest
a to z
z to a
1 to 10
10 to 1

and when everything is queued,the ability to click on column header to sort in actual queue?

ne1 else agree? understand?

[Shark]

I understand Nitrus, and its already on the list of things to do...

It also has nothing to do with this forum :)

Lets stick to the topic, thanks.

[StarBuG]

Hmmmm

It the user specified list isn´t possible at the moment then can u implement that the *.nfo file and a sample folder (including the sample of course!) are transfered first?

I think that would help 90% of all the people asking here!

Normaly it looks like:


Folder
- cd1
- *.sfv
- files
- cd2
- *.sfv
- files
- sample
- sample file
- name.nfo

and it should be queued like:

Folder
- name.nfo
- sample
- sample file
- cd1
- *.sfv
- files


hope that makes it clear

Greetings

StarBuG

[melter]

here are my 2 cents, if they are of any value..

it seems to me (from your posts, and from my experience) that it is usually the case the smallest files are wanted to be uploaded first.. that is .nfo or .m3u or .txt or whatever..

so surely, the simplest way of implementing this, would be to allow the queue window to be sorted by filesize..

[MidKnight]

yes but the only problem with that ,is when some like myself want to download the .rar first (after the nfo, sfv etc), then go on as normal .rar00, .rar01, etc

[Lunake]

well it would be handy that there would be an option to upload the biggest file first after the sfv (i don't mean sorting by size :) )

[melter]

why would u wanna do that lunake?

if a priority queue is implemented successfully in 2.0 final, i will definately buy it.

[Shark]

Originally posted by melter


if a priority queue is implemented successfully in 2.0 final, i will definately buy it.


Well melter, as said many times throughout the forums... we are not working on new features for 2.0, as we are in a feature lock to finalise 2.0. I.e. get rid of all the bugs, etc.

So, maybe 2. something

[jslifer]

A feature along these lines would be useful for me as well and save me a lot of the time spent manually reordering the queue, which I do quite regularly.

I would be perfectly happy if SFVs were given ultimate priority and then any files or folders matching masks specified in a priority list were queued after the SFV in any order.

I think the skip list tab would be a good model for the frontend, or if you did decide to allow the user to specify the order within the priority list, you could use the highlight tab model.

JS

[StarBuG]

Now after the release of FlashFXP 2.0 Final are u planing to implement that feature in a newer build of FlashFXP 2.0?

Cause I don´t see it on ur to-do list!?

I think many many users would love to have this feature!

Greetings

StarBuG

[MidKnight]

oh yeah baby!:D Bring it on:p

[Shark]

Originally posted by 3-legged-goat
:( i was hoping for an added feature in the right click menu in the queue window to simply move (highlighted files) to top, or to bottom with keyboard shortcuts too, when there is 1000s of files the current click hold and drag re arrangement is not very effecient :o


Already an option.. ?

[dawnmaker]

Present way of file-listing sounds like carriages being hooked up to a train, sfv becomes the head when present.
Given that you want to take flashfxps limitations into account, can a changable 'list', separate for upload and download, with sfv on top, be added to X?
If not, can the present file-listing optionally prompt a second way without a major rewrite needed?
This is what I made of it after reading things above...

--------
-will the snow this year
fall again to hide white tracks
and enter wolf dreams-

[Bald0z]

bigstar, I might understand you don't want to change MUCH of code... but doing what is asked is, in a easy language like Delphi, not so time consuming also if you have to rethink about the procedure that adds .sfv files before everything else.

I did it in few hours (in Delphi), but as it is an external program it's not very nice having to reload the queue everytime (since my little proggie works on the queue file).

Your program is very nice, don't tell me a procedure like that is hard to make, please ;)

[bigstar]

It's not hard code. It's hard for me to understand the logic of how everyone wants it to function. Also people have to understand that items are added to the list on a first come basis, it's not like specific file types are added first. that does tend to make it a bit more difficult, but not impossible.

[MidKnight]

Bigstar couldn't you make something like the skip list so we can add what ever file/extension that should be uploaded/downloaded first, second, etc

[Cre]

Originally posted by bigstar
It's not hard code. It's hard for me to understand the logic of how everyone wants it to function. Also people have to understand that items are added to the list on a first come basis, it's not like specific file types are added first. that does tend to make it a bit more difficult, but not impossible.

What i'm looking for, and i think many others too, is something like this:

A small window:

[An Add button]
[A Delete button]
[An Edit button]

Now:
Click Add - A box comes up asking for a filepattern
You add the filepattern *.nfo (clicks 'ok')
Repeat - add the filepattern *sample* (clicks 'ok')

Now.. When you queue (or transfer a huge list of files) *sample* and *.nfo gets moved to the top of the list (just like .sfv does at the moment) and transfered first.

Easy as that... Nothing more complicated is needed..

[MidKnight]

You forgot one button, and "move up" and "Move down". this why you can have what ever order of those files you want upped/downed first, second, etc

[Bald0z]

bigstar... I think your software work this way....

1. Retrieve raw list from server
2. Parse list, line by line (files are ordered by the server, so basically "random" order).
3. Put the files in the visual control, and sort by name or so.
4. Each entry in the visual control is added to the queue, one by one. If extension = ".sfv" then it goes to the top of the queue.
5. Start the transfer.

You could do a cycle, after number 4, on the queue to put things up/down, as said in the "priority list".
Probably, making it putting ".nfo" before ".txt" (for example) wouldn't be easy, but I think that it would just be enaugh that *.nfo and *.txt and *Sample* are upped before anything else, that's all, doesn't matter if *.txt is upped before *.nfo or the opposite.

Think you get it , this way... the interface how it should work it's another job, but I don't think it will be hard :)

[bigstar]

Originally posted by Bald0z
bigstar... I think your software work this way....

1. Retrieve raw list from server
2. Parse list, line by line (files are ordered by the server, so basically "random" order).
3. Put the files in the visual control, and sort by name or so.
4. Each entry in the visual control is added to the queue, one by one. If extension = ".sfv" then it goes to the top of the queue.
5. Start the transfer.

You could do a cycle, after number 4, on the queue to put things up/down, as said in the "priority list".
Probably, making it putting ".nfo" before ".txt" (for example) wouldn't be easy, but I think that it would just be enaugh that *.nfo and *.txt and *Sample* are upped before anything else, that's all, doesn't matter if *.txt is upped before *.nfo or the opposite.

Think you get it , this way... the interface how it should work it's another job, but I don't think it will be hard :)

Yup, that's exactly how it works. This would be the easiest solution. However not everyone is sold on this behavior.

[Bald0z]

Originally posted by bigstar
Yup, that's exactly how it works. This would be the easiest solution. However not everyone is sold on this behavior.
I think it's:
1. Better than nothing.
2. What 95% of the users is looking for.

Would need some input from others...

[Shark]

Bigstar, thats how I explained how most wanted it originally..

[bigstar]

For those of you who haven't been paying attention you can download a BETA copy of FlashFXP that implements a Priority Transfer List. See this thread (http://forum.flashfxp.com/showthread.php?s=&threadid=2328)