There is no way to disable the listing however you could try one the following
1. abort the listing, it should stop while remanining connected to the server. some servers are fussy and will disconnect you but most wont.
2. create a custom command with the code "&cd <path>" without quotes, this will change to the directory with all those files without performing a list. the CWD command wont work directly because it doesn't update the internal paths.