| View previous topic :: View next topic |
| Author |
Message |
eric
Joined: 11 Jan 2007 Posts: 9
|
Posted: Thu Jan 11, 2007 10:02 am Post subject: FTP Get files fails on scheduled task |
|
|
I have created a FTP get job using Automize that involves subdirectories, 11 (1997 - 2007) to be exact. The job is set up to get files from a remote FTP server (IIS) setup with the same folder structure (not on premises) and update another remote server on location. What is happening is that I'm getting a Exit code of 1 and error msg "Connection aborted by peer: Socket write error. It doesn't complete the job
If I run the job manually through the FTP profiles\connect and try and sync the folders individually it works without a problem.
Is there a limatation on the number of files that can be let's say sync'd? There's roughly about 100,000 file that it must sort through to see if newer files exists. I've checked with the location hosting our FTP server and they can't find anything on there end that would be preventing disconnects and forcing the error "Connection aborted by peer: Socket write". The process always seem to timeout in the 6 to 7 min range.
Automize 6.36 is setup on a computer inbetween the two servers.
Running on Win XP SP2
Any help is greatly appreciated. |
|
| Back to top |
|
 |
Robert Site Admin
Joined: 25 May 2006 Posts: 1140
|
Posted: Thu Jan 11, 2007 12:46 pm Post subject: |
|
|
1) 100,000 files is a lot in the directory and may be the cause.
2) however, if it works throught the manual ftp browser, then it should work from the task too. Both the task and the browser use the same Ftp api.
3) How frequent is your schedule? are there overlapping schedules possible? if so, use the engine menu / Synchronization profiles. create a new profile with the following settings:
option - no overlapping task instances. single instance waits
wait time = 10 minutes (less than schedule frequency)
after wait option = do not run task
4) Make sure that there is no overlapping Ftp connections. ie.. if you have opened the ftp browser, shut it down and then see if your task runs. |
|
| Back to top |
|
 |
eric
Joined: 11 Jan 2007 Posts: 9
|
Posted: Thu Jan 11, 2007 1:58 pm Post subject: |
|
|
The task is scheduled to run 1 time per day 10:00 pm. I'm 99.9% sure there's no overlapping. But to make sure I went ahead and setup a Sync profile anywhy to to assure that there's no other task running.
The approximate size of all 100,000 + files is 327mb on the disk.
I haven't had the browser running at the same time I was running the manual "Run Scheduled task now" option and still end up with the same error. I will post a snipit of the debug log tomorrow. 5PM est. cost time here. Thanks for getting back to me so quickly. |
|
| Back to top |
|
 |
melvin Site Admin
Joined: 25 May 2006 Posts: 595 Location: Santa Barbara, california
|
Posted: Fri Jan 12, 2007 6:59 am Post subject: |
|
|
It is not likely to be the file size but rather the number of files in the directory. I have a feeling that the task could be running out of memory while doing the listing. I have no idea why the manual ftp browser does not have the same issue.
Run the task again and email us (support@hiteksoftware.com) the support.zip file using the Help menu / email support generator.
do you get the same error using 7.21? |
|
| Back to top |
|
 |
eric
Joined: 11 Jan 2007 Posts: 9
|
Posted: Fri Jan 12, 2007 8:56 am Post subject: |
|
|
| I've emailed you a copy of the support.z*p file as requested. I look forward to any resoultion you may have. |
|
| Back to top |
|
 |
eric
Joined: 11 Jan 2007 Posts: 9
|
Posted: Fri Jan 12, 2007 8:58 am Post subject: |
|
|
| I don't have version 7.21. We are have version 6.32. Are we entitled to a free upgrade to 7? |
|
| Back to top |
|
 |
Robert Site Admin
Joined: 25 May 2006 Posts: 1140
|
Posted: Fri Jan 12, 2007 10:30 am Post subject: |
|
|
| No, the upgrade to 7.x requires an upgrade license. However, you can install it, and run/test it for 30 days. Import your 6.x ftp task and test and see if it works in 7.x. It seems to be a memory issue which may fare better in version 7 (uses java 1.4 machine) as opposed to version 6 (java 1.3 machine). |
|
| Back to top |
|
 |
eric
Joined: 11 Jan 2007 Posts: 9
|
Posted: Fri Jan 12, 2007 10:32 am Post subject: |
|
|
| Thanks, I'll give 7 a try and repost results. |
|
| Back to top |
|
 |
eric
Joined: 11 Jan 2007 Posts: 9
|
Posted: Thu Jan 25, 2007 11:33 am Post subject: Still unable to get ftp modified files with new version |
|
|
I took your advise and I'm trying out the 7.22 version of mize. But unfortunatly I'm still unable to sync all of my ftp remotely subfolders. Is there a way for me to A. Use the Folder path filter because all I need really need to update is modified folders from 3 folders. ie. 2005,2006,2007. Or, B. Setup a chain.
Any suggestions are greatly appreciated. |
|
| Back to top |
|
 |
Robert Site Admin
Joined: 25 May 2006 Posts: 1140
|
Posted: Thu Jan 25, 2007 3:44 pm Post subject: |
|
|
A chain would be preferable with 3 separate ftp tasks.
Run 1 Ftp task first vs. folder 2005. I assume that this would be aroung 10,000 files? test if it works. |
|
| Back to top |
|
 |
|