hiteksoftware.com Forum Index hiteksoftware.com
User discussion forum
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

FTP Get files fails on scheduled task

 
Post new topic   Reply to topic    hiteksoftware.com Forum Index -> FTP & SFTP
View previous topic :: View next topic  
Author Message
eric



Joined: 11 Jan 2007
Posts: 9

PostPosted: Thu Jan 11, 2007 10:02 am    Post subject: FTP Get files fails on scheduled task Reply with quote

I have created a FTP get job using Automize that involves subdirectories, 11 (1997 - 2007) to be exact. The job is set up to get files from a remote FTP server (IIS) setup with the same folder structure (not on premises) and update another remote server on location. What is happening is that I'm getting a Exit code of 1 and error msg "Connection aborted by peer: Socket write error. It doesn't complete the job

If I run the job manually through the FTP profiles\connect and try and sync the folders individually it works without a problem.

Is there a limatation on the number of files that can be let's say sync'd? There's roughly about 100,000 file that it must sort through to see if newer files exists. I've checked with the location hosting our FTP server and they can't find anything on there end that would be preventing disconnects and forcing the error "Connection aborted by peer: Socket write". The process always seem to timeout in the 6 to 7 min range.

Automize 6.36 is setup on a computer inbetween the two servers.
Running on Win XP SP2
Any help is greatly appreciated.
Back to top
View user's profile Send private message
Robert
Site Admin


Joined: 25 May 2006
Posts: 1140

PostPosted: Thu Jan 11, 2007 12:46 pm    Post subject: Reply with quote

1) 100,000 files is a lot in the directory and may be the cause.

2) however, if it works throught the manual ftp browser, then it should work from the task too. Both the task and the browser use the same Ftp api.

3) How frequent is your schedule? are there overlapping schedules possible? if so, use the engine menu / Synchronization profiles. create a new profile with the following settings:
option - no overlapping task instances. single instance waits
wait time = 10 minutes (less than schedule frequency)
after wait option = do not run task

4) Make sure that there is no overlapping Ftp connections. ie.. if you have opened the ftp browser, shut it down and then see if your task runs.
Back to top
View user's profile Send private message
eric



Joined: 11 Jan 2007
Posts: 9

PostPosted: Thu Jan 11, 2007 1:58 pm    Post subject: Reply with quote

The task is scheduled to run 1 time per day 10:00 pm. I'm 99.9% sure there's no overlapping. But to make sure I went ahead and setup a Sync profile anywhy to to assure that there's no other task running.

The approximate size of all 100,000 + files is 327mb on the disk.
I haven't had the browser running at the same time I was running the manual "Run Scheduled task now" option and still end up with the same error. I will post a snipit of the debug log tomorrow. 5PM est. cost time here. Thanks for getting back to me so quickly.
Back to top
View user's profile Send private message
melvin
Site Admin


Joined: 25 May 2006
Posts: 595
Location: Santa Barbara, california

PostPosted: Fri Jan 12, 2007 6:59 am    Post subject: Reply with quote

It is not likely to be the file size but rather the number of files in the directory. I have a feeling that the task could be running out of memory while doing the listing. I have no idea why the manual ftp browser does not have the same issue.

Run the task again and email us (support@hiteksoftware.com) the support.zip file using the Help menu / email support generator.

do you get the same error using 7.21?
Back to top
View user's profile Send private message Send e-mail
eric



Joined: 11 Jan 2007
Posts: 9

PostPosted: Fri Jan 12, 2007 8:56 am    Post subject: Reply with quote

I've emailed you a copy of the support.z*p file as requested. I look forward to any resoultion you may have.
Back to top
View user's profile Send private message
eric



Joined: 11 Jan 2007
Posts: 9

PostPosted: Fri Jan 12, 2007 8:58 am    Post subject: Reply with quote

I don't have version 7.21. We are have version 6.32. Are we entitled to a free upgrade to 7?
Back to top
View user's profile Send private message
Robert
Site Admin


Joined: 25 May 2006
Posts: 1140

PostPosted: Fri Jan 12, 2007 10:30 am    Post subject: Reply with quote

No, the upgrade to 7.x requires an upgrade license. However, you can install it, and run/test it for 30 days. Import your 6.x ftp task and test and see if it works in 7.x. It seems to be a memory issue which may fare better in version 7 (uses java 1.4 machine) as opposed to version 6 (java 1.3 machine).
Back to top
View user's profile Send private message
eric



Joined: 11 Jan 2007
Posts: 9

PostPosted: Fri Jan 12, 2007 10:32 am    Post subject: Reply with quote

Thanks, I'll give 7 a try and repost results.
Back to top
View user's profile Send private message
eric



Joined: 11 Jan 2007
Posts: 9

PostPosted: Thu Jan 25, 2007 11:33 am    Post subject: Still unable to get ftp modified files with new version Reply with quote

I took your advise and I'm trying out the 7.22 version of mize. But unfortunatly I'm still unable to sync all of my ftp remotely subfolders. Is there a way for me to A. Use the Folder path filter because all I need really need to update is modified folders from 3 folders. ie. 2005,2006,2007. Or, B. Setup a chain.

Any suggestions are greatly appreciated.
Back to top
View user's profile Send private message
Robert
Site Admin


Joined: 25 May 2006
Posts: 1140

PostPosted: Thu Jan 25, 2007 3:44 pm    Post subject: Reply with quote

A chain would be preferable with 3 separate ftp tasks.

Run 1 Ftp task first vs. folder 2005. I assume that this would be aroung 10,000 files? test if it works.
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic   Reply to topic    hiteksoftware.com Forum Index -> FTP & SFTP All times are GMT - 8 Hours
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2005 phpBB Group