Skip to main content

Be able to specify a "growtime" on file/folder tasks.

Comments

5 comments

  • Jim Meyer

    Hi Gert....

    I would like to know more about any file corruption you are getting. You mention FTP but can you give me any specifics? Are you using Mover's FTP or is it some other external app?

    Before Smart Mover acts on any file it checks to make sure the file is not busy.  It does this by trying to open it with write access.  The operating system should deny that request if any other operation also has write access.

    If the file cannot be opened with write access then it is skipped until the next time the Process runs.

    It is certainly possible that some external processes do not keep the file open/locked the entire time it is operating on the file...  and your suggestion could solve this problem.  But you are also relying on a "file size" OS call to be 100% correct at all times.  My experience with at least some OS is that some file attributes may not be updated immediately upon completion... 

    It is also possible that there is a situation where Mover is not making the proper check and files are slipping by.

     

    0
  • Gert Blekkenhorst

    Hi Jim,

    This e.g. shows where external sourced send in data over FTP (e.g. Press Agencies) , or external programs (PitStop, Claro, etc.) save data to a shared (NFS) location.

    These do not lock the files, the basically write/append blocks of data to a file. 

    It's in general Linux/Linux or Linux/Windows based and in general NFS shared devices. (no distributed lock manager here, like with VAX/VMS in the old-days.)

    Using "find" like the sample below (which only copies files with a size>0 not modified in the last minute) currently solves it in those cases.

    find /home/PitStop/pdf/*/Output -size +0 -mmin +1 -name *.pdf -exec cp {} /tmp \;

    //Gert

    0
  • Jim Meyer

    I could create a new Mover Task that would simply copy files from one folder to another only after they have been "stable" for some period of time....  Then you could just use that new Task before any of these situations. 

    Would that work for you?

    0
  • Gert Blekkenhorst

    Hi Jim,

    Yes, that would certainly work for us.

    //Gert

    0
  • Jim Meyer

    OK....  It will not make it into the next release which is ready except for documentation...  but I will try to add such a feature in the next one after that.

    0

Please sign in to leave a comment.

Post ID: 360043266732

Created at: 2019-04-09 09:41:23 UTC

Updated at: 2019-04-24 14:30:00 UTC

Edited at:

Comment count: 5

Follower count: 2

Vote sum: 1

Vote count: 1

Status: none