Robocopy faster7/15/2023 ![]() The first tar command creates a file called ‘-’, which is a special token meaning ’standard output’ in this case. | remsh box2 "cd target_directory tar xf - " ‘rsh’ is some kind of restricted shell in HP parlance. Note also that, as usual, HP-UX is awkward - whereas the rest of the world uses ‘rsh’ for the remote-shell command, HP-UX uses ‘remsh’. rhosts files in the home directories of each machine (remove these after they copy is complete - they are notorious security problems). Note that you’ll need to enable r-commands by creating. The tar approach almost doubled the rate of transfer compared to scp or rsync (YMMV). I wrote a tiny script to pipe the output of the tar command across to the target machine directly in to a receiving tar process which unbundled the files. In a similar situation, I tried using tar to batch up the files. Start Time, End Time and Number of files Copied. We reckon it takes about 12 hours or less for 1 year worth of transfer.Īll the stuff is logged in the log file. It took about 40 - 60 minutes for 1 month worth of transfer (about 35-45,000 files) Then comes destination directory (directories will be created on the fly as and when required). So for example files modified >= 01/Nov/2008 (inclusive) to files modified < 01/Dec/2008 (not inclusive) ROBOCOPY /NS /NC /NFL /NP /LOG :H:\BCK_REPORT\ROBO.LOG /MAXAGE:20081101 /MINAGE:20081201 /MOV H:\Cs\out\fix H:\BCK_REPORT\2008\11 minage and /maxage is to copy files modified with in that date range. ![]() is to write summary information to log file. ![]() ns /nc /nfl /np is to avoid bloating the log file with additional info We had about 1 million files in a directory (about 4 year's worth of files).Īnd we used robocopy to move files to YYYY/MM directory (about 35-45,000 files per month). ![]()
0 Comments
Leave a Reply. |