Puppy Linux Discussion Forum Forum Index Puppy Linux Discussion Forum
Puppy HOME page : puppylinux.com
"THE" alternative forum : puppylinux.info
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

The time now is Wed 14 Nov 2018, 12:28
All times are UTC - 4
 Forum index » Advanced Topics » Additional Software (PETs, n' stuff) » Filesystem
How to auto-skip duplicate files when merging? [SOLVED]
Post new topic   Reply to topic View previous topic :: View next topic
Page 1 of 1 [5 Posts]  
Author Message
Sky Aisling


Joined: 27 Jun 2009
Posts: 1204
Location: Port Townsend, WA. USA

PostPosted: Tue 27 Feb 2018, 20:03    Post subject:  How to auto-skip duplicate files when merging? [SOLVED]
Subject description: Is there a simple merge program that will eliminate duplicates?
 

Hello, Smile

The goal is to merge two directories of photos into one directory of photos and eliminate the duplicates.
There will be many duplicates during the merge.
Is there a batch merge program in Puppy that will auto-skip writing over the duplicate file?

I have found rmlint here.
http://murga-linux.com/puppy/viewtopic.php?t=95233
Anyone have experience with this program?
Suggestions for other .pets?

Thank you in advance for your response.

Last edited by Sky Aisling on Wed 28 Feb 2018, 13:01; edited 1 time in total
Back to top
View user's profile Send private message 
don570


Joined: 10 Mar 2010
Posts: 5170
Location: Ontario

PostPosted: Tue 27 Feb 2018, 20:20    Post subject:  

The following does the opposite i.e it will overwrite

cd into folder of images.....
Code:

 cp -a -f --remove-destination * /path/destination/folder/
 sync
Back to top
View user's profile Send private message 
musher0

Joined: 04 Jan 2009
Posts: 12959
Location: Gatineau (Qc), Canada

PostPosted: Wed 28 Feb 2018, 00:05    Post subject:  

HI Sky Aisling.

I am not all that familiar with rsync, but I think it can do that. Maybe have a look
at the man or docs, or find a matching topic at the stackoverflow forum or similar.

Rsync skips identical files that already exist in the destination dir., which makes
it very fast as a back-up tool. E.g. the following command copies only new files
in the ramdisk to its back-up dir. :
Code:
rsync -avz . /mnt/home/ramdisk
. means that you have to be in the actual ramdisk when you issue the command

-a means "preserve file attributes"

-v means verbose, i.e. "display the filenames as the files are copied" -- (I find that
I need this parameter, it is not just a whim; otherwise, I will not know which files
have been copied)

-z means "compress the flow of the copy at the origin and decompress it at the
destination" (for greater speed).

~~~~~~~~~~

But as I said, I don't know rsync all that well. Please explore it in more detail.

IHTH

_________________
musher0
~~~~~~~~~~
Je suis né pour aimer et non pas pour haïr. (Sophocle) /
I was born to love and not to hate. (Sophocles)

Last edited by musher0 on Thu 01 Mar 2018, 03:23; edited 1 time in total
Back to top
View user's profile Send private message 
Sky Aisling


Joined: 27 Jun 2009
Posts: 1204
Location: Port Townsend, WA. USA

PostPosted: Wed 28 Feb 2018, 13:00    Post subject: How to auto-skip duplicate files during a directory merge?
Subject description: Is there a simple merge program that will eliminate duplicates?
 

don570 and musher0

Thank you! Got it!
Back to top
View user's profile Send private message 
musher0

Joined: 04 Jan 2009
Posts: 12959
Location: Gatineau (Qc), Canada

PostPosted: Thu 01 Mar 2018, 03:25    Post subject:  

My pleasure!
_________________
musher0
~~~~~~~~~~
Je suis né pour aimer et non pas pour haïr. (Sophocle) /
I was born to love and not to hate. (Sophocles)
Back to top
View user's profile Send private message 
Display posts from previous:   Sort by:   
Page 1 of 1 [5 Posts]  
Post new topic   Reply to topic View previous topic :: View next topic
 Forum index » Advanced Topics » Additional Software (PETs, n' stuff) » Filesystem
Jump to:  

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You cannot attach files in this forum
You can download files in this forum


Powered by phpBB © 2001, 2005 phpBB Group
[ Time: 0.0509s ][ Queries: 12 (0.0054s) ][ GZIP on ]