Ugly Hedgehog - Photography Forum
Home Active Topics Newest Pictures Search Login Register
Main Photography Discussion
Lightroom Duplicates
Dec 15, 2014 18:59:37   #
Tracyv Loc: Del Mar, Ca
 
I had some issues with my computer, I do believe all is ok now. But somehow my pictures in Lightroom are shows almost 90K now, where it should be around 10K. Does anyone kno9w how to rid of the duplicates??? Thank You....

Reply
Dec 15, 2014 19:19:22   #
Searcher Loc: Kent, England
 
Tracyv wrote:
I had some issues with my computer, I do believe all is ok now. But somehow my pictures in Lightroom are shows almost 90K now, where it should be around 10K. Does anyone kno9w how to rid of the duplicates??? Thank You....


You can buy software made for the purpose of identifying and displaying duplicates either by file name or by image.

I have used "Duplicate File Finder" (free download) but did not like it because all it does is to scan the drives looking for image files, sorts the filenames into order, then displays a list of the file names expecting the user to delete everything except the first one.

As I use five different cameras, a couple of which have gone round the clock at least once, file name duplicates are inevitable.

My method now is to open Lightroom in the Library, choose all Photographs. On the toolbar just above the filmstrip, there is a sort function, choose sort : Filename

Now all the duplicates are together, enlarge the thumbnail size so that you can see the photos, flag the duplicates and delete them in bulk.

The problem that occurs with this method is it can make rubbish of your folder structure - you could be deleting photos from the very folder you wanted that particular image left in.

Most methods of deleting duplicates will also have an effect on folder structure.

Do you know why the duplicates came into being? (i.e. were back ups of images accidently imported? )

If you can work out what happened, it may be (and usually is) possible to do something differently to wholesale deletions and preserve the integrity of the folder structure.

Reply
Dec 15, 2014 20:17:18   #
DirtFarmer Loc: Escaped from the NYC area, back to MA
 
Searcher wrote:
You can buy software made for the purpose of identifying and displaying duplicates either by file name or by image.

...As I use five different cameras, a couple of which have gone round the clock at least once, file name duplicates are inevitable....


I change the file name at download time. This avoids duplicates, but more importantly it can give you a meaningful file name. What is DSC_9279 a picture of?

A long time ago I got a copy of Downloader Pro. That simplifies the process of changing file names. When I insert a card into the reader it brings up Downloader Pro. It shows me thumbnails of all the files on the card, sorted by capture date. I can choose one date, or go through and select specific images. I then enter a "job code", which is a text string that is a description of the subject, e.g. Suzie's Birthday Party.

When I download the selected images, the program changes the file name to [job code] [YYYYMMDD] [nnn] so the filename contains the subject, the date, and a 3 digit index number (I can make it 4 or 5 digits in the highly unlikely event I shoot more than 1000 [or 10,000!] shots of that subject). It then stores them in a folder /photos/[year]/[job code]/RAW (since I shoot RAW only). (Actually my camera has a mode that is jpg only, in which case the files go into the folder ..../JPG).

After downloading, my files have a name with a recognizable subject and are stored in a folder with the same subject. No more duplicate file names since even if I shoot that subject again, it will have a different date in the file name.

I use Lightroom and that's my primary search engine for images, but I don't think it hurts at all to have a second method of finding things.

PS: you can now change the file name in LR but I think my way is a bit easier (particularly since I'm used to doing it that way). There are probably other programs by now that do the same thing.

Reply
 
 
Dec 15, 2014 21:04:02   #
Searcher Loc: Kent, England
 
DirtFarmer wrote:
I change the file name at download time. This avoids duplicates, but more importantly it can give you a meaningful file name. What is DSC_9279 a picture of?


The OP has 80,000 images to find and delete, renaming at this stage is not going to be the answer :-)

Prevention is always better than cure, but now the horse has bolted, repairs are required. (Was trying to think of another couple of clichés to throw in but decided against it.) I sympathise with the OP, been there & done that, though not to the extent of 8 duplicates to each original, so now my images are prefixed with a date on import.

LR has a brilliant metadata filter which may make sorting the 90,000 photos into manageable blocks a feasibility, it all depends on how the duplicates were created.

Reply
Dec 16, 2014 06:52:42   #
jerryc41 Loc: Catskill Mts of NY
 
Searcher wrote:
You can buy software made for the purpose of identifying and displaying duplicates either by file name or by image.

I've been disappointed by these, too. Some will find duplicate file names, while the better ones compare the data to see if the images are actually identical. I've tried eliminating duplicates in iTunes, with the same poor results. It's fine for a small number of files, but when you get into the hundreds, it's ridiculous.

Reply
Dec 16, 2014 06:59:05   #
jerryc41 Loc: Catskill Mts of NY
 
Searcher wrote:
(Was trying to think of another couple of clichés to throw in but decided against it.)

Let me give you a hand with that.

1. that's just like the pot calling the kettle black.
2. the early bird gets the worm
3. good things come to those who wait
4. early to bed, early to rise makes a man healthy, wealthy and wise
5. a penny saved is a penny earned
6. an apple a day keeps the doctor away
7. don't tempt fate
8. don't paint the devil on the wall (German)
9. mind your manners
10. don't put all your eggs in one basket
11. patience is a virtue
12. look out for number one
13. don't let the bed bugs bite
14. a spoon full of sugar helps the medicine go down
15. wake up and smell the coffee
16. stop and smell the roses
17. it ain't over till the fat lady sings
18. wouldn't kick her (him) outta bed for eatin' crackers
19. rough as a cob
20. he couldn't hit the broad side of a barn
21. is that a mouse in your pocket or are you just happy to see me
22. he went the whole 9 yards.
23. it's not the heat it's the humidity
24. don't burn your bridges
25. he's so ugly, he'd have to sneak up on a glass of water to get a drink

Reply
Dec 16, 2014 07:17:13   #
Searcher Loc: Kent, England
 
jerryc41 wrote:
Let me give you a hand with that.


Thanks for the list, I will refer to that when lost for words.

Please explain #8 - I have never heard it before and am sure it could be useful.

Reply
 
 
Dec 16, 2014 07:29:58   #
DirtFarmer Loc: Escaped from the NYC area, back to MA
 
Searcher wrote:
The OP has 80,000 images to find and delete, renaming at this stage is not going to be the answer :-)

I recognize that, but he's not the only one reading this thread. The suggestion may help someone else.

Searcher wrote:
Prevention is always better than cure, but now the horse has bolted, repairs are required. (Was trying to think of another couple of clichés to throw in but decided against it.)

At my age trying to think of something is counterproductive. It either pops into my head or it doesn't get thought of. Trying just puts it further away.

Searcher wrote:
...LR has a brilliant metadata filter which may make sorting the 90,000 photos into manageable blocks a feasibility, it all depends on how the duplicates were created.

I've used that and you can do a lot with it. Something LR users should try out because it's a hammer you can apply to all sorts of problems.

jerryc41 wrote:
...don't paint the devil on the wall (German)...

I never heard that one either.

Reply
Dec 16, 2014 07:47:50   #
Searcher Loc: Kent, England
 
Dirtfarmer wrote:

I recognize that, but he's not the only one reading this thread. The suggestion may help someone else


Your post is undeniably a good one, deserving of a thread in its own right.

Not enough credence is paid to error prevention in image storage, your post demonstrates forethought and needs highlighting. I shall reference it in the next update in PP tutorials.

Reply
Dec 16, 2014 08:09:34   #
jerryc41 Loc: Catskill Mts of NY
 
DirtFarmer wrote:
I never heard that one either.

(Don't paint the devil on the wall.)

It's the German equivalent of "Speak of the devil."

Reply
Dec 16, 2014 13:08:00   #
James R. Kyle Loc: Saint Louis, Missouri (A Suburb of Ferguson)
 
Oh Dear....

More Lightroom Problems.....

I am seeing More and more problems with that thing than any other program.

Reply
 
 
Dec 16, 2014 14:36:55   #
jerryc41 Loc: Catskill Mts of NY
 
James R wrote:
Oh Dear....

More Lightroom Problems.....

I am seeing More and more problems with that thing than any other program.

Right! And you haven't seen one problem with Bob's Custom Picture Fixer. LR is used by so many people, and we have over 55,000 here, that there are bound to be questions about it. In most cases, it's not so much a problem as someone doesn't know how to do something with it.

Reply
Dec 16, 2014 14:40:30   #
lightcatcher Loc: Farmington, NM (4 corners)
 
jerryc41 wrote:
Right! And you haven't seen one problem with Bob's Custom Picture Fixer. LR is used by so many people, and we have over 55,000 here, that there are bound to be questions about it. In most cases, it's not so much a problem as someone doesn't know how to do something with it.


:thumbup: :thumbup: :thumbup:

Reply
If you want to reply, then register here. Registration is free and your account is created instantly, so you can post right away.
Main Photography Discussion
UglyHedgehog.com - Forum
Copyright 2011-2024 Ugly Hedgehog, Inc.