Ugly Hedgehog - Photography Forum
Home Active Topics Newest Pictures Search Login Register
Main Photography Discussion
help required for corrupt raw photos
Page 1 of 2 next>
Dec 8, 2017 11:22:07   #
big-guy Loc: Peterborough Ontario Canada
 
Background: on vacation I take a laptop to upload photos taken each day into LR. I import to an external and backup to C drive. I also copy the external photos onto C drive as well. Once home I copy all the folders from the external into the main photo folder on the work station and then open LR and "synchronize folder" which has worked well over the years.

The Problem: Late last year and continuing this year I end up with corrupt raw photos some of the time. The corruption seems to happen randomly and has been know to change photos. For example, on a string of 400 photos taken, upon viewing in LR, photos 79, 132 and 275 show up as the #1 photo below shows. Two days later, photos 27, 79, 132, 149 and 275 show as corrupt. Sometimes I can correct this temporarily by removing the 1 to 1 preview and then creating a new 1 to 1 preview. But as I say this is temporary and will show as corrupt again in time. If I'm lucky I can get the export done with no corruption as in the case of #2 photo. (3rd attempt) Now if all I was doing was single shots I could struggle through but I shoot a lot of time lapse sequences which must be exported in a single go and even if I don't see any corrupted photos they may or may not show up on export. On a static time lapse I can simply delete the corrupted file and still have an acceptable time lapse but I also shoot panning time lapse sequences and deleting 1 photo ruins the entire 800 shot time lapse. I have even gone so far as to delete all the raw files (not the xmp's) in the working folder and replace them with the backup raw files from the laptop's C drive without success.

The Solution: (sort of) is that a new laptop is on the menu as this problem does not show up when the work station or the external drive is used without the laptop entering the mix. That still leaves me with a year and a half of panning time lapses that are teetering on the garbage can rim.

Has anyone run into and/or have a solution to the corrupt raw files? Taking a re-shoot is not in the cards. (pun intended)

what I see of the raw image in LR
what I see of the raw image in LR...
(Download)

after 3 trys to remove and recreate 1 to 1 previews
after 3 trys to remove and recreate 1 to 1 preview...
(Download)

Reply
Dec 8, 2017 11:25:58   #
big-guy Loc: Peterborough Ontario Canada
 
I should also mention the the pink corruption only happens on the right side of the photo. Sometimes just a small bit and sometimes almost all the photo.

Reply
Dec 8, 2017 12:07:29   #
DWU2 Loc: Phoenix Arizona area
 
big-guy wrote:
Background: on vacation I take a laptop to upload photos taken each day into LR. I import to an external and backup to C drive. I also copy the external photos onto C drive as well. Once home I copy all the folders from the external into the main photo folder on the work station and then open LR and "synchronize folder" which has worked well over the years.

The Problem: Late last year and continuing this year I end up with corrupt raw photos some of the time. The corruption seems to happen randomly and has been know to change photos. For example, on a string of 400 photos taken, upon viewing in LR, photos 79, 132 and 275 show up as the #1 photo below shows. Two days later, photos 27, 79, 132, 149 and 275 show as corrupt. Sometimes I can correct this temporarily by removing the 1 to 1 preview and then creating a new 1 to 1 preview. But as I say this is temporary and will show as corrupt again in time. If I'm lucky I can get the export done with no corruption as in the case of #2 photo. (3rd attempt) Now if all I was doing was single shots I could struggle through but I shoot a lot of time lapse sequences which must be exported in a single go and even if I don't see any corrupted photos they may or may not show up on export. On a static time lapse I can simply delete the corrupted file and still have an acceptable time lapse but I also shoot panning time lapse sequences and deleting 1 photo ruins the entire 800 shot time lapse. I have even gone so far as to delete all the raw files (not the xmp's) in the working folder and replace them with the backup raw files from the laptop's C drive without success.

The Solution: (sort of) is that a new laptop is on the menu as this problem does not show up when the work station or the external drive is used without the laptop entering the mix. That still leaves me with a year and a half of panning time lapses that are teetering on the garbage can rim.

Has anyone run into and/or have a solution to the corrupt raw files? Taking a re-shoot is not in the cards. (pun intended)
Background: on vacation I take a laptop to upload ... (show quote)

When the photos were taken, were they recorded on a CF card? I've gotten similar-looking photos when one of the pins in the CF card reader got bent. I straightened it, and haven't had the problem since. A good way to straighten a pin is to use a mechanical pencil (without the lead).

Reply
 
 
Dec 8, 2017 12:15:27   #
CHG_CANON Loc: the Windy City
 
Is the file corrupted or is the LR view of the file corrupted? You'd confirm that by opening the file with the Operating System or opening the file in DPP, all external to LR involvement.

I read your text a few time. I'm not really clear. You can isolate the problem to a specific computer where the same files and LR behavior is not a problem on other equipment? You're buying a new laptop because an infrequent issue in LR?

I'd do some more investigation including deleting (rename or copy elsewhere) the XMP files of a few files and start completely fresh with a few of the problem files to see what happens. If I could isolate to a specific piece of equipment with no further explanation, I'd work with other reliable equipment until I could determine the cause. If my CR2 files displayed properly in the camera but were corrupted when transferred to the computer, I'd look at the card and / or transfer process. If the CR2 files are corrupted on the camera, I'd look at the card or consider replacing the camera.

To me it looks like a lot of variables need to be investigated further and ruled out. If you can clearly isolate to LR on a specific machine (via a repeatable serious of steps, even with only old files), I'd contact Adobe and provide the files exposing the problem. And, I wouldn't hope for much ...

Reply
Dec 8, 2017 12:33:29   #
rgrenaderphoto Loc: Hollywood, CA
 
Since you did not mention changing memory cards, or which camera you use, I think your HD or video card is failing.

Reply
Dec 8, 2017 13:26:30   #
big-guy Loc: Peterborough Ontario Canada
 
Sounds plausible but why only the odd photo going belly up? Will check it out.

DWU2 wrote:
When the photos were taken, were they recorded on a CF card? I've gotten similar-looking photos when one of the pins in the CF card reader got bent. I straightened it, and haven't had the problem since. A good way to straighten a pin is to use a mechanical pencil (without the lead).

Reply
Dec 8, 2017 13:31:33   #
brucewells Loc: Central Kentucky
 
big-guy wrote:
Background: on vacation I take a laptop to upload photos taken each day into LR. I import to an external and backup to C drive. I also copy the external photos onto C drive as well. Once home I copy all the folders from the external into the main photo folder on the work station and then open LR and "synchronize folder" which has worked well over the years.

The Problem: Late last year and continuing this year I end up with corrupt raw photos some of the time. The corruption seems to happen randomly and has been know to change photos. For example, on a string of 400 photos taken, upon viewing in LR, photos 79, 132 and 275 show up as the #1 photo below shows. Two days later, photos 27, 79, 132, 149 and 275 show as corrupt. Sometimes I can correct this temporarily by removing the 1 to 1 preview and then creating a new 1 to 1 preview. But as I say this is temporary and will show as corrupt again in time. If I'm lucky I can get the export done with no corruption as in the case of #2 photo. (3rd attempt) Now if all I was doing was single shots I could struggle through but I shoot a lot of time lapse sequences which must be exported in a single go and even if I don't see any corrupted photos they may or may not show up on export. On a static time lapse I can simply delete the corrupted file and still have an acceptable time lapse but I also shoot panning time lapse sequences and deleting 1 photo ruins the entire 800 shot time lapse. I have even gone so far as to delete all the raw files (not the xmp's) in the working folder and replace them with the backup raw files from the laptop's C drive without success.

The Solution: (sort of) is that a new laptop is on the menu as this problem does not show up when the work station or the external drive is used without the laptop entering the mix. That still leaves me with a year and a half of panning time lapses that are teetering on the garbage can rim.

Has anyone run into and/or have a solution to the corrupt raw files? Taking a re-shoot is not in the cards. (pun intended)
Background: on vacation I take a laptop to upload ... (show quote)


In my experience, I think you have evaluated the situation correctly. I've had similar corruption (not often) and have always gone back to the source (the SD card) to re-import successfully. If you no longer have cards with the original image, I fear you're out of luck.

Reply
 
 
Dec 8, 2017 13:34:45   #
big-guy Loc: Peterborough Ontario Canada
 
1. LR view not corrupt, have even deleted the entire preview folder for the entire catalog and had it rebuilt without success. Looking at a raw file merely looks at the embedded thumbnail and not the actual raw data.
2. If the laptop is removed from the mix there is no problem.
3. Done all that without success. At least lasting success.
4. Multiple cameras and cards used and they all have the same problem... intermittently.

CHG_CANON wrote:
Is the file corrupted or is the LR view of the file corrupted? You'd confirm that by opening the file with the Operating System or opening the file in DPP, all external to LR involvement.

I read your text a few time. I'm not really clear. You can isolate the problem to a specific computer where the same files and LR behavior is not a problem on other equipment? You're buying a new laptop because an infrequent issue in LR?

I'd do some more investigation including deleting (rename or copy elsewhere) the XMP files of a few files and start completely fresh with a few of the problem files to see what happens. If I could isolate to a specific piece of equipment with no further explanation, I'd work with other reliable equipment until I could determine the cause. If my CR2 files displayed properly in the camera but were corrupted when transferred to the computer, I'd look at the card and / or transfer process. If the CR2 files are corrupted on the camera, I'd look at the card or consider replacing the camera.

To me it looks like a lot of variables need to be investigated further and ruled out. If you can clearly isolate to LR on a specific machine (via a repeatable serious of steps, even with only old files), I'd contact Adobe and provide the files exposing the problem. And, I wouldn't hope for much ...
Is the file corrupted or is the LR view of the fil... (show quote)

Reply
Dec 8, 2017 13:37:08   #
big-guy Loc: Peterborough Ontario Canada
 
Thanks Bruce, I was thinking the same thing but you never know what some ingenious individual might come up with. Here's hoping.

brucewells wrote:
In my experience, I think you have evaluated the situation correctly. I've had similar corruption (not often) and have always gone back to the source (the SD card) to re-import successfully. If you no longer have cards with the original image, I fear you're out of luck.

Reply
Dec 8, 2017 13:40:57   #
DWU2 Loc: Phoenix Arizona area
 
big-guy wrote:
Sounds plausible but why only the odd photo going belly up? Will check it out.


I don't know, either, but when I experienced the problem, it didn't effect all shots. Here's an example I kept, similar to yours:


(Download)

Reply
Dec 8, 2017 13:51:32   #
big-guy Loc: Peterborough Ontario Canada
 
Per chance, do you use ML?

DWU2 wrote:
I don't know, either, but when I experienced the problem, it didn't effect all shots. Here's an example I kept, similar to yours:

Reply
 
 
Dec 8, 2017 13:53:43   #
DWU2 Loc: Phoenix Arizona area
 
big-guy wrote:
Per chance, do you use ML?


What's ML?

Reply
Dec 8, 2017 16:52:33   #
big-guy Loc: Peterborough Ontario Canada
 
Magic Lantern (for Canon only)

Reply
Dec 8, 2017 16:54:09   #
DWU2 Loc: Phoenix Arizona area
 
big-guy wrote:
Magic Lantern (for Canon only)


Ah. Not currently. Had Magic Lantern on an earlier camera. It wasn't on the camera that took the uploaded photo.

Reply
Dec 8, 2017 16:56:35   #
big-guy Loc: Peterborough Ontario Canada
 
I'm gonna have a close look at those pins tonight.

Reply
Page 1 of 2 next>
If you want to reply, then register here. Registration is free and your account is created instantly, so you can post right away.
Main Photography Discussion
UglyHedgehog.com - Forum
Copyright 2011-2024 Ugly Hedgehog, Inc.