Ugly Hedgehog - Photography Forum
Home Active Topics Newest Pictures Search Login Register
Main Photography Discussion
File Storage for Lightroom Files
Page 1 of 2 next>
Dec 16, 2016 18:00:55   #
Maxwell12 Loc: Florida
 
Hi

I have just completed my new computer and have reloaded Lightroom.
System drive is a Samsung 950 Pro SSD in the M.2 slot, a reg.SSD for some data storage
and 2- 1 TB WD HDs for image storage. I have the external drive to send the second
copy to.

I guess because my system drive is not a SATA drive I had problems trying to make
the 2 Wds RAID1..long story…doesn’t work..ASUS tech tried a few times and ways…have to find another option.

When I import files I want them go into HD1 and (and into HD2 as a backup). I also have the external
backup which will store all images.

Here’s the issue. I might import 300 images into HD1 and only keep 10. The rest will
be “Deleted from disk”. When I delete from(1) I want them to be deleted from(2) as well.
I would like HD(2) to be a real image of HD(1) and not keep those extra 290 images.

Any thoughts on how to do that. Know of any software that will not only add images but remove
them as well to stay true to what is on HD(1).

Thanks for your thoughts

Phil

Reply
Dec 16, 2016 20:03:17   #
bsprague Loc: Lacey, WA, USA
 
There is a category of software for drive "synchronization" The idea is to make a second drive have both the additions and deletions of the first drive. I use a freebie from Microsoft called SyncToy. It has been around awhile but does work on Windows 10. I will probably migrate to GoodSync when I get around to it.

The basics with SyncToy is that it only runs when you launch it. You can create a "preset" for routine repetition. When launched it compares two drives. New files on the first drive are copied to the second. Files deleted on the first drive are deleted on the second.

I have two "second" drives. One is on my desk for convenience and the other is offsite in an RV.

I'm not sure, but I think GoodSync can be set to run automatically. I'm not sure I would like that. I like running it when I know that the condition of the primary drive is what I want. In other words, if I accidentally delete something on the first drive I don't want it deleted on the second drive. But, if I've done some clean up deletions on the first drive, I do want them to go away on the second drive too.

Reply
Dec 16, 2016 20:36:46   #
rjaywallace Loc: Wisconsin
 
Bill, your process sounds well thought out and reasonable.

Reply
 
 
Dec 16, 2016 20:47:54   #
Erik_H Loc: Denham Springs, Louisiana
 
Maxwell12 wrote:
Hi

...Here’s the issue. I might import 300 images into HD1 and only keep 10. The rest will
be “Deleted from disk”. When I delete from(1) I want them to be deleted from(2) as well.
I would like HD(2) to be a real image of HD(1) and not keep those extra 290 images.

Any thoughts on how to do that. Know of any software that will not only add images but remove
them as well to stay true to what is on HD(1).

Thanks for your thoughts

Phil

Phil,
I believe that Syncback Free would do what you're looking for. With it, you can also avoid the second copy step in the LR import process. You can create a profile that will run every day (or as often as you want) to mirror drive 1 to drive 2. That way, any deletions you make on drive 1 will also be removed from drive 2.

Reply
Dec 16, 2016 21:07:29   #
Maxwell12 Loc: Florida
 
Thank you bspraque and Eric H for those ideas. I had not heard of any of those software options
but will check them out for sure.

Phil

Reply
Dec 16, 2016 22:29:13   #
Maxwell12 Loc: Florida
 
Well, you guys got me pointed in the right direction. GoodSync does look like a good
choice. Here is a site that lists and compares 10 sync software.

The Best Sync Software of 2016
http://www.toptenreviews.com/software/utilities/best-sync-software/

Thanks again

Phil

Reply
Dec 16, 2016 22:47:30   #
TriX Loc: Raleigh, NC
 
bsprague wrote:
There is a category of software for drive "synchronization" The idea is to make a second drive have both the additions and deletions of the first drive. I use a freebie from Microsoft called SyncToy. It has been around awhile but does work on Windows 10. I will probably migrate to GoodSync when I get around to it.

The basics with SyncToy is that it only runs when you launch it. You can create a "preset" for routine repetition. When launched it compares two drives. New files on the first drive are copied to the second. Files deleted on the first drive are deleted on the second.

I have two "second" drives. One is on my desk for convenience and the other is offsite in an RV.

I'm not sure, but I think GoodSync can be set to run automatically. I'm not sure I would like that. I like running it when I know that the condition of the primary drive is what I want. In other words, if I accidentally delete something on the first drive I don't want it deleted on the second drive. But, if I've done some clean up deletions on the first drive, I do want them to go away on the second drive too.
There is a category of software for drive "sy... (show quote)


You've pointed out a real potential issue with mirroring/synching data between drives - if you accidentally delete a file (or directory) on the first drive, then you delete your redundant copy as well and lose them both unless you have a 3rd copy or a snapshot of the FS (after the write, but before the delete), or can successfully undelete.

Reply
 
 
Dec 17, 2016 05:05:47   #
Gene51 Loc: Yonkers, NY, now in LSD (LowerSlowerDelaware)
 
Maxwell12 wrote:
Hi

I have just completed my new computer and have reloaded Lightroom.
System drive is a Samsung 950 Pro SSD in the M.2 slot, a reg.SSD for some data storage
and 2- 1 TB WD HDs for image storage. I have the external drive to send the second
copy to.

I guess because my system drive is not a SATA drive I had problems trying to make
the 2 Wds RAID1..long story…doesn’t work..ASUS tech tried a few times and ways…have to find another option.

When I import files I want them go into HD1 and (and into HD2 as a backup). I also have the external
backup which will store all images.

Here’s the issue. I might import 300 images into HD1 and only keep 10. The rest will
be “Deleted from disk”. When I delete from(1) I want them to be deleted from(2) as well.
I would like HD(2) to be a real image of HD(1) and not keep those extra 290 images.

Any thoughts on how to do that. Know of any software that will not only add images but remove
them as well to stay true to what is on HD(1).

Thanks for your thoughts

Phil
Hi br br I have just completed my new computer an... (show quote)


I've been using SyncBack Free since forever - 2004 or so. I use Lightroom, and I have a 1 TB Samsung 850EVO as a system drive, and a 4 tb RAID 1+0 for data storage. I also have several external drives, connected by USB 3.

The LR catalog and preview files are on the system drive. Images and their corresponding xmp files (important, in the event you lose your system drive), are on the internal RAID.

I have SyncBack set up to sync various folders to my externals - I back up my LR catalog and preview files and their backups, and I back up my image data, every night. I do not make a second copy on import (it's too slow).

Since I am using SyncBack to sync the data and not back it up, when I add, delete or change a file on the working drives, the backup drives get the changes during the overnight scheduled sync.

I think that's what you are trying to do, and yes, it does work.

Reply
Dec 17, 2016 06:29:54   #
Maxwell12 Loc: Florida
 
Thanks Gene51

That's the plan. A day ago I didn't know this type of sync software was around other than to think
that it must be something like it . Opens up all kinds of backup and/or sync possibilities.

Reply
Dec 17, 2016 07:42:17   #
jerryc41 Loc: Catskill Mts of NY
 
Maxwell12 wrote:
Hi

I have just completed my new computer and have reloaded Lightroom.
System drive is a Samsung 950 Pro SSD in the M.2 slot, a reg.SSD for some data storage
and 2- 1 TB WD HDs for image storage. I have the external drive to send the second
copy to.

I guess because my system drive is not a SATA drive I had problems trying to make
the 2 Wds RAID1..long story…doesn’t work..ASUS tech tried a few times and ways…have to find another option.

When I import files I want them go into HD1 and (and into HD2 as a backup). I also have the external
backup which will store all images.

Here’s the issue. I might import 300 images into HD1 and only keep 10. The rest will
be “Deleted from disk”. When I delete from(1) I want them to be deleted from(2) as well.
I would like HD(2) to be a real image of HD(1) and not keep those extra 290 images.

Any thoughts on how to do that. Know of any software that will not only add images but remove
them as well to stay true to what is on HD(1).

Thanks for your thoughts

Phil
Hi br br I have just completed my new computer an... (show quote)


I build myself a machine with an M.2 drive, and I'm finishing one for my son. Talk about fast!

As for your two-drive situation, like Gene51, I think SynchBack might work. I use that for backing up, and I have it set to "Mirror." If I add or delete files on my D drive, when I run SyncBack to backup my files, it will add and delete files on the G drive. I backup seven folders from D to two externals and a NAS.

Reply
Dec 17, 2016 12:17:51   #
jimnyc1 Loc: New York, NY USA
 
I use www.deltawalker.com/

Reply
 
 
Dec 17, 2016 12:54:36   #
rck281 Loc: Overland Park, KS
 
Maxwell12 wrote:
Hi

I have just completed my new computer and have reloaded Lightroom.
System drive is a Samsung 950 Pro SSD in the M.2 slot, a reg.SSD for some data storage
and 2- 1 TB WD HDs for image storage. I have the external drive to send the second
copy to.

I guess because my system drive is not a SATA drive I had problems trying to make
the 2 Wds RAID1..long story…doesn’t work..ASUS tech tried a few times and ways…have to find another option.

When I import files I want them go into HD1 and (and into HD2 as a backup). I also have the external
backup which will store all images.

Here’s the issue. I might import 300 images into HD1 and only keep 10. The rest will
be “Deleted from disk”. When I delete from(1) I want them to be deleted from(2) as well.
I would like HD(2) to be a real image of HD(1) and not keep those extra 290 images.

Any thoughts on how to do that. Know of any software that will not only add images but remove
them as well to stay true to what is on HD(1).

Thanks for your thoughts

Phil
Hi br br I have just completed my new computer an... (show quote)


I intend to build a system very similar to the one you describe. I am going to use a Samsung 960 M2 SSD for the OS and programs and a pair of WD hard drives in Raid 1 for data. Are you saying that you can't do RAID with a non SATA OS drive?

Reply
Dec 17, 2016 14:02:26   #
jeep_daddy Loc: Prescott AZ
 
bsprague wrote:
There is a category of software for drive "synchronization" The idea is to make a second drive have both the additions and deletions of the first drive. I use a freebie from Microsoft called SyncToy. It has been around awhile but does work on Windows 10. I will probably migrate to GoodSync when I get around to it.

The basics with SyncToy is that it only runs when you launch it. You can create a "preset" for routine repetition. When launched it compares two drives. New files on the first drive are copied to the second. Files deleted on the first drive are deleted on the second.

I have two "second" drives. One is on my desk for convenience and the other is offsite in an RV.

I'm not sure, but I think GoodSync can be set to run automatically. I'm not sure I would like that. I like running it when I know that the condition of the primary drive is what I want. In other words, if I accidentally delete something on the first drive I don't want it deleted on the second drive. But, if I've done some clean up deletions on the first drive, I do want them to go away on the second drive too.
There is a category of software for drive "sy... (show quote)



This is what I use too.

Reply
Dec 17, 2016 14:20:55   #
rck281 Loc: Overland Park, KS
 
I understand sync'ing but it's different than mirrored drives. Any accidental deletions should be in the recycle bin. Also, previous versions of a file can be found in File History - if turned on. All NAS boxes run some version of RAID drives. I have run RAID 1 mirrored drives for years with great success. However, I have never had a PCI M2 drive that uses NVME instead of SATAN.
Thanks for the suggestions as I may change my design..

Reply
Dec 17, 2016 14:45:14   #
romanticf16 Loc: Commerce Twp, MI
 
rck281 wrote:
I intend to build a system very similar to the one you describe. I am going to use a Samsung 960 M2 SSD for the OS and programs and a pair of WD hard drives in Raid 1 for data. Are you saying that you can't do RAID with a non SATA OS drive?


If you check the specks on WD drives only certain ones can be used in a raid setup. The original post did not specify which WD drives were being used-black, blue, red, etc.

Reply
Page 1 of 2 next>
If you want to reply, then register here. Registration is free and your account is created instantly, so you can post right away.
Main Photography Discussion
UglyHedgehog.com - Forum
Copyright 2011-2024 Ugly Hedgehog, Inc.