Ugly Hedgehog - Photography Forum
Home Active Topics Newest Pictures Search Login Register
Main Photography Discussion
Setting up RAID array for Macbook
Page <prev 2 of 4 next> last>>
Jul 3, 2021 19:01:50   #
rodolini
 
Have been doing a little research into the OWC ThunderBay 4. Have any of you set this up using the Disk Utilities on the Mac or would I be better off using the SoftRaid software that comes with the ThunderBay?

Thanks!

Reply
Jul 3, 2021 19:40:51   #
jscorbin Loc: Woodinville, WA
 
rodolini wrote:
Thanks to everyone who has responded! ...

SoftRAID has many features that improve the RAID system. For example, you can optimize the system for general workstation, server, digital video, digital audio, or digital photography.

While you're gathering data, I found the discussion of RAID from OWC to be quite useful, especially the sections on Levels, Uses, and Options. For example, RAID 1-0 is about 30% slower on writes than RAID 4 or 5.
https://www.softraid.com/raid/

In looking at items in their news section, a couple of other things I didn't know:
-- When you get an OWC system with the drives, they do a full certification of the drives before shipping. That is, they run the full certify process for every drive, checking read/write for every sector, which takes 1 to 2 days. The SoftRAID app can do this also, which they recommend for new drives if you buy them separately.
-- SoftRAID can also certify SD and other cards, which helps alert you if a card is starting to fail. Good to know before a photo shoot.
-- SoftRAID is integrated tightly with the macOS kernel, making it very efficient for reads and writes.

SoftRAID shows data on the hours of use, I/O errors, and SMART status (general health), which can help indicate when a drive is nearing the end of its life before it crashes. A SoftRAID icon in the task bar turns from blue to yellow or red if there are any errors. Here is a screenshot showing some of the error checking in SoftRAID on my system.


(Download)

Reply
Jul 3, 2021 20:47:17   #
rodolini
 
jscorbin wrote:
SoftRAID has many features that improve the RAID system. For example, you can optimize the system for general workstation, server, digital video, digital audio, or digital photography.

While you're gathering data, I found the discussion of RAID from OWC to be quite useful, especially the sections on Levels, Uses, and Options. For example, RAID 1-0 is about 30% slower on writes than RAID 4 or 5.
https://www.softraid.com/raid/

In looking at items in their news section, a couple of other things I didn't know:
-- When you get an OWC system with the drives, they do a full certification of the drives before shipping. That is, they run the full certify process for every drive, checking read/write for every sector, which takes 1 to 2 days. The SoftRAID app can do this also, which they recommend for new drives if you buy them separately.
-- SoftRAID can also certify SD and other cards, which helps alert you if a card is starting to fail. Good to know before a photo shoot.
-- SoftRAID is integrated tightly with the macOS kernel, making it very efficient for reads and writes.

SoftRAID shows data on the hours of use, I/O errors, and SMART status (general health), which can help indicate when a drive is nearing the end of its life before it crashes. A SoftRAID icon in the task bar turns from blue to yellow or red if there are any errors. Here is a screenshot showing some of the error checking in SoftRAID on my system.
SoftRAID has many features that improve the RAID s... (show quote)


Thank you! Just spent some more time with the OWC and SoftRAID sites. Good to know that SoftRAID monitors disk health.

Reply
 
 
Jul 3, 2021 20:50:44   #
rodolini
 
Another question - sorry...

I currently have about 11T of data which includes my 2 external HDs and my laptop.

If I want to make sure that I have some room to grow, how many terrabytes should I buy for the RAID drives? (Knowing that I will be doing some video.) It sounds like I will most likely be losing from 25-30% of the drive space so I am thinking that a 48T array might be sufficient and a 64T array would probably be better.

Does that sound correct?

Reply
Jul 3, 2021 21:51:33   #
burkphoto Loc: High Point, NC
 
rodolini wrote:
Hi All!

Have been lurking for years but this is my first post so be gentle :-) (and thank you to everyone for the great information over the years!)

I have a new MacBook Pro (not M1). I had been storing all of my images onto an external 8T drive and backing up to a second 8T drive using Time Machine. I also change all drives every year and store the older ones off site. That worked fine but now that I am getting into video, I have added a second 8T drive for small projects and video. Of course 1 8T drive can't back up 2 8T drives and I haven't been able to figure out if Time Machine will backup to 2 separate drives.

I have seen in the past that people are recommending RAID arrays for both speed and redundancy. I searched on UHH and google but would like some experienced users to help to steer me.

I am looking for a reputable company to help me configure an array. I did a quick look on B&H but am thinking that I should maybe be looking at a computer company instead.

I would appreciate any help/advice.

Thanks!

Suzanne
Hi All! br br Have been lurking for years but thi... (show quote)


CALL OWC and speak with a drive expert. They’ve been making/selling Mac peripherals since 1988, and they sell great gear.

OWC has many different drive configurations at many price points. They deal with movie and broadcast producers regularly, so they know their stuff! They recently helped rock star photographer, Henry Diltz, digitize his life’s work. So you’ll be in good hands.

Reply
Jul 3, 2021 21:53:45   #
burkphoto Loc: High Point, NC
 
rodolini wrote:
Another question - sorry...

I currently have about 11T of data which includes my 2 external HDs and my laptop.

If I want to make sure that I have some room to grow, how many terrabytes should I buy for the RAID drives? (Knowing that I will be doing some video.) It sounds like I will most likely be losing from 25-30% of the drive space so I am thinking that a 48T array might be sufficient and a 64T array would probably be better.

Does that sound correct?


Sounds formidable! 48T is borderline photo lab territory. It’s a good start for video editing.

Reply
Jul 3, 2021 22:02:33   #
BobHartung Loc: Bettendorf, IA
 
rodolini wrote:
Have been doing a little research into the OWC ThunderBay 4. Have any of you set this up using the Disk Utilities on the Mac or would I be better off using the SoftRaid software that comes with the ThunderBay?

Thanks!


When you speak to OWC be sure to ask if there is need for any special HDs. Some of their devices require matched HDs – others do not. I do know that my Thunder Bay 8 do not require any special HDs.

re: Set up. Use SoftRAID!!!!!

Reply
 
 
Jul 3, 2021 22:43:57   #
rodolini
 
Thanks everyone for your replies.

I will be going offline until after I can speak with OWC on Monday. At least now I know what questions to ask.

I'll let you all know what I decide.

Reply
Jul 4, 2021 12:22:32   #
jzett
 
I paired my MBP with a Promise Pegasus raid. Bought both at the same time through Apple store. Very pleased with both. Promise web site has several configurations of the Pegasus. Good luck in your search.

Reply
Jul 4, 2021 13:59:31   #
Drbobcameraguy Loc: Eaton Ohio
 
rodolini wrote:
Hi All!

Have been lurking for years but this is my first post so be gentle :-) (and thank you to everyone for the great information over the years!)

I have a new MacBook Pro (not M1). I had been storing all of my images onto an external 8T drive and backing up to a second 8T drive using Time Machine. I also change all drives every year and store the older ones off site. That worked fine but now that I am getting into video, I have added a second 8T drive for small projects and video. Of course 1 8T drive can't back up 2 8T drives and I haven't been able to figure out if Time Machine will backup to 2 separate drives.

I have seen in the past that people are recommending RAID arrays for both speed and redundancy. I searched on UHH and google but would like some experienced users to help to steer me.

I am looking for a reputable company to help me configure an array. I did a quick look on B&H but am thinking that I should maybe be looking at a computer company instead.

I would appreciate any help/advice.

Thanks!

Suzanne
Hi All! br br Have been lurking for years but thi... (show quote)


I use a Drobo. 4 drives that are mirroring my desktop and 2 of the drives in the drobo are mirroring the other two. Hot swap capable in case you have a drive failure. Sorry I don't have the link but google Drobo. Have used mine for years.

Reply
Jul 4, 2021 15:47:56   #
BobHartung Loc: Bettendorf, IA
 
Drbobcameraguy wrote:
I use a Drobo. 4 drives that are mirroring my desktop and 2 of the drives in the drobo are mirroring the other two. Hot swap capable in case you have a drive failure. Sorry I don't have the link but google Drobo. Have used mine for years.


I have been through 2 Drobos, both of which failed within 6 months of the warranty expiration. Contacting Drobo is senseless unless you pay their outrageous annual maintenance fee.

Avoid Drobo

Reply
 
 
Jul 5, 2021 18:35:59   #
TriX Loc: Raleigh, NC
 
FG
rodolini wrote:
Thanks to everyone who has responded! Thought I'd give y'all an update...

I contacted Apple and they can't do a backup to 2 drives unless I manually disconnect the drives and switch them out so I would have to connect and back up Drive 1 and then disconnect those 2 drives and connect and back up Drive B. So that's a no go BUT using Disk Utility, I can set up RAID 0, RAID 1 or JBOD. I thought that is pretty interesting.

Apple also did not have any information about the RAID systems they sell because they aren't made by Apple.

Tried New Egg - they don't have any techs and can't give advice

Tried MacSales/Other World Computing - closed

B&H - closed

Adorama - closed

Best Buy - after 5 phone calls and multiple disconnects and transfers, I finally reached someone at the Geek Squad who actually knew what RAID is! Spent quite a bit of time with me and this is what we came up with - WD My Cloud PR4100 with Seagate Ironwolf 12T (the 16T aren't available...) it is only a 4 bay case so I was looking for larger drives but it is hard to find things right now.

I haven't purchased anything yet. I still want to contact some other places but at least I have one possible solution!

I guess I should also be looking at something like BackBlaze. I have shied away from it since the last time I looked at cloud storage, it was cost prohibitive.

I really appreciate everyone's advice and information. I feel like I am starting to understand this...
Thanks to everyone who has responded! Thought I'd ... (show quote)


Set it up as RAID 1+0. That will give you 24TB usable mirrored. Regarding cloud for DR, instead of Backblaze, instead look at Amazon S3, Google, Microsoft or since you’re using a Mac, consider Apple ICloud. Of all of those, you may find that Amazon S3 Glacier is the most affordable. It’s not designed for frequent access, but as an archive for a disaster recovery copy, it’s a good choice. Don’t skip this 3rd DR copy, it can save your data when all else fails.

Reply
Jul 5, 2021 19:02:22   #
TriX Loc: Raleigh, NC
 
rodolini wrote:
Another question - sorry...

I currently have about 11T of data which includes my 2 external HDs and my laptop.

If I want to make sure that I have some room to grow, how many terrabytes should I buy for the RAID drives? (Knowing that I will be doing some video.) It sounds like I will most likely be losing from 25-30% of the drive space so I am thinking that a 48T array might be sufficient and a 64T array would probably be better.

Does that sound correct?


If you chose 4 drives and configure them as 1+0 (sometimes called RAID 10), you will get 50% usable (24TB). If you chose RAID 5 (bad choice for performance), you can generally expect to lose 1/total number of drives as parity or you’ll likely get ~ 36 TB usable with 4 12 TB drives. The extra capacity sounds good, but it will be substantially slower than 1+0 and a second drive failure will cost you your data, while a RAID 1+0 array MAY survive a double drive failure depending on where the drives are that fail. Two other suggestions. First, buy an extra drive so you can swap it in when one fails. Secondly, make sure the drive enclosure is fan cooled - heat is the enemy of dive longevity, and the more drives you pack, side by side into an enclosure, the hotter they will get.

Reply
Jul 5, 2021 19:05:37   #
TriX Loc: Raleigh, NC
 
P
jscorbin wrote:
SoftRAID has many features that improve the RAID system. For example, you can optimize the system for general workstation, server, digital video, digital audio, or digital photography.

While you're gathering data, I found the discussion of RAID from OWC to be quite useful, especially the sections on Levels, Uses, and Options. For example, RAID 1-0 is about 30% slower on writes than RAID 4 or 5.
https://www.softraid.com/raid/

In looking at items in their news section, a couple of other things I didn't know:
-- When you get an OWC system with the drives, they do a full certification of the drives before shipping. That is, they run the full certify process for every drive, checking read/write for every sector, which takes 1 to 2 days. The SoftRAID app can do this also, which they recommend for new drives if you buy them separately.
-- SoftRAID can also certify SD and other cards, which helps alert you if a card is starting to fail. Good to know before a photo shoot.
-- SoftRAID is integrated tightly with the macOS kernel, making it very efficient for reads and writes.

SoftRAID shows data on the hours of use, I/O errors, and SMART status (general health), which can help indicate when a drive is nearing the end of its life before it crashes. A SoftRAID icon in the task bar turns from blue to yellow or red if there are any errors. Here is a screenshot showing some of the error checking in SoftRAID on my system.
SoftRAID has many features that improve the RAID s... (show quote)

Reply
Jul 6, 2021 09:47:09   #
TriX Loc: Raleigh, NC
 
david vt wrote:
First, I absolutely recommend waiting until you speak with OWL. They were incredibly helpful on my older MAC when I needed a docking station and working through a thunderbolt rev level compatibility issue. They are legendary when it comes to non-dealer Apple hardware support

Please update us on your journey as it progresses. While not a professional, and therefore not needing massively redundant systems with 100% uptime, I do need to do a better job with onsite and offsite (cloud?) backup of critical files and my (amateur) photo file library. Just want not to lose the files to a catastrophic event or ransomware attack.

As it relates directly to the topic of better backup system, is it possible to hang a RAID type system off of a cable modem/wifi hub (one that supports several different wifi networks), have that be a central household backup server for the 6 computers (mix of apple and windows) for the family, and then have a piece of sofware that regularly backs that up to the cloud (or other offsite secure storage)? I would like to find a way to protect the whole household at once, but not be physically lugging hardware in/out of the house.

Not trying to hijack the thread, but I think this is close enough to the OP’s desire for better backup to be relevant
First, I absolutely recommend waiting until you sp... (show quote)


You need a NAS (network attached storage) that you can connect via Ethernet to your router and can be accessed by everyone on your network. It may have a RAID array on the back end, but unlike a directly connected RAID or SAN, it “owns” the file system. You access the data over your network using CIFS, NFS or HTTP protocols.

Reply
Page <prev 2 of 4 next> last>>
If you want to reply, then register here. Registration is free and your account is created instantly, so you can post right away.
Main Photography Discussion
UglyHedgehog.com - Forum
Copyright 2011-2024 Ugly Hedgehog, Inc.