Ok, I got a bunch of emails today asking to explain exactly how an Ethernet SAN works. I’ve done a full article on this in the past, but here’s a quick primer on how it works.
1 – The SAN controller computer. In our case, a Mac Pro 12 Core machine with 32GB RAM.
2 – An Ethernet controller inside the SAN controller computer. In our case it’s a Small Tree Communications Card.
3 – A RAID Host controller inside the SAN controller computer. In our case it’s the Atto R680 SAS Host controller.
4 – A high speed ethernet switch. In our case, a Small Tree 24 port ethernet switch.
5 – A high speed media array. In our case, a brand spankin’ new Small Tree 48TB ST RAID II. 16 drive chassis with 3TB drives.
6 – Client computers connected to the ethernet switch via Cat 5 / 6 cable. Mac Pro, iMac, Mac Mini, Laptops, anything with an ethernet port.
So in a nutshell, the high speed RAID connects directly to the SAN Controller computer.
The SAN Controller computer connects to the Ethernet Switch.
The Client computers connect to the Ethernet Switch.
Set up the Network settings correctly on the SAN Controller Computer and all Client computers.
Set up the File Sharing correctly on the SAN Controller Computer and all the Client computers.
Go into the Mac OS on the SAN Controller Computer and all the Client Computers and tune the heck out of them.
That’s it in a nutshell. Mount the SAN to each client and start working.
There is zero control software needed to run the SAN. Just set it up, tweak it and start editing. Of course I’m not going to get 500MB/s to each client workstation like you might with Fibre Channel, but we get well over 100MB/s to each workstation allowing us to cut and view Apple ProRes HD files all day long across 14 workstations simultaneously.
Here’s a diagram of what the system looks like in our shop. In our case, we’ve decided to keep one of the original 16TB Expansion chassis from our original SAN so we can use it as a direct connect to our Resolve system for RED / Alexa playback and to use as a “dump drive” for the big SAN when needed to clean up the RAID.
And of course if you have any more questions on how to set up and install one of these, you definitely want to call on the experts at Small Tree Communications.
Hi Walter, helpful post… a few questions:
– What protocol are you connecting with on the Macs? AFP/SMB/NFS?
– Did the GigE switch require any special configuration to improve streaming data?
– Can you be more specific about how the bandwidth you’re able to achieve? With 100MB/s to each workstation (around 800Mb/s), are you actually able to get multiple streams of ProRes HQ? How many?
I’ve built many high performance Xsans, however I’m always interested in less expensive options. With no more Xserves, a NAS based solution like this is really interesting to me. Thanks in advance for your answers!
Charlie
Everything connects AFP
As for how everything is configured, that’s all Small Tree Communications. They go in and tweak the entire configuration to ensure we get the maximum performance for the tasks we are doing. That’s not just the switch, but going to all the clients and tweaking them as well. That’s one of the reasons I love working with them. They log in remotely and continually update and tweak on our systems as they discover new things in their labs.
We don’t run ProRes HQ here, no reason to. We can easily get two to three streams of ProRes no problem on our systems.
Thanks Walter, I’ll chat with Small Tree for more info!