Bought a gigabit network switch to connect the new raid machines (cdfs1 & cdfs2) to older machines in the glass room. Switch is LINKSYS 24-PORT 10/100/1000 GIGABIT SWITCH W/WEBVIEW (SRW2024).
I created a 1GB file on one of the raid machine and copied it to the other raid machine, going through the gb switch. Time to copy was around 12-15 seconds. This is around 70MB/s, which is fine. Wire speed for the gb network is 1000/8 = 125MB/s. Wire speed for our current mb network is 100/8 = 12.5MB/s. We’re usually closer to 4-8MB/s.