The Netflix guys wiring up a fully loaded ASR9010 with 118 single mode fibers:
http://www.youtube.com/watch?v=tyb-nnRNwfw
For those who don't know yet, Netflix is an online movie rental company and uses so much bandwidth that they had to push out their own CDN boxes to ISPs and IXPs.
Their CDN boxes are almost stock FreeBSD 9.1 based, contain some 35 HDDs at 4TB plus a couple of SSDs and push about 15Gbit/s *each* during the evening hours. They are limited by HDD (seek) bandwidth.
Hoi,
2013/3/18 Andre Oppermann oppermann@networx.ch:
The Netflix guys wiring up a fully loaded ASR9010 with 118 single mode fibers:
Cool!
Their CDN boxes are almost stock FreeBSD 9.1 based, contain some 35 HDDs at 4TB plus a couple of SSDs and push about 15Gbit/s *each* during the evening hours. They are limited by HDD (seek) bandwidth.
Do you think they use ZFS+L2ARC as the filesystem of their content push system?
groet, Pim
On 18.03.2013 14:48, Pim van Pelt wrote:
Hoi,
2013/3/18 Andre Oppermann oppermann@networx.ch:
The Netflix guys wiring up a fully loaded ASR9010 with 118 single mode fibers:
Cool!
Their CDN boxes are almost stock FreeBSD 9.1 based, contain some 35 HDDs at 4TB plus a couple of SSDs and push about 15Gbit/s *each* during the evening hours. They are limited by HDD (seek) bandwidth.
Do you think they use ZFS+L2ARC as the filesystem of their content push system?
IIRC they use plain UFS2 on the disks. They don't care about disks dying, so no RAID. The availability of the content is controlled from upper layers. So if a disk dies requests for that content get redirected to another box with the same content. Only the popular movies and shows are stored on the CDN boxes. The long tail is served from AWS S3.
Am Mon, 18 Mar 2013 14:59:08 +0100 schrieb Andre Oppermann oppermann@networx.ch:
On 18.03.2013 14:48, Pim van Pelt wrote:
Hoi,
2013/3/18 Andre Oppermann oppermann@networx.ch:
The Netflix guys wiring up a fully loaded ASR9010 with 118 single mode fibers:
Cool!
Their CDN boxes are almost stock FreeBSD 9.1 based, contain some 35 HDDs at 4TB plus a couple of SSDs and push about 15Gbit/s *each* during the evening hours. They are limited by HDD (seek) bandwidth.
Do you think they use ZFS+L2ARC as the filesystem of their content push system?
IIRC they use plain UFS2 on the disks. They don't care about disks dying, so no RAID. The availability of the content is controlled from upper layers. So if a disk dies requests for that content get redirected to another box with the same content. Only the popular movies and shows are stored on the CDN boxes. The long tail is served from AWS S3.
Described in more detail here:
http://lists.freebsd.org/pipermail/freebsd-stable/2012-June/068129.html
-
Andre Oppermann -
Pim van Pelt -
Rainer Duffner