
« Cloudwar | Main | Media's next target: ISPs »
The billion-dollar switch
January 28, 2008
Talk about your big switches. Cisco today is unveiling the largest network switch ever, the Nexus 7000, which is able to transfer 15 terabytes terabits per second. That's equivalent, the company says, to sending digital copies of all the movies in NetFlix's inventory in 38.4 seconds. Geared to facilitate cloud computing, which demands the rapid exchange of massive quantities of data over long distances, the Nexus switch has required about $1 billion in R&D investment over the last four years, according to the New York Times. Microsoft has said it plans to use the new switch for its expanding set of Live web apps.
The billion-dollar switch underscores a couple of big trends in the IT world. First, it's another indication that IT's traditional heavy-metal giants - not just Cisco but IBM, HP, Sun, EMC and others - are counting on the shift to utility-style computing to produce a wave of new investment in the modernized data centers required for large-scale cloud computing. The virtualization and centralization of computing assets promises in the long-run to reduce the capital that corporations have to dump into IT machinery, but in the short run it's going to require big outlays for new equipment, both by large companies looking to consolidate their data centers and by the suppliers of web apps and other utility services.
Second, it shows that scale is becoming more important than ever on the supply side. Cisco's smaller competitors will be hard-pressed to match its R&D outlays as they rush to match the capabilities of the Nexus - and of the even more powerful switches that will surely follow. Whether you're building utility data centers or supplying the equipment that goes into them, you need to spend a lot of cash. So count on more consolidation in the infrastructure sector.
UPDATE: Other reports put Cisco's investment in the Nexus at $250 million; so maybe it's only the quarter-billion-dollar switch.
Advertisement: Are you ready for "The Big Switch"? Fast Company calls Nicholas Carr's new book "compulsively readable - for nontechies, too." Salon says it's "magisterial." Order now from Amazon.com.
Comments
Minor correction: the general press is always confusing bits and bytes, and this post and the Forbes article hopelessly confuse terabits and terabytes. The Nexus 7000 can transfer data at 15 terabits per second, which is fast, but not quite fast enough to transfer Netflix's entire library in forty seconds. By my calculations, that data rate would transfer about 9,000 DVDs in that time, but Netflix says its collection has 90,000 titles.
But apparently the 15Tbit/sec throughput is based on 10Gbit connectivity; the box scales beyond this when 40Gbit and 100Gbit connectivity becomes available.
Posted by: Kendall Brookfeld
at January 28, 2008 11:34 AM
The 15Tb/Second number is based on the switch fabric capacity, regardless of interface type- although I completely concur that 40 and 100GbE interfces will be able to take better advantage of that type of capacity- allowing the system to enjoy a very long lifecycle.
Agree there is a decimal lost in the calculation somewhere as its 384 seconds, not 38.4. i.e. in the length of time it took me to get logged in to TypeKey the DB could be sync'd and replicated... :)
One other nit while fact-checking- we invest $1B annually into Data Center R&D, the Nexus 7000 is about $250M in R&D spend.
Posted by: Douglas Gourlay
at January 28, 2008 03:45 PM
Thanks for the corrections and clarifications.
Posted by: Nick Carr
at January 28, 2008 07:26 PM
This type of development is not new and is not a validation of your hypothesis that data centres are the new black.
What this represents is using less _physical_ units to do the same virtual thing. This switch is a progression in existing asset technology, because it combines (at least) two existing technologies into one box (namely, ethernet switching and storage networks).
The Nexus is not much faster than competitive products from Foundry, Juniper et al. And indeed, the speeds are mostly irrelevant since the data centers don't need and cannot generate traffic at this volume.
The speed is important only because a bigger number makes it a more convincing purchase. Note: the top speed will not be possible for four or five years when the modules and line cards that go into it will become available. For example, the C6500 chassis has been available since 1999 but only reached it full capacity in 2005.
I need this box in my networks, so I can have more features in less physical equipment so that I can spend more time working instead of purchasing and deploying.
Posted by: Greg Ferro
at January 29, 2008 07:42 AM
Well this is a big switch. And Cisco is a great company. But gee it doesn't seem all that big a deal to me. I work for a tiny ( compared to Cisco) company that makes Linux-based switchblades in ATCA chassis, mostly for the telcom market. Trust me, we didn't spend $1b, or $250m, or even $25m to develop our switches. Our largest switch does 48 ports of 1 gig ethernet data ( like phone traffic) and 24 ports of control (used for management functions required in HA environments), and costs less than $10k. It's expected that customers buy them in pairs and have multiple racks, so it wouldn't be all that uncommon to aggregate the same capacity as this Cisco switch using our switches ( or our competitor's). As has been pointed out above, few locations need to switch this much traffic.
Also nobody gets 1 gigabit of traffic through a 1 gig port. 50-80% is more realistic. So of course comparisons about all of Netflix' movies are pretty silly to network engineers. Thats a bit like saying we could run twice as much car traffic by doubling the freeway lanes, when the freeway entrances/exits and feeder routes actually dictate the throughput.
Posted by: jpfisher
at January 29, 2008 02:36 PM
Greg brings up some interesting points, and I just posted to our DC blog about the 15Tb number (http://blogs.cisco.com/datacenter/2008/02/why_youll_want_this_switch_par.html).
Our goal with Nexus was never to have the success of the switch hinge on the bigger/faster argument, although, for now, it is. We believe there are a lot of folks out there like Greg who want to spend more time working and less time purchasing and deploying. Our belief is that once folks have the oppty to dig deeper and check out NX-OS or play with the switch virtualization available through VDCs, or some of the manageability features such as lights-out management, they will see these as the compelling reason to make the investment.
Posted by: Omar S.
at February 3, 2008 02:19 PM
Nexus is certainly not a commodity hardware, at least not yet. Though Cisco's entry in the supply side of cloud computing would certainly attract other players and that would further strengthen the trend of cloud computing (http://cloudcomputing.blogspot.com/)
Posted by: Chirag Mehta
at February 5, 2008 08:53 PM
Post a comment
Thanks for signing in, . Now you can comment. (sign out)
(If you haven't left a comment here before, you may need to be approved by the site owner before your comment will appear. Until then, it won't appear on the entry. Thanks for waiting.)Nick's new book:
"Future Shock for the web-apps era" -Fast Company
"Ominously prescient" -Kirkus Reviews
"Riveting stuff" -New York Post
Greatest hits
Avatars consume as much electricity as Brazilians
The love song of J. Alfred Prufrock's avatar
Other writing
The end of corporate computing
Nick's last book:
Order from Amazon
Visit book site