InfiniBand: Faster AND Greener??

July 24th, 2010

This post was written by Jon Toor

Prius racing?? I’ve heard of it being done. I’m told that gas mileage gets factored into the race standings, but it sounds pretty dull. The fact is that “green” and “speed” don’t usually go together.

Which is why I was intrigued by two InfiniBand articles that recently appeared. Taken together, they report that IB is both the fastest server interconnect, and has the greatest potential to increase data center power efficiency as well.

Here’s what they said:

1)   The Register reported in this June 29 article, titled InfiniBand to outpace Ethernet’s unstoppable force, that “InfiniBand, more than Ethernet, has kept pace with the exploding core counts in servers and massive storage arrays to feed them, which demand massive amounts of I/O bandwidth in the switches that link them.”

Not only has IB been ahead on past speed transitions but already has specs in place for speeds to 312Gbps, and for  new encoding mechanisms that will use that performance much more efficiently, consuming just 3% of the bandwidth for overhead.

OK, we knew IB is fast. That’s why it is used in 37% MORE of the TOP500 supercomputing sites than it was just one year ago. But green, too?

2) Google researchers reported an energy savings analysis in a  June 19 journal paper, titled Energy Proportional Datacenter Networks.

When you’re building data centers near dams, as Google is, you’re probably doing some serious thinking about saving power. So what green technology did they reveal in this paper? InfiniBand.

They discussed the concept of “energy proportional,” which essentially means, “use less power when you can.” Their finding was that servers are getting better in this respect, but that networks are not. In terms of power, networks “are always on regardless of whether they are flowing data packets, because they must still send idle packets,” they report.

The implication of this is that “the datacenter network can become a significant fraction (up to 50%) of cluster power.”

The answer is to design a network whose power consumption is more proportional to the amount of traffic it is moving.

Here they found that IB technology has designed-in capabilities ideally suited to this power-saving goal. The IB architecture includes provisions that make it possible to shut down inactive lanes — and thereby reduce power — when they’re not required. Power savings in a scaled-down performance mode can reach 60%, enough to save $3M over four years in a 3400 node data center.

Faster and Greener

So it is possible to go fast and save energy doing it. Which I guess isn’t too surprising. Porsche after all is showing a hybrid that does 0-60 in about 3 sec.

But that car will cost over $600K. That same money will buy about 1,000 of the world’s fastest server I/O cards.  And they just happen to be the most efficient ones, too.

InfiniBand to outpace Ethernet’s unstoppable force

 
 
Bookmark and Share

Getting over the cloud… the preconceptions, that is

July 9th, 2010

This post was written by Jon Toor

Can a cloud model surprise you… in a good way?

We all hate surprises. Too often they’re bad things. But occasionally you can get surprised in a good way. That’s what happened to an IT manager I ran across this week. He achieved some remarkable results in a way he did not expect: in the cloud.

His company, a large financial services provider, needed to improve the scalability of an online service offering. Batch jobs were already running too slowly with the number of users they had. And they were expecting the user base to grow significantly. What would they do then?

A cloud service provider thought he could help, but the IT manager was skeptical. Would it be fast, secure, reliable, etc?

The cloud provider was able to satisfy the security and reliability concerns by explaining the architecture. The underpinnings relied on Xsigo virtual I/O, so they were able to provide isolated connectivity to servers. It also let them configure redundancy and fast failover throughout the infrastructure — whether a connection or an entire server failed. It helped that the provider was an established managed hosting company, so they were a known quantity from a business perspective.

But that still left the performance question. And the only way to answer that was to try it. You can talk about car engines all you want, but until you take the car to the track, you won’t really know its top speed.

So the cloud provider set up a test: a batch job with data from 100,000 users. This job that took 2 1/2 hours to run in the IT manager’s own shop (their forecasted number of users was 400,000, so you can imagine why the IT manager was anxious for a new solution). The goal was to drop that to 1 hour. That would be a success and would allow the IT manager to safely expand his user base.

When they ran the test, the surprising result was this: it took six minutes. 96% less than the original, and 83% less than the goal.

That’s good, but would it scale? They tried it again with a much larger data set and found that it scaled nearly linearly.

It’s not often we’re surprised in a really good way. And with all the fear, uncertainty, and doubt around the cloud (the pundits see all kinds of threats), it’s pretty easy to believe that any surprises are likely to be bad ones.

But if this IT manager had gone with that flow rather than looking at the potential upsides, he would have missed a solution that saved his company significant time and money.

He had a healthy skepticism… which is a form of preconception. But he got over it.

 
Tags:
 
Bookmark and Share

Does the World Need Virtual I/O?

July 2nd, 2010

This post was written by Jon Toor

Network Computing.com recently raised this question: “Does the world need virtual I/O?” Why introduce virtual I/O, they ask, when 40G Ethernet will provide plenty of bandwidth for any server?  Isn’t virtual I/O really needed only for bleeding-edge, large scale applications?

Rather than respond here myself, I put the question to two data center architects who use virtual I/O. Neither runs bleeding-edge apps — they provide web services, database, Exchange, all the usual stuff. And neither operates an esoteric Star Wars-type computing environment.  Both run typical data centers in facilities familiar to us all.

So why do they need virtual I/O? Here are their answers.

Case 1: Distribution Company

This company is a distributor in the Midwest. The IT department maintains databases for orders, inventory and customer relationships. And they provides similar IT services to their clients to help them streamline their own operations.

So what do they get from virtual I/O? Here are a few key points:

Performance: Increased bandwidth was an important feature for them. Like a lot of shops, they’ve consolidated, so they needed to get more out of fewer servers. They’re running high-end Nehalems and very fast storage, so the opportunity to get 40Gb through a single server link was important to maximize sever utilization. And they wanted to do it today, not sometime in the future.  The fact that Xsigo’s IB link delivers by far the industry’s lowest latency (in the nanoseconds, as opposed to microseconds or even milliseconds for FCoE), helped too.

Agility: They are building what they describe as a private cloud. They want to run any application on any server, so the ability to dynamically manage connectivity is important.

Cannot rely on VLANS: They absolutely cannot run a single Ethernet connection into a server and then carve it up. Multiple physically isolated networks are essential — VLANS alone do not provide the isolation they require. Within their cloud there will be multiple businesses (both internal and external) sharing the resources. There will also be multiple data types, including credit card information. From a legal and a compliance standpoint, network isolation is required.

Future Proof: Virtual I/O makes change simple, whatever that change might be. As the company’s architect pointed out, “The future is hard to predict. What happens if I suddenly need to connect my legacy SAN to the cloud? Or if I need a new network, or FCoE enters my plans? With virtual I/O that’s all easy to accommodate.”

Case 2: Online Transaction Company

The second architect, at an online transaction firm, had a slightly different spin on virtual I/O and how it helps. His company is larger and more complex, so he values  tools that help reduce complexity.

Simplified planning: In a complex environment, just planning cabling can be a challenge. With virtual I/O they don’t have to think about it because every server is cabled the same way. The architect commented, “I don’t have to think about whether it’s fibre, single or multi-mode, Cat 6, or whatever. It’s all the same.”

$1.5M cost savings: These guys know data center design, and know very well how to save a buck. But their next-best alternative to virtual I/O would have cost $1.5 million more on day one.

Agility: The ability to change things rapidly with virtual I/O can help avoid downtime. As the architect pointed out, “It’s not that we’re changing things frequently. But when we need to change something right now, it needs to be done — right now!”

Remote management: Because this firm operates multiple data centers, they need remote management. “If I can fix an issue without having to get a guy physically to the data center, that’s a huge time savings.”

Cannot rely on VLANs: Like the distributor, this company has compliance regulations and payment card industry rules to worry about. Not to mention their own peace of mind. The architect pointed out, “I manage my shop tightly to ensure security. You won’t be seeing my name in the news.”  Isolated networks are employed wherever needed, and virtual I/O lets them maintain that isolation while still getting the flexibility to run any app on any server.

“To us, virtual I/O improved the quality of life,” the architect concluded. “We simplified planning, accelerated critical management tasks, and saved cost at the same time.”

That’s live input, this week, from two IT managers on the front lines of data center operations. Neither is unusual in any way except that they looked for and found a better way to manage their infrastructure.

Do they need virtual I/O?

So, getting back to the original question, do they need virtual I/O? No, of course not. They both ran their data centers just fine before they installed Xsigo.

But does having virtual I/O give them a competitive business advantage? And does it improve their quality of life? Absolutely.

Bookmark and Share

The Explosion at the Other End of the Cloud

June 18th, 2010

This post was written by Jon Toor

We talk about cloud as a data center concept, but what about at the other end of the pipe?

Just as the cloud is revolutionizing the data center, there is an equally dramatic revolution going on at the the content consuming side of the compute world.

Namely, the trend towards mobile devices is emerging as a force.

An article in last week’s Newsweek magazine offered some interesting market numbers about Apple’s revenue split for desktop verses mobile products. PCs no longer dominate at Apple. It’s not even close. The company’s PC business has dropped from 70% of  revenue to less than 30%. (During that time, Apple’s share of the overall PC business has remained roughly flat, at about 8%.) In the PC’s place, mobile now rules the Apple roost. The iPad is selling a at a rate of one unit every 3 seconds. iPhone 4 pre-orders recently  brought ATT’s system to its knees.

While mobile is not yet the dominant model for the compute world — tablets have a tiny share of the overall market — it’s a trend that has a lot of interest.

The same Silicon Valley venture capitalists who invested early in the internet now are doing the same with tablets. John Doerr of Kleiner Perkins (a Xsigo investor) commented about iPad, “It is not a big iPod. It is a very big deal.” And he backed that up by doubling his firm’s iPad-related investment fund from $100M to $200M.

For data center managers, the implications are huge. Growth at the consuming end of the cloud can mean only one thing: equivalent growth at the distribution end of the cloud. Data center managers will be in the drivers seat as consumers seek better and richer ways to use these devices.

The trends towards mobile devices and VDI point to increased demand on data center managers to be responsive. More importantly, it’s a great opportunity to make the shift towards an inherently responsive infrastructure to make that job easier and far more cost effective.

 
 
Bookmark and Share

Cloud Computing Shopping List: 4 Key Ingredients

June 11th, 2010

This post was written by Jon Toor

Defining the cloud remains a challenge. But we may be getting closer to agreement on the cloud building blocks.

CIO magazine this week provided a list of four ingredients that make up the cloud. Virtual I/O was part of that list. Here’s a quick look at their Fab Four:

** For more on this topic, join our Xsigo/Dell webcast, “How Virtual I/O Lets You Build a Private Cloud with the Vendors of Your Choice,” June 17, 1PM Eastern. Click here to register. **

1. Application Integration

In this context, “integration” is intended to work towards IT as a service, as opposed to simply managing hardware that hosts applications. “Integration” could mean anything, but the article provides a specific example: Enhancements such as administering user identities across multiple applications from a single location can greatly streamline management.

2. Security

A critical element, but one that’s still a work in progress, according to this article. Which partly explains why we see people working towards a private cloud as a first step.

3. Virtual I/O

There are multiple reasons why virtual I/O is essential to the cloud: performance, real-time management, simplicity, etc. But for the IT manager (and Xsigo user) quoted in this article, it was all about scalability.

“When you’re in the dev/test stage, having eight or 10 [Gigabit Ethernet] cables per box is an incredible labeling issue; beyond that, forget it,” says the IT manager. “Moving to virtual I/O is a concept shift—you can’t touch most of the connections anymore—but you’re moving stuff across a high-bandwidth backplane and you can reconfigure the SAN connections or the LANs without having to change cables.”

4. Storage

Storage is an issue because virtual machines require physical storage, just as physical servers do. While the article highlights this as a cost driver, remember that it’s an I/O driver as well. The fact that virtualization is storage intensive implies that it’s I/O intensive as well. Remember, with VMs most of that storage will be external to the server.

While there may not be a single generally-accepted definition of what the cloud looks like once you’ve arrived, there is a lot of value in the conversation about how you get there.

 
 
Bookmark and Share

Army Attacks the Cloud!

June 3rd, 2010

This post was written by Jon Toor

Still not convinced the cloud is real? Then consider three cloud announcements in the news this week. One from the US Army, one from Microsoft, and the last from HP.

In this Information Week article, the CIO of the Army discusses their plans to consolidate servers by creating “compute clouds in select data centers.” The Army is one of the world’s largest IT operations, with a $10 billion IT budget and 1.4 million users.

The Army’s plan of attack reads like Cloud 101.  It wants to “exert control over server deployments as it prepares to consolidate data centers and, in the process, convert designated data centers into cloud computing environments that provide shared services across its operations.”

Microsoft also made news, announcing a joint cloud computing center with Taiwan’s economics ministry on Thursday at the Computex electronics show. And they announced plans to work with two local companies on new designs for servers meant specifically for cloud computing.

And finally there was the HP announcement of their plan to restructuring IT operations around the cloud.

All of these point to the immediacy of the cloud transformation. Why? Because the cost savings potential is just too compelling to ignore.

We work every week with IT shops saving hundreds of thousands of dollars in immediate capex by adopting cloud models with virtualized servers and virtual I/O. Most compound those savings over time with increased operating efficiency. A public cloud provider we worked with recently saved over $1,000,000 in immediate capex by moving to virtualized I/O.

So the choice will become clear. You can streamline your own operations with virtualized servers and I/O. Or you can outsource to a public cloud provider (who is probably virtualizing their servers and I/O). Or you can ultimately face the question of why your IT operations are not cost competitive. The Army saw this challenge and opted to attack the cloud hill.

Bookmark and Share

Drive the Future: Earn Your Certified Virtual I/O Engineer Certificate

May 27th, 2010

This post was written by Jon Toor

Do you want to shape the future? It’s one thing to just see the future. To do that, you could visit a psychic and look at tarot cards. Or you could watch TV’s Jim Cramer and speculate about the next stock market moves.

But to drive the future, you could attend a Xsigo Virtual I/O course and earn your Certified Virtual I/O Engineer (CVIOE) certification. It’s a lot more practical than tarot, and has a better expected ROI than the NYSE. And it will let you not only see the future, but shape it, too.

Why is this? Well, virtual I/O is the future of server connectivity.  It is already a critical element of today’s most advanced server solutions. And it enables the backbone of the cloud by giving the infrastructure newfound efficiency.

You already love server virtualization. Well, virtual I/O is the second half of the virtualization equation. Once you experience virtual I/O, you will see its potential to shape the data center of the future. If you work with servers and virtualization, it’s likely that virtual I/O will be part of your future.

So what’s the best way to really learn about it… in depth? We think that learning at Xsigo has some compelling advantages.

At Xsigo, when you gain your CVIOE Certification you’re learning from the experts. Xsigo pioneered the concept of virtual I/O in 2004. Our staff holds fundamental patents in the field and has deployed virtual I/O at hundreds of sites. So there’s a tremendous pool of knowledge you can benefit from.

And you’ll learn the fine points. Virtual I/O is intuitive and easy to use, but that doesn’t mean it’s simple. It opens up new possibilities for infrastructure management. In a Xsigo class, you’ll learn about the nuances and options introduced by virtual I/O, which puts you in an ideal position to architect deployments that capitalize on these capabilities.

The CVIOE curriculum

The basic course is a two-day virtual I/O administration course. With extensive hands-on training, you’ll get experience with Xsigo’s hardware and management components including the Xsigo I/O Director CLI, Xsigo Management System GUI, and host servers using virtual I/O devices.

After completing this training you’ll thoroughly understand the components and architecture of the Xsigo I/O Director, and you’ll be ready to install and configure virtual I/O and all of its components.

Furthermore, completing the class will prepare you for the Certified Virtual I/O Engineer (CVIOE) exam. For a limited time, those purchasing a seat in the training (for $1395) will be offered the certification test immediately after course completion at no extra charge.

Past students have called the class “indispensible,” and “a terrific learning experience.” Many have continued on to the follow-on one-day Virtual I/O Diagnostics course to gain even greater depth.

The only question is… now that you’ve seen the future, do you want to be ready to drive it?

For a class schedule click here.

For a complete course description (pdf) click here.

 
 
Bookmark and Share

Pod Power!

May 21st, 2010

This post was written by Jon Toor

Pods are everywhere! From ubiquitous music players (iPods) to pods that threaten humanity (Invasion of the Body Snatchers), the pod concept thrives in many forms.

Now the pod is becoming a central element of many data center deployments. It is a trend to watch because pods are already revolutionizing data center management. What are these pods, and why do they matter?

A pod, in our thinking, is a standardized unit of infrastructure. A mini data center-in-a-rack that is equipped with servers, connectivity, and perhaps storage.  The exact configuration will vary depending on each organization’s requirements. But within a data center each pod will look just like the one next to it.

Why do this?

The objective here is to save time. Employing pods standardizes deployment and management tasks, which means less time needed to complete these tasks. And that translates to higher efficiency and better resource utilization. Read More

 
Tags:
 
Bookmark and Share

Journey to the Private Cloud

May 14th, 2010

This post was written by Jon Toor

At EMC World this week, the theme was “The Journey to the Private Cloud.” Why did they choose this theme? Well you could be cynical and say that is was simply to highlight their new storage architecture for the cloud. But I believe that’s thinking too small.

Cloud has become real. One observer noted that most IT people in attendance  no longer questioned the value of the cloud. They were looking for the best strategies to get there… quickly. EMC picked the theme that simply reflected what most people are thinking about.

And there’s little question as to why. Over the course of the event, I met with hundreds of people and heard their concerns: the excessive time required to deploy infrastructure, the high levels of complexity (one person said he had 22 I/O cables running to each of his servers!), the difficulty of pinpointing issues when they occur in a complex environment, and the I/O bottlenecks that block the path to higher utilization.

One attendee from an insurance company put it bluntly: “When we have an I/O issue, it’s usually easier to add another server than to fix the issue on the old server.” A frank admission. And an obvious wake-up call that doing things the old-fashioned way does not work anymore.

VMware has of course been espousing the values of the cloud for some time now. Their server virtualization and management technologies are of course key enablers.

We would maintain that virtual I/O is a key enabler as well. It resolves all of the I/O issues that arise as you move towards a more fluid, more easily scaled infrastructure. VMware agrees, which is why they use virtual I/O in their own environment to make it that much more powerful and that much simpler to manage.

For an in-depth look at virtual I/O and the cloud, I’ve condensed the blog post series, “Open Solutions for the Private Cloud,” into this white paper. 8,000 attendees at EMC World were thinking about this topic. If you’re not yet, you should.

 
Tags:
 
Bookmark and Share

Top Ten Reasons to NOT Buy a Xsigo VP780 I/O Director

May 9th, 2010

This post was written by Lloyd Carney

10. No one you’ve heard of uses Xsigo. OK, so EMC, VMware, Accenture, Microsoft, Hitachi, Capgemini, and Technicolor all use Xsigo today. But you don’t want to take chances. Nobody does. So don’t take their word for it!

9. InfiniBand is a flash in the pan. Sure InfiniBand has been around for a decade, is available from all leading server vendors, has shipped over 5M ports (at speeds 10G or higher), is embedded in servers from two major vendors (with more coming!), and is growing at 35% per year. But Cisco doesn’t offer IB, so that’s reason enough to doubt it.

8. InfiniBand is just too darn fast. You’ve seen the signs: “Speed kills!” If man was meant to be moving data around at 40Gbps (soon to be 80Gbps!), Cisco would be doing it.

7. Isn’t that InfiniBand stuff just for HPC? InfiniBand is the dominant interconnect in high-performance computing. Why? Because it delivers 4X the bandwidth of 10G Ethernet, at 1/3 the latency, and at less cost. But why would you want high performance in your data center?

6. Who knows where InfiniBand even came from! Wasn’t IB dreamed up in some government lab or something? Well, no. InfiniBand was actually created by IBM, Hewlett-Packard, Intel, Microsoft, Sun, and Compaq. But what do those guys know about systems?

5. With IB, you’d have a new interconnect in your data center. InfiniBand means you might have to learn something new. Of course FCoE is new, too. But Cisco tells you that’s OK. It’s good to have someone do your thinking for you.

4. Cost savings aren’t a priority. Sure Xsigo can save you 50% to 60% on your connectivity capital costs, but you don’t need the cost savings (and your switch vendor needs the money!).

3. Cisco promised you BIG discounts! Xsigo showed you how to eliminate 70% of your switch ports, and amazingly Cisco came back a day later with a 70% discount, “guaranteed for life.” Wow! That was a coincidence, but you’ll take the discount. Clearly Cisco has your best interests at heart.

2. You like vendor lock-in! Your favorite vendors have been with you for years and they give you great service. As well they should. They know you, and know what they can get away with. They never mentioned that the expression “one throat to choke” can work both ways.

And the TOP reason to not buy a VP780 I/O Director…


1. The new VP560 I/O Director is much cuter! At just 2U height, the new VP560 is sized and priced for smaller deployments. So NOW you have a choice in open, standards-based, enterprise-proven virtual I/O: the VP560 or the VP780. Something you did not have before.

 
Tags:
 
Bookmark and Share