Mathematical Proof of the Inevitability of Cloud Computing
In the emerging business model and technology known as cloud computing, there has been discussion regarding whether a private solution, a cloud-based utility service, or a mix of the two is optimal. My analysis examines the conditions under which dedicated capacity, on-demand capacity, or a hybrid of the two are lowest cost. The analysis applies not just to cloud computing, but also to similar decisions, e.g.: buy a house or rent it; rent a house or stay in a hotel; buy a car or rent it; rent a car or take a taxi; and so forth.
To jump right to the punchline(s), a pay-per-use solution obviously makes sense if the unit cost of cloud services is lower than dedicated, owned capacity. And, in many cases, clouds provide this cost advantage.
Counterintuitively, though, a pure cloud solution also makes sense even if its unit cost is higher, as long as the peak-to-average ratio of the demand curve is higher than the cost differential between on-demand and dedicated capacity. In other words, even if cloud services cost, say, twice as much, a pure cloud solution makes sense for those demand curves where the peak-to-average ratio is two-to-one or higher. This is very often the case across a variety of industries. The reason for this is that the fixed capacity dedicated solution must be built to peak, whereas the cost of the on-demand pay-per-use solution is proportional to the average.
Also important and not obvious, leveraging pay-per-use pricing, either in a wholly on-demand solution or a hybrid with dedicated capacity turns out to make sense any time there is a peak of “short enough” duration. Specifically, if the percentage of time spent at peak is less than the inverse of the utility premium, using a cloud or other pay-per-use utility for at least part of the solution makes sense. For example, even if the cost of cloud services were, say, four times as much as owned capacity, they still make sense as part of the solution if peak demand only occurs one-quarter of the time or less.
In practice, this means that cloud services should be widely adopted, since absolute peaks rarely last that long. For example, today, Cyber Monday, represents peak demand for many etailers. It is a peak who’s duration is only one-three hundred sixty-fifth of the time. Online flower services who reach peaks around Valentine’s Day and Mother’s day have a peak duration of only one one-hundred eightieth of the time. While retailers experience most of their business during one month of the year, there are busy days and slow days even during those peaks. “Peak” is actually a fractal concept, so if cloud resources can be provisioned, deprovisioned, and billed on an hourly basis or by the minute, then instead of peak month or peak day we need to look at peak hours or peak minutes, in which case the conclusions are even more compelling.
I look at the optimal cost solutions between dedicated capacity, which is paid for whether it is used or not, and pay-per-use utilities. My assumptions for this analysis are that pay-per-use capacity is 1) paid for when used and not paid for when not used; 2) the cost for such capacity does not depend on the time of request or use; 3) the unit cost for on-demand or dedicated capacity does not depend on the quantity of resources requested; 4) there are no additional relevant costs needed for the analysis; 5) all demand must be served without delay.
These are assumptions which may or may not correspond to reality. For example, with respect to assumption (1), most pay-per-use pricing mechanisms offered today are pure. However, in many domains there are membership fees, non-refundable deposits, option fees, or reservation fees where one may end up paying even if the capacity is not used. Assumption (2) may not hold due to the time value of money, or to the extent that dynamic pricing exists in the industry under consideration. A (pay-per-use) hotel room may cost $79 on Tuesday but $799 the subsequent Saturday night. Assumption (3) may not hold due to quantity discounts or, conversely, due to the service provider using yield management techniques to charge less when provider capacity is underutilized or more as provider capacity nears 100% utilization Assumption (4) may or may not apply based on the nature of the application and marginal costs to link the dedicated resources to on-demand resources vs. if they were all dedicated or all on-demand. As an example, there may be wide-area network bandwidth costs to link an enterprise data center to a cloud service provider’s location. Finally, assumption (5) actually says two things. One, that we must serve all demand, not just a limited portion, and two, that we don’t have the ability to defer demand until there is sufficient capacity available. Serving all demand makes sense, because presumably the cost to serve the demand is greatly exceeded by the revenue or value of serving it. Otherwise, the lowest cost solution is zero dedicated and zero utility resources; in other words, just shut down the business. In some cases we can defer demand, e.g., scheduling elective surgery or waiting for a restaurant table to open up. However, most tasks today seem to require nearly real-time response, whether it’s web search, streaming a video, buying or selling stocks, communicating, collaborating, or microblogging.
It is tempting to view this analysis as relating to “private enterprise data centers” vs. “cloud service providers,” but strictly speaking this is not true. For example, the dedicated capacity may be viewed as owned resources in a co-location facility, managed servers or storage with fixed capacity under a long term lease or managed services contract, or even “reserved instances.” By “dedicated” we really mean “fixed for the time period under consideration.” For this reason, I will use the terms “pay-per-use” or “utility” rather than “cloud” except when providing colloquial interpretations.
Let the demand D for resources during the interval 0 to T be a function of time D(t), 0 <= t <= T.
This demand can be characterized by mean mu μ(D), which we shall simply call A, and a peak or maximum max(D) which we shall simply call P. Needless to say, based on the definitions of mean and maximum, A <= P. For example, the average demand A might be for 9 CPU cores, with a peak P of 31 CPU cores.
Let the unit cost per unit time of fixed capacity be C, and let U be the utility premium. By utility premium, I mean the multiplier for utility (pay-per-use) capacity vs. fixed. The unit cost of on-demand capacity is then U * C. For example, C might be $2.00 per core hour for fixed capacity. If on-demand capacity costs $3.00 per core hour, then U would be 1.5, i.e., there is a 50% premium for on-demand capacity.
To be slightly more precise, because on-demand capacity is assumed to be pure pay-per-use, in contrast to fixed capacity which is paid for whether or not it is used, there is a premium when the capacity is used, and a 100% discount when the capacity is not used. As stated above, this assumption may not be valid in all cases.
If U = 1, then fixed capacity and on-demand capacity cost the same. If U < 1, then pay-per-use resources (e.g., the cloud) are cheaper on a unit-cost basis. It has been argued that economies of scale and statistics of scale can make cloud providers’ unit costs lower. If U > 1, then pay-per-use resources (e.g., the cloud) are assessed to be more expensive on a unit-cost basis, as at least one study claims. Even under these unit cost assumptions, a pure utility or hybrid solution may be less expensive in terms of total cost, as we shall see.
Thanks to assumption (2), we can rearrange the demand curve to be monotonically non-decreasing, i.e., in ascending order, to help illustrate the points. In practical terms, this means that, for a site supporting special events, like concert or movie ticket sales, if they have a peak during 3 days each month, we can just treat it as if this peak occurred for 36 days at the end of the year. This reordering doesn’t impact mean, max, or any of the calculations below, but makes it easier to understand the proofs. In the real world, such an assumption may not be the case. Continuously growing, or at least non-decreasing, demand may be suitable for resourcing via fixed capacity.
Finally, it should be noted that thanks to assumptions (2) and (3), the cost of providing utility capacity to meet the demand D is just the utility premium U times the base cost C times the arithmetic mean A times the duration of time T. In other words, if the price of a hotel room doesn’t vary based on day or quantity–and we ignore the time value of money–then renting 8 rooms on one night and 2 rooms the next night costs the same as renting 5 rooms for two nights. This is because Σ U * C * D(ti), i = 0 -> T = U * C * Σ D(ti), i = 0 -> T = U * C * A * T.
Proposition 1: If U < 1, that is, the utility premium is less than unity, a pure pay-per-use solution costs less than a pure dedicated solution.
Proof: The cost of the pay-per-use solution is A * U * C * T. The cost of a dedicated solution built to peak is P * C * T. Since A <= P and U < 1,
A * U * C * T <= P * U * C * T < P * 1 * C * T = P * C * T
Therefore, the pay-per-use solution costs less than the dedicated solution.
Colloquially, the cloud total cost is advantaged due to only paying for resources when needed, as well as paying less for those resources when used.
Proposition 2: If U equals 1, that is the utility premium is unity, and A = P, that is demand is flat, then a pure pay-per-use solution costs the same as a pure dedicated solution built to peak.
Proof: The cost of the pay-per-use solution is A * U * C * T. The cost of a dedicated solution built to peak is P * C * T. Since A = P and U = 1,
A * U * C * T = P * U * C * T = P * 1 * C * T = P * C * T
Therefore, the pay-per-use solution costs the same as the dedicated solution.
In other words, if there is no difference between unit costs, and there is no variability in demand, it doesn’t matter which strategy you use. Of course, this assumes that your demand is predictable and that there is no financial risk, neither of which is typically the case. Even if you believed this to be true, all other things being equal, you might prefer the cloud solution due to demand forecasting risk and due to financial risk, e.g., residual values being lower than projected or changes in tax laws.
Proposition 3: If U = 1 and demand is not flat, that is A < P then a pure pay-per-use solution costs less than a pure dedicated solution.
Proof: The cost of the pay-per-use solution is A * U * C * T. The cost of a dedicated solution built to peak is P * C * T. Since A < P and U = 1,
A * U * C * T < P * U * C * T = P * 1 * C * T = P * C * T
Therefore, the pay-per-use solution costs less than the dedicated solution.
Interestingly, even if the unit cost of the pay-per-use utility is higher than the dedicated capacity, the total cost may be lower if the demand curve is “spiky” enough.
Proposition 4: Even if the utility premium U is greater than 1, if it is less than the peak-to-average ratio P / A, that is, 1 < U < ( P / A ), then a pure pay-per-use solution costs less than a pure dedicated solution.
Proof: Again, the cost of the pay-per-use solution is A * U * C * T. The cost of a dedicated solution built to peak is P * C * T. Since U < (P / A)
A * U * C * T < A * (P / A) * C * T = P * C * T
Therefore, the pay-per-use solution costs less than the dedicated solution.
In other words, as I point out in my first law of Cloudonomics, even if a utility costs more (on a unit cost basis), the total cost can be lower than a dedicated solution, because of the savings when resources are not needed due to variations in demand. The more “spiky” the demand is, the higher rate one might be willing to pay for the utility. For example, if one needs a car every day for years, it makes sense to own / finance / lease it, for a rate of, say, ten dollars a day. If one needs a car for only a few days, it makes sense to rent it, even though the rate might be, say, fifty dollars a day. And if one needs a car for only a few minutes, it makes sense to grab a taxi, even though paying a dollar a minute works out to an equivalent rate of over a thousand dollars per day.
Let us define the total duration of the peak of the demand D to be Tp. That is, even if there are multiple periods when D is at peak, we sum them up to get Tp. This turns out to be an important criterion for determining the value of hybrid clouds.
Continue reading at: Cloudonomics
