Search papers, labs, and topics across Lattice.
The paper introduces CLOUDADV, an advisory system that utilizes zero-shot time-series forecasting for optimal cloud instance sizing amidst workload drift. By integrating historical utilization data, forecast summaries, and explicit sizing heuristics, the system generates cost-effective recommendations that significantly reduce operational expenses. In a case study, CLOUDADV achieved a 52.9% reduction in simulated monthly costs for production VMs, demonstrating the effectiveness of zero-shot models in dynamic cloud environments without the need for extensive retraining.
CLOUDADV slashes cloud costs by over 50% using zero-shot forecasting, proving that less can be more in cloud instance sizing.
Cloud virtual machines are often overprovisioned, creating avoidable cost and operational inefficiency. We present CLOUDADV, an interactive engineer-facing advisory system for cloud instance sizing under workload drift. The system combines zero-shot time-series forecasting with bounded recommendation generation across day-, week-, and month-scale planning horizons. For each query, CLOUDADV constructs a structured decision context from historical utilization, forecast summaries, current VM metadata, candidate instance options, pricing, and explicit sizing heuristics. A higher-capacity LLM is used offline to generate reference recommendations, while a smaller production model is evaluated on the same prompts to assess deployment-time alignment under latency and cost constraints. Evaluation prioritizes downstream recommendation quality using simulated Azure cost savings and ex-post exceedance, with rolling-origin forecast accuracy reported as a secondary diagnostic against classical and supervised baselines. In a case study of seven production VMs, the reference recommendations reduce simulated monthly cost from about \$1,503 to \$708, yielding \$795/month in savings (52.9%) under conservative heuristic constraints, while the highest observed exceedance rate among downgraded cases is 1.5%. Although Chronos-2 does not minimize every forecasting metric, it often induces recommendation patterns similar to those of a supervised per-VM baseline. These results suggest that zero-shot foundation models can support decision-aligned provisioning in non-stationary cloud environments while reducing the operational burden of repeated per-tenant retraining, revalidation, and redeployment.
