TCO
Taubman Centers Inc.
stock NYSE

This conclusion seems to contradict the other article they had about OpenAI’s jelapeno chip being on par or better than Vera Rubin in terms of TCO.

Thanks for sharing this report. The key takeaway for me was:
On perf/TCO, Vera Rubin and Jalapeño are head-to-head, producing almost the same number of output tokens per $. However, as previously mentioned, **Jalapeño’s results are obtained without speculative decoding** and Vera Rubin’s results use speculative decoding. Speculative decoding leads to a \~3-5x reduction in cost per token. When speculative decoding is implemented on Jalapeño, this will enable Jalapeño to serve tokens even more cost effectively.
TCO using jelapeno could be 1/3 to 1/5 that of using Nvidia chips after optimization, makes sense for model makers to make their own chips.

>AMD said on Aug. 24 that it has launched an artificial intelligence (AI) cost calculator that allows companies to estimate potential reductions in total cost of ownership (TCO). AMD officially calls the tool the “AMD AI Cost Calculator.”
>The calculator compares the cost of AI workloads using cloud infrastructure with the cost of running them locally on AMD platforms. Companies can estimate their AI spending and optimize budgets by entering factors including team size, analysis period, AI workload and AI model. The calculator estimates AI token costs and recommends infrastructure configurations that could lower TCO, along with AMD hardware suited to the user's requirements.
출처 : The Elec Inc.(https://www.thelec.net)