ARM Reddit Mentions | ChartExchange

Welcome to the final day of the Goldman Sachs Community Development and Technology Conference.
My name is Jim Schneider.
I am the semiconductor analyst here at Goldman Sachs.
It's my pleasure to welcome AMD to the stage today with us from the company.
We have SVP and general manager of the Compute and Enterprise AI, Dan McNamara, and corporate vice president of financial strategy investor relations, Matt Ramsay.
Welcome, guys.
Thanks for being here.
Thank you, Jay.
AMD: Thank you.
Jim: I think the topic almost every session at this conference is AI, so you're a key enabler of that trend with your infrastructure products.
Maybe before we can kind of get into those products, how has the AI adoption kind of progressed inside AMD over the past several years from a corporate perspective? What areas have seen the biggest productivity gains? And what lessons from AMD's own AI journey are applicable to enterprise customers today?
Dan: I can jump with that, yeah.
So look, it's a great question.
And I think that when I think about our journey, it's very similar to a number of enterprises. But, you know, our team started out, I think it's a multi-layer approach to the infrastructure, right. We started out first and foremost with the data layer and optimized that. And, you know, a lot of, and we talked to a lot of enterprise customers, and, you know, you this is often overlooked. It’s how you structure your data such that you can actually employ agents effectively, and we actually open sourced our solution. It's called Optima.
So we started there, and then we've been on this journey about for agents driving what I would call automation for efficiency, and that's gone very, very well.
And now where I would say is we're really in the domain-specific type applications. Right, so if you think about it for us, domain-specific is EDA. So we're seeing a tremendous amount of upside across coding, debug, you know, and those two key areas along with kernel development and, you know, just software development in general. Very, very strong returns there. And then, of course, across all of the businesses we're seeing very, very strong automation and efficiencies across each of the businesses.
So I would say that it's interesting because we were in New York City last week, and I was with our CIO, and we had a roundtable with a number of top enterprise customers in New York City. And he started out and just walked them through the journey, and it was a very good conversation about where each one of them are on this journey. So I would say that we're advanced in this area.
I would say that we took it on very, very aggressively, and we're also looking at how do you balance sort of token costs with the value, and we're really doing some advanced things across that, too. So overall, very, very strong adoption. You've got to look at this as both a provider and a major adaptor of AI.
Matt: Jim, the only thing I would add there is you guys saw us work with a big framework that we put together with Anthropic about, obviously, them buying up to 2 gigawatts worth of MI450, and there's also a lot of work of not just the OpenAI tools, but the Anthropic Claud tools being adopted across our engineering organizations and unlocking a much faster flywheel of software development and debug, time to production of chip programs, optimizing where our software people are spending their time.
We have a huge software organization and trying to figure out what they need to be working on, where can they use tools to accelerate that flywheel versus doing anything manual.
My Boss, Jean, our CFO, has benchmarked us versus a whole bunch of leading semis and tech companies. I think we're on the bleeding edge of AI adoption internally. It's come with an increased token cost, but it's come with a much, much greater productivity gain across the organization. And I think you'll see it allow us to bring hardware and software products to market much more quickly as we go forward.
Dan: Yeah, actually, just one last point.
I want to just emphasize that, right.
So you've got domain specific, and then you've got sort of what I would call general IT automation, and ones for efficiency. But when you can drive a faster time to market, that's where the real rubber hits the road. And that's what we're after. As we go to external enterprises, our goal is to get them time to value very quickly, right, with ROCm and with some of our solutions. So again, we always say we eat our own dog food. Everything we build is deployed in our data centers first. And, you know, it's going very well in terms of driving our time to market with our engineering teams.

Jim: Ya, with respect to your customers, from their perspective, how do you think this plays out in terms of model evolution over three to five years in terms of the landscape.
I mean, do you think frontier models still going to kind of be leading the charge here?
Do we see small language models kind of like do a lot more kind of task specific things?
Or do you think open weight, open source models are going to have a larger role to play?
Dan: You want to start or I can?
Matt: Yeah, I think, Jim, the answer is yes.
It's not a very helpful answer, but it actually is the answer.
I mean, our goal is to make sure that our combination of CPU and GPU roadmaps are very differentiated in terms of driving tokens-per-dollar outcomes, regardless of whether it's open-weight models, frontier models for our largest customers. I think those, I mean, obviously the industry is evolving quickly around what are the right use cases.
How should we say this?
But how to apply the right tokens to the right problem relative to the cost of the token versus the return of the token.
And that's a very large continuum.
I think our goal is to make sure that on the GPU side, our hardware and software are deriving the right efficiencies regardless of whether it's open-weight models or closed-weight models or frontier models, and that Dan's business is the right CPU to run agents to drive all of those models, regardless of where they come from.
I mean, that's kind of our goal.
I don't know, Dan, if you.
Dan: Yeah, I would just say, look, we rolled this out.
I showed this at our Advancing AI Day, right.
And Matt's right.
It's all of the above, right.
Clearly, Frontier will continue to be the cutting edge, but open weights are very, very valuable, and then you've got sort of what I would call SLMs for some of this domain-specific stuff, right.
And what we showed was intelligent routing, right.
So if you think about it, you've got Frontier.
Every enterprise is going to have some distributed model around Frontier, probably GPU as a service in the cloud.
Most likely an on-prem server that can service and run open-weights models. And you have a policy-based router, depending on the task. And you're looking at performance latency. You're looking at obviously security. That's one of the key areas where ... What I hear mostly is cost and security from the enterprise, right.
What you can do is you route this and you can manage your costs. You can manage, if it's a policy-based router, if it's highly secure, it stays on prem.
We see a lot of enterprises trying to build this out. It's very interesting because enterprises are infinitely hybrid and we believe that will continue.
Jim: Great.
Now I want to dive straight into your business.
First the AI business and also the server CPU business as well.
You know, your AI data center business has grown very rapidly over the last few years.
You know, if you think about the biggest strides you've made in product development across silicon, software, customers, ecosystem, you know, where do you think you can make the biggest strides going forward and kind of like where are your key focus areas from here?
Dan: Yeah, that's a great question because first and foremost, I always say this because it's very, very important.
Our vision for many years now has been you build the right compute engine for the right workload, and that's across CPUs. That's within, not only across the product lines, but within the product lines, right. So, you know, and we'll talk about server at some point, but, you know, we optimize for workloads. But most importantly is we feel like we're in very, very good shape across the different product lines, right. From server to GPU to networking, right. And now ROCm is coming online.
So I think the biggest part for us is we have now shifted from this sort of individual product lines to a full system provider. So providing the full rack, all of it interworking, and we're also driving a different roadmap cycle, right…
It used to be, you know, three, five years ago, it was like you're optimizing for your product now. It's a combined data center road map steering group. Whatever I'm doing, you have to make trade-offs across all of the products. I think that's the biggest change. What you'll see is getting rack scale solutions at scale is the biggest thing we're focused on right now.
Matt: I think from my perspective, just listening to, Dan spoke about it just now, but listening to Lisa and others speak about, we don't necessarily have to force ourselves to be, if you step back and think about the top, there's a long tail of customers that we're gonna continue to support, but if you think about the large top 15 or 20 or consumers of high-performance computing cycles in the world, we don't need to necessarily be their CPU partner or GPU partner or FPGA partner or semi-custom partner. We can walk into a room strategically and say how can we at scale be your high-performance computing partner.
And that might look differently at different customers, but it's a very powerful thing to be able to say, hey, we just want to be your high-performance computing partner and let's think strategically about what you want to do over the next number of generations and put solutions together that can support that across Endpoint, across inference at the edge, across the server, on-prem and in the cloud, AI deployments in massive data center scale or in PCs, or that there's a huge continuum of how can we be your high-performance computing partner, and being able to bring those pieces of IP to the market at significant scale is one of the things that I think is unique about what we bring, is it's not a push approach, it's a how can we be your partner and let's decide how we're gonna work together to bring significant amounts of high performance computing to market, I think that's the biggest change that's happened, and now that AMD has this full breadth of portfolio and the scale that we have, that's a conversation that I think is valuable.
Jim: Great.
Now, the company has outlined some pretty healthy revenue growth targets, 60% CAGR over the next several years in data center revenue, 80% CAGR in AI data center revenue.
Talk about two elements of that.
One is how diverse does this get between the hyperscalers, CSPs, enterprise, AI labs over time, even sovereigns.
And then, so how diverse does it get?
And then secondly, what should we be thinking about in terms of markers for more of the short-term going into 2027?
Matt: I'll start.
Yeah, maybe I'll start, and Dan can add a bunch of detail on his business and server.
Yeah, Jim, we have outlined, we started at the Analyst Day back in November, and it's amazing how long ago that seems, given how fast this industry's moving now, but we talked about more than 60% growth of the data center franchise, more than 80% of growth of the AI business, and at that time, we thought we were well above where the market was in talking about a $60 billion server TAM, and we've now more than tripled that.
So we're, at that point in time, talked about the company growing at more than 35% annually.
Lisa and the team have updated the TAM for AMD to be more than, around $2 trillion by 2030, and that's a 40% growth rate of the TAM, and we expect to grow faster than that as a company.
And we talked about getting to more than $20 in earnings over the sort of strategic timeframe, and I think we've updated that to be significantly more than $20.
So, we're excited about the growth, the leverage, and the model, and we've given a few data points on 2027, much more than doubling the data center business, and those are things that we feel really good about, and now it's just putting our heads down and making sure that we scale the AI business in terms of building racks. And Dan's business is in a very, very different place than it was 12 or 24 months ago in terms of growth.
So we feel it's a very, very exciting time at the company, but at the same time we're heads down in trying to execute. So I understand if you want to expand on that.
Dan: Yeah, I would just say, look, the way I look at our AI business is very similar to the way I looked at the server business five years ago, right… Very deliberate approach. You get in, and if you look at what we did in server, it was strong in cloud and national labs and then we evolved into the enterprise, right. And now we're seeing very, very strong growth in the enterprise. I think you'll see the same thing happen.
Like Matt said, we're very focused on delivering to our top customers right now with Helios, but the spread will happen. Just like I just talked about, the enterprises are really thinking through what their overall infrastructure needs to look like. It will include cloud. But if you think about AI, it's the exact opposite of what happened in general purpose compute.
General purpose compute started on prem and went to the cloud. It's the exact opposite. And we are seeing many of the mainstream enterprises look at building sub rack scale, whether it's PCI card type deployments or eight way server UVB based deployments to do exactly what I just talked about in terms of what is the right balance and what's the distributed architecture that you need for the long term.
So I think what you'll see is the shift happen over time, but right now, like Matt said, we're pretty concentrated from an AI standpoint.
However, with server, we really are, you know, Lisa and Jean talked about the results we're seeing across the enterprise as well as cloud, and it's growing quite dramatically right now in terms of share gains across all of the mainstream enterprise and the channel.
We have invested very heavily over the last few years to drive the channel and the enterprise. It's really starting to pay off.
There's no sort of fixed ratio but it's more of know, I see the same evolution happening across the AI business.
Jim: Fantastic.
Want to dive into server CPUs next.
You're a home turf, so to speak.
So for investors less familiar with the technical details of agentic AI, maybe help us understand why agentic workloads actually drive higher tag traits for CPUs, and as you do that, maybe talk about the changes in system architectures that occur as the customers move from simple inference to more autonomous, multi-step AI workloads.
Dan: Yeah.
Look, this is a hot topic, and I think I would start with saying that this is more of a distributed systems architecture problem as opposed to a simple linear problem.
If you think about the world of ChatGPT from November 22 to probably into last year, very linear. It was a SaaS-based data center. You have your servers for web serving, you've got your application servers, you've got your database storage, you've got caching, and then you've got sort of this GPU server, right.
Which everyone understands the GPU server, right. You know the ratios, everyone can calculate that very easily. And that was very linear, prompt response, right. That's what it was built for.
Well, with Agentic, as you all know, it's an entirely continuous flow. It's a completely different compute paradigm. It's 24-7 churning, within a sandbox, spawning numbers of different agents.
So if you just think of the picture I tried to just draw for you, if you think of your traditional servers here and your big GPU servers here, you kind of open it up and you pull in a whole new class of compute, which is for agentic, control plane, API calls, database queries, database queries, tool execution. And that is pure CPU-based. So that clearly will do RL with the GPU service. So the GPU servers grow also. But if you think about those general purpose servers, those get uplifted too. Because more and more calls to those. So you're seeing an uplift in a whole new class plus the traditional general purpose. And we're just seeing that dramatically grow, right. And at our FAD in November, I said that, look, there's multiple areas of growth for the CPU. We called it, but we called it too low, right. So we've upped it now. And I think the growth we're seeing across both the enterprise and the cloud is very, very exciting.
And then lastly, what I would say is with Venice, we are hitting on the three main focus areas for CPU, right. You've got your GPU server that everyone knows and loves in terms of, you know, started out one to four, a CPU to GPU. Then you've got this agentic sandbox CPU where with Venice with our high core count, 256 core device, that is, if you think about agentic, it is really threads per watt with the right level of per core performance.
If you think about the head node, it's really about IPC and high frequency driving and keeping the GPUs busy.
Then the general purpose servers, we've been very, very strong there for many years and we're going to continue.
When you think about it, we feel like not only with Turin Today leadership, Venice, as we launched it already and as it comes online here through the back half of this year, we are extremely well positioned to capture this growth.
But I'd say one last thing.
If you're trying to find a number to plug into a model, it's very, very hard because there's so many things. If you just think of a gigawatt of power and then you factor in your PUE and you come up with your IT power. It's all about the addition of the CPUs. Again, the host node, you know. We all know. That's easy calculation. But it all depends on what you're trying to run. It's really workload dependent, and that's why it's so hard to plug a number in. But that's why we tried to capture sort of, hey, this is the growth we see. And when we show it for agentic, it is also pulling in the uplift in those general purpose servers that I talked about.
So I don't know if I confuse you more or not, but just trying to give you the picture of what we're seeing.
Jim: Yeah.
Matt: Dan, maybe I just add one thing.
I mean, we did take a $60 billion TAM out to 2030 and up that now to $120 billion and then $220 billion, and the companies ... I know what Lisa's expecting of you, Dan, is for your business to be over 50% of that TAM as we grow, and it'll be ... we can do a relatively small number of Chiplets and put them together in configurations that can be a significant number of SKUs and a full coverage of the platform.
So, I mean, you guys can do the math on more than 50% of the 220 billion.
I mean, it is, I've been following and now part of AMD's server business for a very, very long time. And to talk about building a hundred billion dollar server business is pretty exciting.
No pressure, Dan.
But that's what we see coming, is a significant growth of agenetic sandbox CPUs for which we have very large core count multi--threaded parts, strong growth of head node CPUs where we have really high frequency, focused, high bandwidth, high single-thread performance parts, and then the broad range of the server market.
One of the things that stuck out to me seeing the results of Dan's business in the second quarter, I it seems like forever ago, we talked about the second quarter, but even the enterprise part of the server business grew more than 70%. The industry's not seen those type of growth rates in enterprise server, basically ever.
So we're very excited about all parts of the server business and the breadth of SKUs and the breadth of platforms as we roll out Venice and then move into the Florence generation is something that we're really excited about.
Jim: Now, the server CPU market, as I said, it's also becoming increasingly competitive even as it's growing.
So what advantages do you think the x86 ecosystem continues to provide for the enterprise specifically, and how do you think about the durability of x86 in the hyperscaler environments, especially for some of these internal workloads where customers are developing their own silicon?
Dan: Yeah, this is a common question.
So I mean, first and foremost, we always talk about this. This is not an instruction set architecture problem or concern. There's no fundamental differences in the ISA between x86 and ARM. It's really about delivering to different optimization points. It's perf per watt per dollar, ultimately. And we know that if we continue to drive along the three swim lanes that we just talked about and optimize for that performance per watt, we're in very, very good position.
And if you think about from an ecosystem standpoint, if you go back to that picture, I tried to draw it with my hands, all those general purpose servers that I talked about, x86 based today. Lots of software built for x86. So the ecosystem is built around X86. So all that growth comes on X86.
Now, if you look at sort of the hyperscalers, each one of them are doing some form of their own. And what we see is, if we continue to drive just what I talked about, which is the highest throughput and core density per watt, and then we hit these other points, we feel extremely good about the design in that we have right now across all of the major cloud vendors in the world. Across from an agentic standpoint at 256 core, from a high frequency standpoint at 96 core, and then just across other skews for high performance computing.
And even though, I'll just give you a good example, like recently Amazon came out with RDS, which is their database service, which is a first party property, right, that we would classify. It's on Turin. And the reason why is performance.
So we just know that, yes, would they, Yeah, there is a focus for them to try to get their first party properties on their home grown, but is doesn’t fit for everything. And again, even when you go high density, it's that perf per core sweet spot and that optimization point on the VF curve that we very, you know, we pay close attention to.
So we really feel like where we are today with coming out with Venice, well, Turin today with Venice coming out as we speak and ramping, and then, you know, I just, I was looking at, we had a review earlier this week on even Zen 8 in terms of what our engineering teams are targeting.
So I feel very, very good about where we are in terms of delivering the optimization points.
That's the key, right.
It's really optimizing for the different workload in the deployment model.
Matt: I think, Dan, I agree.
I mean, from my perspective, it's not watching the teams internally, the investor focus tends to be much more around instruction set, and it is important for the enterprise pieces of the server market, whether that's on-prem deployment or in-cloud deployment. But the economics of rolling out the server market to unprecedented scale that we talked about with the TAM. It's about building the best server parts, period. Never mind the instruction sets.
And I think that's what we, from a scale and supply chain point of view, from a… optimization points and the number of SKUs that we can roll out, the number of platforms that we can roll out, the significant amount of optimization you can do for different places in the roadmap, I feel really good about where we are. And it's not just what we think about the market. We can see the demand pull from customers for different optimization points. And so when we think about, OK, this is where the demand pull is, and these are conversations that are multi-generation in nature, I think we feel really good about where the server business is.
Dan: I would just, final point on that is for Venice, and I'm pretty sure Lisa talked about this at our last earnings, but with each generation we built builds on the next, right.
And you get more and more of the ecosystem coming along with you as you go, and we've been very, very focused on that. But with Venice, it's the broadest true launch that we've had in terms of OEMs, ODMs, cloud vendors, the ISVs on day zero support. You know, the demand is very, very strong. Due to the three swim lanes that I talked about, I think our customers in the ecosystem are seeing that one SKU doesn't solve every problem. Right. And that's kind of what we're seeing from a merchant arm standpoint. It's really just sort of singular SKUs or one or two SKUs.
So we're pretty excited because it really is in a, we're in a very good spot from a market opportunity standpoint and our product portfolio leadership across really, I would argue, three generations straight.
Jim: Excellent.
You know, one thing that's striking me is for the past couple years, we've kind of changed the parlance of how we talk about this market. We're not talking about server counts or counting accelerators. We're talking about counting gigawatts of capacity. And every single presentation at this conference has done that. So maybe as you think about these multi-gigawatt AI deployments, how should investors be thinking about CPU content per gigawatt?
Matt: Yeah, maybe I'll start.
We think the focus that we have at AMD broadly in our data center business is to make sure that we provide very compelling tokens per dollar and TCO for our GPU business.
And we're right in the thralls of ramping and launching Helios and MI455. And you'll see us be a very large partner to some of the leading model companies in the world to run their inference workloads.
Separately, Jim, regardless of whether the inference runs on our GPUs or NVIDIA GPUs or TPUs or whatever XPU, I mean, Dan can expand on this, but I think what we're focused on in the server business is to make sure that AMD's Venice portfolio and going forward are the, they're the differentiated and right place for the industry to run agent code.
And so we haven't been super specific about what that ratio is in terms of gigawatts of deployment because it does look different depending on what customer it is, but we want to grow a very large AI business and I think Dan's business is positioned to be a significant majority of the industry running agents to power agentic AI.
And so we haven't been super specific on the gigawatt comments in terms of CPU.
Dan: Yeah, I was just, really simple, “it depends”.
Because the challenge is, so take a gigawatt. You do, again, do your PUE. You've got this IT. And then you've got to break it down where, OK, I've got clusters of GPUs over here training. I've got clusters here doing inference. Then I've got to support it with a general purpose. And then the agents. And it just really depends on what you're trying to accomplish with that gigawatt. And it's very hard to just say, oh, you know, here's a fixed ratio. I would say that it's growing, right. Like if you think about it today, we're saying one-to-one, you know, sort of ratio. And, you know, it's going to continue to grow. But it's just very hard to pinpoint. Plug this into a model and you'll get what you're looking for. It's very highly dependent on what the end customer is trying to accomplish.
Jim: I spend a lot of time plugging numbers into models.
OK, we're almost out of time.
But let me leave you with the last question for you.
If we are, we've covered a lot of ground.
If you think about your position in AI, compute data infrastructure, data center infrastructure, et cetera, if we're up in here on stage again in five years and we look back, what do you think the one thing or two things that investors are going to be most surprised about in terms of the performance of the company?
Matt: Dan, do you want to start off?
Dan: Look, I think maybe I'll start with maybe what people may be missing about us.
What I talked about earlier is we have fully transitioned from a very, very good silicon provider across multiple products to a, and we are transitioning now to full rack scale.
And our software has come, even over the last six months, the gains we've seen.
We're becoming more of a software company and a systems company today than we were even six months ago.
I'll just say that that that will be, I think if you look forward 12 to 24 months, I think it'll become very clear how we have made that transition quickly, and we've driven a software stack that is truly focused on time to value for our customers.
I think that's where I'd leave it in terms of what you'll see over the next few years.
Matt: I mean, it's, from my perspective, we're, the goal is to, I mean, Dan started the conversation this way, Jim, where we want to provide the industry that consumes high-performance computing with the right type of computing for the right type of workload.
And I think that that will serve us well across the breadth of our markets, and we're right now at one of the more exciting times that the industry's seen, and more exciting times for the company.
We've talked about much more than doubling our data center business next year, and driving gross margin dollars very significantly faster than expenses, right.
So we're at that inflection point, and I think it's important for the investor community to understand that Lisa and the whole team, it's funny, we were doing a meeting in a room at the conference just an hour before we came on stage here, and Dan was on an execution meeting with Lisa and the team, right.
So it's like the team is focused on making sure that we have a cadence of execution at the company, and despite all the excitement there, the focus remains on making sure that we execute.
And if we do that, then I think investors will be really pleased with where things end up, but it's not about driving, for us it's about driving outcomes for customers, and then that'll translate into outcomes for the investment community, not the other way around.
So we're just gonna put our heads down and execute, because it's a super exciting time.
But as we wrap up here, the little blinking light is on. Thank you all for spending time with us.
And thank you, Jim and the team at Goldman for hosting us.
We really appreciate it.
Jim: And Matt, thanks for being here.
I appreciate it.
Thank you.

.dark-mode .zb0pQd{ color: white; background-color: #333333; border: 2px solid white; }.light-mode .zb0pQd{ color: #333333; background-color: white; border: 2px solid #333333; }ARMArm Holdings plcstock NASDAQ ADR

ARM
Arm Holdings plc
stock NASDAQ ADR