CDNA
CareDx, Inc.
stock NASDAQ

My quick thoughts on where/how this could be useful. Totally baseless speculation based on me joining dots that might not even exist...
# Short Term (6-12 Months?)
* Likely just as-is to help take the edge off the current RAM drought, but maybe for AMD only?
* I think AMD has done similar in the past with some RAMDisk software on Windows for Ryzen?
* This doesn't seem very compelling, I would have though EPYC was competitive enough on it's own
# Mid Term (1-2 Years?)
* I think on this time scale you could see it adapted for GPUs and integrated into the CDNA Drivers
* Flash-to-VRAM (like with CPU) seems the most obvious here, though I'm not sure which usecase this helps with. Local inference of big models with low parallelism?
* I seem to remember there was some rumour of MI400 also having a larger but slower pool of LPDDR, in addition to the HBM. Predictive promotion of data up to the HBM could be a usecase?
# Long Term (3-5 Years?)
* CPUs predict memory access to fetch them into the cache
* On this timescale, I think it starts to be possible to build this into a CPU Core, e.g. Zen 8 or 9
* I wouldn't expect the full algorithm, but a sort of 80/20 reduction
* Could improve IPC by better predicting "random" memory accesses?

My quick thoughts on where/how this could be useful. Totally baseless speculation based on me joining dots that might not even exist...
# Short Term (6-12 Months?)
* Likely just as-is to help take the edge off the current RAM drought, but maybe for AMD only?
* I think AMD has done similar in the past with some RAMDisk software on Windows for Ryzen?
* This doesn't seem very compelling, I would have though EPYC was competitive enough on it's own
# Mid Term (1-2 Years?)
* I think on this time scale you could see it adapted for GPUs and integrated into the CDNA Drivers
* Flash-to-VRAM (like with CPU) seems the most obvious here, though I'm not sure which usecase this helps with. Local inference of big models with low parallelism?
* I seem to remember there was some rumour of MI400 also having a larger but slower pool of LPDDR, in addition to the HBM. Predictive promotion of data up to the HBM could be a usecase?
# Long Term (3-5 Years?)
* CPUs predict memory access to fetch them into the cache
* On this timescale, I think it starts to be possible to build this into a CPU Core, e.g. Zen 8 or 9
* I wouldn't expect the full algorithm, but a sort of 80/20 reduction
* Could improve IPC by better predicting "random" memory accesses?