This is a new way to compare processors
AMD is once again showing off the NPU performance of its Ryzen 8000 mobile processors, comparing them with the latest Core Ultra.
AMD compared the Ryzen 7 8840U to the Core Ultra 7 155H in tests involving large language models. In the Llama v2 chat, the Ryzen APU processed tokens 14% faster than the Core Ultra 7 155H. For the same bit size in Mistral Instruct, the Ryzen processor delivers 17% faster token processing speed.
In the same LLM tests, but including time to first token for sample request, the AMD processor was 79% faster than Core Ultra 7 in Llama v2 and 41% faster in Mistral Instruct.
In the Llama 2 7B chat, which uses a variety of different bit sizes, block sizes and quality levels, even the Ryzen 7 7840U was on average 55% faster than its Intel counterpart, and this despite the fact that in terms of dry block performance The NPUs of these processors are close (10 and 11 TOPS). The Ryzen 8040, let us remind you, has an NPU performance of 16 TOPS, and this is a current record in this class.
Recall that we recently saw independent tests from the Procyon suite, which also showed the superiority of AMD processors, but the problem is that many tests only work on some CPUs and do not work on others.