“If you buy sumthin’ through these links, this ol’ boy might snag a small commission—enough to buy a biscuit—at no extra cost to you!”
– – – It’s finally arrived! A benchmark with an Intel Arc gpu. This one’s a real brain buster… as the Intel XMX tensor cores are a unique beast to tame. Join Country Boy try his hat at the mighty Intel Arc A770 – 16gb gpu, with 512 of Intel’s Xe Matrix eXtensions (XMX) tensor cores.
We compare Qwen3:14b with this graphics cards to over a dozen others such as the RTX 5090, 3090, 7900 XTX and Radeon Vii / Mi50.
This setup was anything but typical…
Here’s a link to the Microsoft Visual Studio 2019:
https://aka.ms/vs/16/release/vs_community.exe
Intel OneAPI is required, as well as the full Intel gpu driver install.
I mentioned that I would copy the code for the servearc.py file as well as the openvinobench.py file… it wouldn’t allow me to post the characters from the script – if you want them, please ask.
countryboycomputersbg.com
https://patreon.com/CountryBoyComputers
Timestamps:
0:00 – Intro
0:51 – BIOS setup
1:29 – Intel install
3:35 – overall project
4:48 – A770 specs
6:06 – Expectations
6:30 – LMStudio
12:35 – Ollama
15:10 – llama.cpp SYCL
21:04 – OneAPI toolkit
23:50 – Software setup
31:04 – OpenVino
36:07 – Summary
source
Leave a Reply