OpenAI's nightmare: Deepseek R1 on a Raspberry Pi

Wed, 29 Jan 2025 09:07:22 +0000

DeepSeek R1 runs on a Pi 5, but don't believe every headline you read.

Resources referenced in this video:

- DeepSeek R1: https://github.com/deepseek-ai/DeepSeek-R1
- Ollama and llama.cpp benchmarks on Pi 5: https://github.com/geerlingguy..../ollama-benchmark/is
- Reuters article on DeepSeek: https://www.reuters.com/techno....logy/artificial-inte
- DeepSeek FAQ from Stratchery: https://stratechery.com/2025/deepseek-faq/

Support me on Patreon: https://www.patreon.com/geerlingguy
Sponsor me on GitHub: https://github.com/sponsors/geerlingguy
Merch: https://www.redshirtjeff.com
2nd Channel: https://www.youtube.com/@GeerlingEngineering
3rd Channel: https://www.youtube.com/@Level2Jeff

Contents:

00:00 - OpenAI's Nightmare
01:00 - What can a Pi 5 do, really?
01:39 - 671b on AmpereOne
02:00 - Pi 5 14b - CPU inference
02:20 - Pi 5 14b - GPU inference
03:05 - GPUs on Pi (and year of the Arm PC)
03:37 - Still in an AI bubble