DeepSeek has made waves around the internet in the last few days, praised for its open-source reasoning capabilities and outperforming OpenAI’s costly ChatGPT. DeepSeek R1 is a distilled model that matches the capabilities of top-tier models like OpenAI’s GPT-4 and Claude 3.5 Sonnet in tasks like math, coding, and reasoning. The best part? It’s completely free and ensures 100% privacy since it runs locally (offline, therefore, no internet). I must say, I am impressed by it, as many others are. For example, HuggingFace has already started working on fully reproducing and open-sourcing R1, including training data, training scripts, and more.
This weekend, I succeeded in installing and running DeepSeek R1 also locally on my laptop. As explained also by this post, all you have to do to install it locally is first install Ollama from https://ollama.com/download. After this, Ollama will run in the background, ready to pull and execute AI models. Ollama supports multiple versions of DeepSeek R1, ranging from smaller models to larger, more powerful ones. Choose the model size based on your hardware capabilities and run it in your terminal with, e.g. ollama run deepseek-r1:8b
With this command, Ollama will download and run the model locally on your laptop. Note: Larger models like the 32B and 70B versions require significant GPU power. If you’re unsure about your hardware, start with the 8B version and upgrade later.
After that, I installed Chatbox, a user-friendly desktop interface that allows users to interact with AI models. It’s privacy-focused and works seamlessly with Ollama. Many users have praised its simplicity and clean design. You first need to download it from https://chatboxai.app, and once installed, in Settings, set the model provider to Ollama and the API host to http://127.0.0.1:11434
(this is the default and should work out of the box) and select the DeepSeek R1 model you downloaded on your laptop.
That’s it. Once configured, you can start interacting with DeepSeek R1 directly through Chatbox, with no fear of privacy issues, and completely free!
Neueste Kommentare