Introduction DeepSeek is an advanced open-source code language model (LLM) that has gained significant popularity in the developer community. When paired with Ollama, an easy-to-use framework for running and managing LLMs locally, and deployed on Azure Kubernetes Service (AKS), we can create a powerful, scalable, and cost-effective environment for AI applications. This blog post walks […]

Discover how to create a private AI-powered document analysis system using cutting-edge open-source tools. System Requirements 16GB RAM minimum 10th Gen Intel Core i5 or equivalent 10GB free storage space Windows 10+/macOS 12+/Linux Ubuntu 20.04+ 🛠️ Step 1: Installing Ollama Download Ollama for macOS, Linux, or Windows: Download Ollama Follow installation instructions based on your […]

Introduction to DeepSeek-R1 and Ollama In the era of generative AI, efficiently deploying large language models (LLMs) in production environments has become crucial for developers and organizations. DeepSeek-R1 is a powerful quantitative LLM developed for complex natural language processing tasks, offering state-of-the-art performance in text generation, question answering, and semantic analysis. Its optimized architecture makes […]

Quantizing DeepSeek-V3 for Smaller GPUs Large language models (LLMs) like DeepSeek-V3 offer incredible capabilities, but their size often makes them challenging to run on consumer hardware. One technique to address this is quantization, which reduces the precision of the model’s weights, allowing it to fit into smaller GPUs. This blog post demonstrates how to load […]

This blog demonstrates how to use DeepSeek-R1 for text generation using Ollama, a tool for running LLMs locally. These instructions align with the usage described on the DeepSeek-R1 page at ollama.com. 1. Install Ollama Ollama currently supports macOS (both Intel and Apple Silicon). Install it using Homebrew: brew install ollama Confirm the installation by checking […]

Artificial Intelligence has seen tremendous growth in recent years, with advanced models like OpenAI’s ChatGPT leading the charge in natural language processing. However, a new contender, DeepSeek, has emerged, and it’s making waves by adopting a distinct approach to AI model development. While ChatGPT has been a benchmark for generative AI, DeepSeek is challenging the […]