Deepseek Running Locally with RAG

Here is a quick video I made showing a distilled version of the Deepseek model running locally and accessing some local documents. Usually I’ve been using GPT4ALL for local LLMs but it was having errors so I switched to LM Studio. Not you currently have to use a Beta build of LM studio as the “normal” version doesn’t have RAG capability built in.