DeepSeek.com making waves!

[vishalrao]

Folks who are into AI - have you not been following recent chinese deepseek.com news? i just (found out about and) downloaded the lmstudio.ai desktop gui app and gave it a whirl... nice easy way to run local stuff, better than ollama.com in the sense it's only command-line.

Go check it out and see all the buzz (and panic for the US) this is causing!

 

[Jonas]

Source

Chinese Open-Source AI DeepSeek R1 Matches OpenAI's o1 at 98% Lower Cost - Decrypt

DeepSeek's new R1 model matches or beats OpenAI's performance while being free and open-source—and it got there in a fascinating way.

decrypt.co

 

[Hitori_Abhito7]

I have a simple corpo laptop with 8gb ram and a i5 1135G7 CPU, what model should I run and will I be able to run any at all?

 

[Navjot Singh]

You can use the web version of Deepseek (chat.deepseek.com).

 

[vishalrao]

Just try lmstudio.ai app on your laptop - you should be able to run some small sized models.

 

[Hitori_Abhito7]

@Navjot Singh Thanks bossman, also any suggestions for tempmail or alias mai which actually work with it?

 

[SpeedxThunder]

try this https://m.kuku.lu

 

[vishalrao]

Tried LMStudio.ai on my 9950X + 7800XT with the qwen-7b-instruct and deepseek-r1-distilled-qwen-7b models and asked "write a poem"... The CPU mode gives about 12 tokens per second and using Vulkan or ROCm for the GPU give nearly 8x speedup at just over 80 tokens per second.

 

[vishalrao]

I liked this video from CNBC:


Source

 

[Deleted member 87056]

Can we really trust these benchmarks? I mean deepseek is open source but I honestly feel the way these benchmarks are presented is just to hype up the company and shit on OpenAI(which they deserve honestly). I feel that the only big advantage deepseek has is that it's open source and we really don't know what dataset they are using to beat openAI and other LLMs in the benchmark . The dataset could have some sort of bias.
I also feel that an open source product from china is something we can't really trust on, not everyone is going to run it locally, most of the folks would run it online. I really don't know what china might do with the data they collect and the fact that the model was announced right after the ban of tiktok makes it more suspicious. Ek taraf se data milna band hua to dusra raasta bana liya

Also the impact it had on the US stock market, Nvidia stocks fell like crazy. Microsoft(MSFT), who is a major holder in OpenAI is also bound to fall until the hype remains. We all know that Indian stock market is a follower of the US Market so we can expect a little turbulence here as well. The market is very volatile after US elections.