Some suggestions

[brownplayer]

Hello, I've been following the ai playground for a long time. This application gives me many surprises, such as running llm that requires large memory, which has more advantages than ollama and lm studio on intel platform. However, such a long update also exposes some problems, such as slow update speed. I believe that a large part of the users of ai playground need to process some data locally, so they need some large models with more advanced and powerful performance. However, due to the slow update speed, users gradually and sharply abandoned it. For example, the recent deepseek r1 has shown good performance, and I hope the official version will be updated to meet the needs of deepseek R1.

[bobduffy]

Hello, I've been following the ai playground for a long time. This application gives me many surprises, such as running llm that requires large memory, which has more advantages than ollama and lm studio on intel platform. However, such a long update also exposes some problems, such as slow update speed. I believe that a large part of the users of ai playground need to process some data locally, so they need some large models with more advanced and powerful performance. However, due to the slow update speed, users gradually and sharply abandoned it. For example, the recent deepseek r1 has shown good performance, and I hope the official version will be updated to meet the needs of deepseek R1.

What kind of update are you thinking is needed for deepseek R1?

[brownplayer]

Thanks for your reply, I think if ai playground can use more llm models, it will make the application more practical value, such as supporting deep inference models like deepseek R1. I'm not sure what components need to be added for this ai playground. But it would be cool to be able to support deepseek R1.

[bobduffy]

Deepseek is currently supported

Click the + icon in the Answer Tab then paste in the model ID: "deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B" and confirm

See here https://www.linkedin.com/posts/bobduffy5_getting-deepseek-r1-running-locally-on-your-activity-7290524110999195649-wZZl

[brownplayer]

wow，it‘s great