Pretraining code for a large-scale depth-recurrent language model

Grab your own sweet-looking '.is-a.dev' subdomain.

欢迎来到 LLM-Dojo，这里是一个开源大模型学习场所，使用简洁且易阅读的代码构建模型训练框架(支持各种主流模型如Qwen、Llama、GLM等等)、RLHF框架(DPO/CPO/KTO/PPO)等各种功能。👩‍🎓👨‍🎓

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

rhythm is just a *click* away!

🤯 Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / DeepSeek / Qwen), Knowledge Base (file upload / knowledge managemen…

FIDO Passkey for Raspberry Pico and ESP32

test