Pinned Loading

1. jax-llm jax-llm Public

   JAX implementation of Large Language Models. You can train GPT-2-like model with 青空文庫 (aozora bunko-clean dataset) or any other text dataset.

   Python 11 2

2. input-method input-method Public

   First-two-char input method using transformer-based language model and n-gram model.

   Python 1

3. fast-near-duplicate-matching fast-near-duplicate-matching Public

   Fast near-duplicate matching is a method for quickly finding near-duplicate spans in a document by utilizing the Rabin-Karp algorithm.

   Rust 1

4. llava-mnist llava-mnist Public

   llava-mnist is a simple example of Vision and Language model using LLaVA architecture trained on MNIST dataset.

   Python

5. llm-jp/text2dataset llm-jp/text2dataset Public

   Easily turn large English text datasets into Japanese text datasets using open LLMs.

   Python 18 1

6. llm-jp/llm-jp-eval-mm llm-jp/llm-jp-eval-mm Public

   This tool automatically evaluates Japanese multi-modal large language models across multiple datasets.

   Python 9