Skip to content

Commit

Permalink
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
rev
Browse files Browse the repository at this point in the history
kenarsa committed May 10, 2024
1 parent 0518764 commit 55584b5
Showing 2 changed files with 3 additions and 5 deletions.
2 changes: 1 addition & 1 deletion LICENSE
Original file line number Diff line number Diff line change
@@ -186,7 +186,7 @@
same "printed page" as the copyright notice for easier
identification within third-party archives.

Copyright [yyyy] [name of copyright owner]
Copyright 2024 Picovoice Inc.

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
6 changes: 2 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
@@ -53,13 +53,11 @@ both partitions and report the results separately.

### Perplexity Loss

Perplexity measures the models' language modeling capabilities. Research has shown that perplexity is very sensitive to
quantization and can be used to detect deterioration in the model's output distribution early on.
Perplexity measures the models' language modeling capabilities.

## Data

All required data for the benchmark is available under the `/res` folder But if you wish to reproduce it find out
how the data is curated or change it you can follow the sections below.
The'/res' folder contains all required data for the benchmark. To reproduce it, follow the sections below.

### MMLU

0 comments on commit 55584b5

Please sign in to comment.