Skip to content

Actions: huggingface/lighteval

Actions

Quality

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
quality.yaml
1,794 workflow runs
1,794 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Hotfix for litellm judge Quality #1991: Pull request #490 synchronize by JoelNiklaus
January 7, 2025 14:57 2m 13s JoelNiklaus:fix-litellm-judge
JoelNiklaus:fix-litellm-judge
January 7, 2025 14:57 2m 13s
Fix T_co import bug Quality #1990: Pull request #484 synchronize by gucci-j
January 7, 2025 13:51 2m 13s gucci-j:fix-tco
gucci-j:fix-tco
January 7, 2025 13:51 2m 13s
feat: add JGLUE tasks Quality #1988: Pull request #469 synchronize by ryan-minato
January 7, 2025 09:10 Action required ryan-minato:jglue
ryan-minato:jglue
January 7, 2025 09:10 Action required
feat: add JGLUE tasks Quality #1987: Pull request #469 synchronize by ryan-minato
January 7, 2025 09:08 Action required ryan-minato:jglue
ryan-minato:jglue
January 7, 2025 09:08 Action required
Made litellm judge backend more robust. (#485) Quality #1986: Commit fdb12f4 pushed by clefourrier
January 7, 2025 08:24 2m 12s main
main
January 7, 2025 08:24 2m 12s
Fix issue with encodings for together models. (#483) Quality #1985: Commit 2073a29 pushed by clefourrier
January 7, 2025 08:23 2m 4s main
main
January 7, 2025 08:23 2m 4s
Implemented the possibility to load predictions from details files and continue evaluating from there Quality #1984: Pull request #488 synchronize by JoelNiklaus
January 7, 2025 06:11 3m 42s JoelNiklaus:load-details
JoelNiklaus:load-details
January 7, 2025 06:11 3m 42s
Add swiss legal evals as new community tasks Quality #1983: Pull request #389 synchronize by JoelNiklaus
January 7, 2025 04:30 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 7, 2025 04:30 Action required
Added cache for openai models. Quality #1982: Pull request #435 synchronize by JoelNiklaus
January 7, 2025 04:30 Action required JoelNiklaus:add-openai-cache
JoelNiklaus:add-openai-cache
January 7, 2025 04:30 Action required
Added custom model inference. Quality #1981: Pull request #437 synchronize by JoelNiklaus
January 7, 2025 04:29 Action required JoelNiklaus:add-custom-model
JoelNiklaus:add-custom-model
January 7, 2025 04:29 Action required
Fix issue with encodings for together models. Quality #1980: Pull request #483 synchronize by JoelNiklaus
January 7, 2025 04:26 2m 14s JoelNiklaus:fix-encoding-issue
JoelNiklaus:fix-encoding-issue
January 7, 2025 04:26 2m 14s
Made litellm judge backend more robust. Quality #1979: Pull request #485 synchronize by JoelNiklaus
January 7, 2025 04:26 2m 7s JoelNiklaus:fix-litellm-judge
JoelNiklaus:fix-litellm-judge
January 7, 2025 04:26 2m 7s
Implemented the possibility to load predictions from details files and continue evaluating from there Quality #1978: Pull request #488 opened by JoelNiklaus
January 7, 2025 04:23 Action required JoelNiklaus:load-details
JoelNiklaus:load-details
January 7, 2025 04:23 Action required
feat: add asian language support to CorpusLevelTranslationMetric Quality #1976: Pull request #479 synchronize by ryan-minato
January 7, 2025 00:25 2m 6s ryan-minato:feat/asian-lang-translate-metic
ryan-minato:feat/asian-lang-translate-metic
January 7, 2025 00:25 2m 6s
Update README.md (#486) Quality #1975: Commit f6fee3a pushed by clefourrier
January 6, 2025 12:45 2m 7s main
main
January 6, 2025 12:45 2m 7s
fix doc links in readme Quality #1974: Pull request #486 opened by NathanHB
January 6, 2025 11:31 2m 5s NathanHB-patch-1
NathanHB-patch-1
January 6, 2025 11:31 2m 5s
Add swiss legal evals as new community tasks Quality #1970: Pull request #389 synchronize by JoelNiklaus
January 4, 2025 10:18 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 4, 2025 10:18 Action required
Tiny improvements to endpoint_model.py, base_model.py,... (#219) Quality #1969: Commit 452e031 pushed by clefourrier
January 3, 2025 17:22 2m 6s main
main
January 3, 2025 17:22 2m 6s
Tiny improvements to endpoint_model.py, base_model.py,... Quality #1968: Pull request #219 synchronize by sadra-barikbin
January 3, 2025 15:33 2m 7s sadra-barikbin:small-improvement-in-models
sadra-barikbin:small-improvement-in-models
January 3, 2025 15:33 2m 7s
Fix T_co import bug Quality #1967: Pull request #484 opened by gucci-j
January 3, 2025 15:03 2m 8s gucci-j:fix-tco
gucci-j:fix-tco
January 3, 2025 15:03 2m 8s
Release: v0.7.0 Quality #1966: Commit 657978d pushed by NathanHB
January 3, 2025 14:02 2m 18s v0.7-release
v0.7-release
January 3, 2025 14:02 2m 18s
Add swiss legal evals as new community tasks Quality #1965: Pull request #389 synchronize by JoelNiklaus
January 3, 2025 11:55 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 3, 2025 11:55 Action required
Add swiss legal evals as new community tasks Quality #1964: Pull request #389 synchronize by JoelNiklaus
January 3, 2025 11:11 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 3, 2025 11:11 Action required
Fix issue with encodings for together models. Quality #1963: Pull request #483 opened by JoelNiklaus
January 3, 2025 10:47 2m 2s JoelNiklaus:fix-encoding-issue
JoelNiklaus:fix-encoding-issue
January 3, 2025 10:47 2m 2s
Add swiss legal evals as new community tasks Quality #1962: Pull request #389 synchronize by JoelNiklaus
January 2, 2025 16:41 Action required JoelNiklaus:add_swiss_legal_evals
JoelNiklaus:add_swiss_legal_evals
January 2, 2025 16:41 Action required