Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add Coaching & ScoreBoard class (result tracking) #72

Merged
merged 40 commits into from
Feb 6, 2025
Merged

Add Coaching & ScoreBoard class (result tracking) #72

merged 40 commits into from
Feb 6, 2025

Conversation

andreaskoepf
Copy link
Contributor

No description provided.

@andreaskoepf
feat: Add Coach and ScoreBoard classes for performance tracking and d…
09ea0d6 
…ifficulty adjustment
@andreaskoepf
refactor: Move difficulty parameters to nested metadata dictionary
831de40
@andreaskoepf
feat: Add aggregate method to ScoreBoard for grouping scores by diffi…
84d56f2 
…culty parameters
@andreaskoepf
refactor: Optimize aggregate method to avoid list slicing and improve…
1600408 
… memory efficiency
@andreaskoepf
test: Add comprehensive unit test for Coach with ChainSum dataset
20f3bdf
@andreaskoepf
feat: Add GroupedScores class to wrap aggregated scores with total count
8f44263
@andreaskoepf
refactor: Move GroupedScores class below import statement
edef83a
@andreaskoepf
feat: Add stats() method to GroupedScores with mean, std, min, max …
710b179 
…calculation
@andreaskoepf
fix: Add missing imports for GroupedScores, OrderedDict, and math
ffac365
@andreaskoepf
fix: Resolve GroupedScores length check and empty case handling
d50464a
@andreaskoepf
fix: Correct iteration over GroupedScores in test_coach_with_chain_sum
8ef7a14
@andreaskoepf
lint
5b460f7
@andreaskoepf
feat: Add optional JSONL score logging to Coach with configurable log…
f79ef07 
… file path
@andreaskoepf
feat: Log full dataset entry instead of only metadata in Coach class
ebf3cea
@andreaskoepf
feat: Add __str__() method to GroupedScores for detailed score reporting
ac5123c
@andreaskoepf
refactor: Create ScoreStats class with tuple-based score statistics
896002d
@andreaskoepf
refactor: Remove total_scores from ScoreStats class and related code
39f5ff7
@andreaskoepf
feat: Add formatted score list display with last 100 values in Groupe…
7eec996 
…dScores.__str__
@andreaskoepf
style: Compact ScoreStats __str__ output with unicode mean and std
429c294
@andreaskoepf
test: Add print statement for debugging in test_coach_with_chain_sum
8498304
@andreaskoepf
test: Update test assertions for ScoreStats string representation
ee99f24
@andreaskoepf
style: Compact ScoreStats __str__ output with inline parameters
d5d4165
@andreaskoepf
refactor: Remove unnecessary empty lines in string representations
e7b4a1a
@andreaskoepf
feat: Add count to ScoreStats tuple for tracking number of elements
96a7d26
@andreaskoepf
fix: Correct type checking for stats values in coaching test
f461f0c
@andreaskoepf
fix: Correct stats calculation for empty groups in test_coach_with_ch…
b3befd4 
…ain_sum
@andreaskoepf
refactor: Compact GroupedScores __str__ with single-line stats display
bf4c046
@andreaskoepf
test: Add print statements for debugging in test_coach_with_chain_sum
1ac61b0
@andreaskoepf
test: Update test assertions to match new string format
cd96811
@andreaskoepf
refactor: Remove automatic difficulty update in score_answer method
b939997
@github-actions GitHub Actions
Copy link

github-actions bot commented Feb 6, 2025

❌ Pre-commit checks failed. Please run pre-commit run --all-files locally and fix the issues.

@open-thought open-thought deleted a comment from github-actions bot Feb 6, 2025
@open-thought open-thought deleted a comment from github-actions bot Feb 6, 2025
@andreaskoepf andreaskoepf linked an issue Feb 6, 2025 that may be closed by this pull request
Auto-Curriculum: Adaptively adjusting the complexity of tasks #17
Open
@andreaskoepf andreaskoepf marked this pull request as ready for review February 6, 2025 22:13
@andreaskoepf andreaskoepf merged commit 3f6b2fc into main Feb 6, 2025
3 checks passed
@andreaskoepf andreaskoepf deleted the accuracy_tracking branch February 6, 2025 22:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Auto-Curriculum: Adaptively adjusting the complexity of tasks
1 participant
@andreaskoepf