Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create a CLI #3

Open
joshcarp opened this issue May 8, 2024 · 0 comments
Open

Create a CLI #3

joshcarp opened this issue May 8, 2024 · 0 comments
Labels
good first issue Good for newcomers

Comments

@joshcarp
Copy link
Owner

joshcarp commented May 8, 2024

  • A user-friendly interactive command-line interface, similar to ollama
  • Use cobra or charm.sh

Flags:
To start with it would only need a --prompt flag, then interactive chat style would be a further goal

After the simple --prompt flag, it would be nice to be able to extract information like token loss, perplexity, and any other information that can be extracted

  • --temperature
  • --batch-size controls size of batch size, larger would lead to quicker passes
  • --training-data would specify training data to open
  • --eval-data would specify data to eval against

See https://github.com/joshcarp/grpctl for reference

@joshcarp joshcarp added the good first issue Good for newcomers label May 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

1 participant