Skip to content

Commit

Permalink
Merge pull request #2549 from moj-analytical-services/llm_knowledgebase
Browse files Browse the repository at this point in the history
add knowledgebase
  • Loading branch information
RobinL authored Dec 10, 2024
2 parents d656502 + fdb717a commit 8f26bf6
Showing 1 changed file with 10 additions and 1 deletion.
11 changes: 10 additions & 1 deletion docs/topic_guides/llms/prompting_llms.md
Original file line number Diff line number Diff line change
Expand Up @@ -114,4 +114,13 @@ These files are generated with the following scripts, which you may wish to modi

[Create LLM Prompt Long Script](https://github.com/moj-analytical-services/splink/blob/master/scripts/create_llm_prompt_long.py)

[Create LLM Prompt Short Script](https://github.com/moj-analytical-services/splink/blob/master/scripts/create_llm_prompt_short.py)
[Create LLM Prompt Short Script](https://github.com/moj-analytical-services/splink/blob/master/scripts/create_llm_prompt_short.py)

### Issues and Discussions

I have also created a knowledgebase file by scraping all Github issues and discussions from the main Splink repo.

I've found Gemini Pro 1.5 (2 million context length) is able to process these files effectively.

[Knowledgebase prompt - 1.6 million tokens](https://gist.github.com/RobinL/f241917bc4246911f12aed2b372d7f43#file-splink_knowledge_base-txt)
[Create knowledgebase script](https://gist.github.com/RobinL/f241917bc4246911f12aed2b372d7f43#file-creation_script-py)

0 comments on commit 8f26bf6

Please sign in to comment.