From fdb717a3f1787db5e70de2bce56e7867644f97b5 Mon Sep 17 00:00:00 2001 From: Robin Linacre Date: Tue, 10 Dec 2024 12:19:00 +0000 Subject: [PATCH] add knowledgebase --- docs/topic_guides/llms/prompting_llms.md | 11 ++++++++++- 1 file changed, 10 insertions(+), 1 deletion(-) diff --git a/docs/topic_guides/llms/prompting_llms.md b/docs/topic_guides/llms/prompting_llms.md index 200cda0a2..581ee151d 100644 --- a/docs/topic_guides/llms/prompting_llms.md +++ b/docs/topic_guides/llms/prompting_llms.md @@ -114,4 +114,13 @@ These files are generated with the following scripts, which you may wish to modi [Create LLM Prompt Long Script](https://github.com/moj-analytical-services/splink/blob/master/scripts/create_llm_prompt_long.py) -[Create LLM Prompt Short Script](https://github.com/moj-analytical-services/splink/blob/master/scripts/create_llm_prompt_short.py) \ No newline at end of file +[Create LLM Prompt Short Script](https://github.com/moj-analytical-services/splink/blob/master/scripts/create_llm_prompt_short.py) + +### Issues and Discussions + +I have also created a knowledgebase file by scraping all Github issues and discussions from the main Splink repo. + +I've found Gemini Pro 1.5 (2 million context length) is able to process these files effectively. + +[Knowledgebase prompt - 1.6 million tokens](https://gist.github.com/RobinL/f241917bc4246911f12aed2b372d7f43#file-splink_knowledge_base-txt) +[Create knowledgebase script](https://gist.github.com/RobinL/f241917bc4246911f12aed2b372d7f43#file-creation_script-py) \ No newline at end of file