Skip to content

Commit

Permalink
Browse files Browse the repository at this point in the history
  • Loading branch information
whylabs committed Dec 8, 2023
1 parent ea9dd9b commit 04c0949
Show file tree
Hide file tree
Showing 10 changed files with 334 additions and 14 deletions.
Binary file modified .doctrees/environment.pickle
Binary file not shown.
Binary file modified .doctrees/whylogs_container.whylabs.llm_validation.doctree
Binary file not shown.
8 changes: 8 additions & 0 deletions _sources/whylogs_container.whylabs.llm_validation.rst.txt
Original file line number Diff line number Diff line change
Expand Up @@ -68,6 +68,14 @@ whylogs\_container.whylabs.llm\_validation.validation\_workflow module
:undoc-members:
:show-inheritance:

whylogs\_container.whylabs.llm\_validation.validator module
-----------------------------------------------------------

.. automodule:: whylogs_container.whylabs.llm_validation.validator
:members:
:undoc-members:
:show-inheritance:

whylogs\_container.whylabs.llm\_validation.validators module
------------------------------------------------------------

Expand Down
99 changes: 88 additions & 11 deletions genindex.html

Large diffs are not rendered by default.

Binary file modified objects.inv
Binary file not shown.
6 changes: 6 additions & 0 deletions py-modindex.html
Original file line number Diff line number Diff line change
Expand Up @@ -347,6 +347,12 @@ <h1>Python Module Index</h1>
<a href="whylogs_container.whylabs.llm_validation.html#module-whylogs_container.whylabs.llm_validation.validation_workflow"><code class="xref">whylogs_container.whylabs.llm_validation.validation_workflow</code></a></td><td>
<em></em></td>
</tr>
<tr class="cg-1">
<td></td>
<td>&#160;&#160;&#160;
<a href="whylogs_container.whylabs.llm_validation.html#module-whylogs_container.whylabs.llm_validation.validator"><code class="xref">whylogs_container.whylabs.llm_validation.validator</code></a></td><td>
<em></em></td>
</tr>
<tr class="cg-1">
<td></td>
<td>&#160;&#160;&#160;
Expand Down
2 changes: 1 addition & 1 deletion searchindex.js

Large diffs are not rendered by default.

1 change: 1 addition & 0 deletions whylogs_container.html
Original file line number Diff line number Diff line change
Expand Up @@ -237,6 +237,7 @@ <h2>Subpackages<a class="headerlink" href="#subpackages" title="Permalink to thi
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#module-whylogs_container.whylabs.llm_validation.validate">whylogs_container.whylabs.llm_validation.validate module</a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#module-whylogs_container.whylabs.llm_validation.validation_utils">whylogs_container.whylabs.llm_validation.validation_utils module</a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#module-whylogs_container.whylabs.llm_validation.validation_workflow">whylogs_container.whylabs.llm_validation.validation_workflow module</a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#module-whylogs_container.whylabs.llm_validation.validator">whylogs_container.whylabs.llm_validation.validator module</a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#module-whylogs_container.whylabs.llm_validation.validators">whylogs_container.whylabs.llm_validation.validators module</a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#module-whylogs_container.whylabs.llm_validation">Module contents</a></li>
</ul>
Expand Down
39 changes: 39 additions & 0 deletions whylogs_container.whylabs.html
Original file line number Diff line number Diff line change
Expand Up @@ -470,10 +470,49 @@ <h2>Subpackages<a class="headerlink" href="#subpackages" title="Permalink to thi
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#module-whylogs_container.whylabs.llm_validation.validation_workflow">whylogs_container.whylabs.llm_validation.validation_workflow module</a><ul>
<li class="toctree-l3"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validation_workflow.RequestMetadata"><code class="docutils literal notranslate"><span class="pre">RequestMetadata</span></code></a><ul>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validation_workflow.RequestMetadata.headers"><code class="docutils literal notranslate"><span class="pre">RequestMetadata.headers</span></code></a></li>
</ul>
</li>
<li class="toctree-l3"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validation_workflow.make_openai_request"><code class="docutils literal notranslate"><span class="pre">make_openai_request()</span></code></a></li>
<li class="toctree-l3"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validation_workflow.validation_workflow"><code class="docutils literal notranslate"><span class="pre">validation_workflow()</span></code></a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#module-whylogs_container.whylabs.llm_validation.validator">whylogs_container.whylabs.llm_validation.validator module</a><ul>
<li class="toctree-l3"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.PromptValidationMessage"><code class="docutils literal notranslate"><span class="pre">PromptValidationMessage</span></code></a><ul>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.PromptValidationMessage.id"><code class="docutils literal notranslate"><span class="pre">PromptValidationMessage.id</span></code></a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.PromptValidationMessage.openai_message"><code class="docutils literal notranslate"><span class="pre">PromptValidationMessage.openai_message</span></code></a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.PromptValidationMessage.request_metadata"><code class="docutils literal notranslate"><span class="pre">PromptValidationMessage.request_metadata</span></code></a></li>
</ul>
</li>
<li class="toctree-l3"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.ResponseValidationMessage"><code class="docutils literal notranslate"><span class="pre">ResponseValidationMessage</span></code></a><ul>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.ResponseValidationMessage.id"><code class="docutils literal notranslate"><span class="pre">ResponseValidationMessage.id</span></code></a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.ResponseValidationMessage.openai_message"><code class="docutils literal notranslate"><span class="pre">ResponseValidationMessage.openai_message</span></code></a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.ResponseValidationMessage.response"><code class="docutils literal notranslate"><span class="pre">ResponseValidationMessage.response</span></code></a></li>
</ul>
</li>
<li class="toctree-l3"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.SynchronousValidator"><code class="docutils literal notranslate"><span class="pre">SynchronousValidator</span></code></a><ul>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.SynchronousValidator.close_validator"><code class="docutils literal notranslate"><span class="pre">SynchronousValidator.close_validator()</span></code></a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.SynchronousValidator.start_validator"><code class="docutils literal notranslate"><span class="pre">SynchronousValidator.start_validator()</span></code></a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.SynchronousValidator.validate_prompt"><code class="docutils literal notranslate"><span class="pre">SynchronousValidator.validate_prompt()</span></code></a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.SynchronousValidator.validate_response"><code class="docutils literal notranslate"><span class="pre">SynchronousValidator.validate_response()</span></code></a></li>
</ul>
</li>
<li class="toctree-l3"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.ValidationActor"><code class="docutils literal notranslate"><span class="pre">ValidationActor</span></code></a><ul>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.ValidationActor.close"><code class="docutils literal notranslate"><span class="pre">ValidationActor.close()</span></code></a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.ValidationActor.close_validator"><code class="docutils literal notranslate"><span class="pre">ValidationActor.close_validator()</span></code></a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.ValidationActor.process_batch"><code class="docutils literal notranslate"><span class="pre">ValidationActor.process_batch()</span></code></a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.ValidationActor.process_close_message"><code class="docutils literal notranslate"><span class="pre">ValidationActor.process_close_message()</span></code></a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.ValidationActor.process_prompt_validation_message"><code class="docutils literal notranslate"><span class="pre">ValidationActor.process_prompt_validation_message()</span></code></a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.ValidationActor.process_response_validation_message"><code class="docutils literal notranslate"><span class="pre">ValidationActor.process_response_validation_message()</span></code></a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.ValidationActor.run"><code class="docutils literal notranslate"><span class="pre">ValidationActor.run()</span></code></a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.ValidationActor.start"><code class="docutils literal notranslate"><span class="pre">ValidationActor.start()</span></code></a></li>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.ValidationActor.start_validator"><code class="docutils literal notranslate"><span class="pre">ValidationActor.start_validator()</span></code></a></li>
</ul>
</li>
<li class="toctree-l3"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validator.create_validator"><code class="docutils literal notranslate"><span class="pre">create_validator()</span></code></a></li>
</ul>
</li>
<li class="toctree-l2"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#module-whylogs_container.whylabs.llm_validation.validators">whylogs_container.whylabs.llm_validation.validators module</a><ul>
<li class="toctree-l3"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validators.BaseThresholdValidatorBuilder"><code class="docutils literal notranslate"><span class="pre">BaseThresholdValidatorBuilder</span></code></a><ul>
<li class="toctree-l4"><a class="reference internal" href="whylogs_container.whylabs.llm_validation.html#whylogs_container.whylabs.llm_validation.validators.BaseThresholdValidatorBuilder.build_validator"><code class="docutils literal notranslate"><span class="pre">BaseThresholdValidatorBuilder.build_validator()</span></code></a></li>
Expand Down
Loading

0 comments on commit 04c0949

Please sign in to comment.