Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

docs: revamp streaming how-to guides #3239

Merged
merged 18 commits into from
Jan 31, 2025
Merged

docs: revamp streaming how-to guides #3239

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
be3f4b5
docs: revamp streaming how-to guides
vbarda Jan 28, 2025
5c599c9
update streaming tokens
vbarda Jan 29, 2025
968d6c3
update
vbarda Jan 29, 2025
ababe1a
move
vbarda Jan 29, 2025
c265e99
update subgraphs
vbarda Jan 29, 2025
d2bac47
Merge branch 'main' into vb/update-streaming-howtos
vbarda Jan 30, 2025
5acb64c
streaming from nodes
vbarda Jan 30, 2025
55c9498
redirect
vbarda Jan 30, 2025
84fb8ad
update streaming from tools
vbarda Jan 30, 2025
f02b0cc
Merge branch 'main' into vb/update-streaming-howtos
vbarda Jan 30, 2025
d824576
cr
vbarda Jan 30, 2025
8f68904
Merge branch 'main' into vb/update-streaming-howtos
vbarda Jan 30, 2025
b2928a1
update
vbarda Jan 30, 2025
91f74b2
nit
vbarda Jan 30, 2025
a668637
update venv
vbarda Jan 30, 2025
93af876
cr
vbarda Jan 31, 2025
3a9e88a
cr
vbarda Jan 31, 2025
40a5175
Merge branch 'vb/update-streaming-howtos' of github.com:langchain-ai/…
vbarda Jan 31, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions docs/_scripts/notebook_convert.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
import os

Check notice on line 1 in docs/_scripts/notebook_convert.py

View workflow job for this annotation

GitHub Actions / benchmark

Benchmark results 

.........................................
fanout_to_subgraph_10x: Mean +- std dev: 65.7 ms +- 1.5 ms
.........................................
fanout_to_subgraph_10x_sync: Mean +- std dev: 58.6 ms +- 1.9 ms
.........................................
fanout_to_subgraph_10x_checkpoint: Mean +- std dev: 89.5 ms +- 2.3 ms
.........................................
fanout_to_subgraph_10x_checkpoint_sync: Mean +- std dev: 109 ms +- 4 ms
.........................................
fanout_to_subgraph_100x: Mean +- std dev: 852 ms +- 23 ms
.........................................
fanout_to_subgraph_100x_sync: Mean +- std dev: 615 ms +- 30 ms
.........................................
fanout_to_subgraph_100x_checkpoint: Mean +- std dev: 1.14 sec +- 0.06 sec
.........................................
fanout_to_subgraph_100x_checkpoint_sync: Mean +- std dev: 1.14 sec +- 0.03 sec
.........................................
react_agent_10x: Mean +- std dev: 33.6 ms +- 1.0 ms
.........................................
react_agent_10x_sync: Mean +- std dev: 25.3 ms +- 0.5 ms
.........................................
react_agent_10x_checkpoint: Mean +- std dev: 44.4 ms +- 1.6 ms
.........................................
react_agent_10x_checkpoint_sync: Mean +- std dev: 43.5 ms +- 1.6 ms
.........................................
react_agent_100x: Mean +- std dev: 394 ms +- 15 ms
.........................................
react_agent_100x_sync: Mean +- std dev: 323 ms +- 12 ms
.........................................
react_agent_100x_checkpoint: Mean +- std dev: 812 ms +- 24 ms
.........................................
react_agent_100x_checkpoint_sync: Mean +- std dev: 740 ms +- 35 ms
.........................................
wide_state_25x300: Mean +- std dev: 24.7 ms +- 0.6 ms
.........................................
wide_state_25x300_sync: Mean +- std dev: 16.4 ms +- 0.2 ms
.........................................
wide_state_25x300_checkpoint: Mean +- std dev: 247 ms +- 3 ms
.........................................
wide_state_25x300_checkpoint_sync: Mean +- std dev: 240 ms +- 3 ms
.........................................
wide_state_15x600: Mean +- std dev: 28.6 ms +- 0.5 ms
.........................................
wide_state_15x600_sync: Mean +- std dev: 18.9 ms +- 0.2 ms
.........................................
wide_state_15x600_checkpoint: Mean +- std dev: 429 ms +- 4 ms
.........................................
wide_state_15x600_checkpoint_sync: Mean +- std dev: 419 ms +- 3 ms
.........................................
wide_state_9x1200: Mean +- std dev: 28.4 ms +- 0.7 ms
.........................................
wide_state_9x1200_sync: Mean +- std dev: 18.7 ms +- 0.2 ms
.........................................
wide_state_9x1200_checkpoint: Mean +- std dev: 277 ms +- 9 ms
.........................................
wide_state_9x1200_checkpoint_sync: Mean +- std dev: 268 ms +- 3 ms

Check notice on line 1 in docs/_scripts/notebook_convert.py

View workflow job for this annotation

GitHub Actions / benchmark

Comparison against main 

+-----------------------------------------+---------+------------------------+
| Benchmark                               | main    | changes                |
+=========================================+=========+========================+
| wide_state_15x600_checkpoint_sync       | 417 ms  | 419 ms: 1.00x slower   |
+-----------------------------------------+---------+------------------------+
| wide_state_25x300_checkpoint_sync       | 237 ms  | 240 ms: 1.01x slower   |
+-----------------------------------------+---------+------------------------+
| wide_state_9x1200_checkpoint            | 273 ms  | 277 ms: 1.01x slower   |
+-----------------------------------------+---------+------------------------+
| wide_state_9x1200_sync                  | 18.5 ms | 18.7 ms: 1.01x slower  |
+-----------------------------------------+---------+------------------------+
| wide_state_15x600_checkpoint            | 423 ms  | 429 ms: 1.01x slower   |
+-----------------------------------------+---------+------------------------+
| wide_state_25x300_checkpoint            | 243 ms  | 247 ms: 1.02x slower   |
+-----------------------------------------+---------+------------------------+
| wide_state_9x1200                       | 27.8 ms | 28.4 ms: 1.02x slower  |
+-----------------------------------------+---------+------------------------+
| wide_state_15x600_sync                  | 18.5 ms | 18.9 ms: 1.02x slower  |
+-----------------------------------------+---------+------------------------+
| wide_state_25x300_sync                  | 16.0 ms | 16.4 ms: 1.03x slower  |
+-----------------------------------------+---------+------------------------+
| wide_state_15x600                       | 27.8 ms | 28.6 ms: 1.03x slower  |
+-----------------------------------------+---------+------------------------+
| fanout_to_subgraph_10x                  | 63.9 ms | 65.7 ms: 1.03x slower  |
+-----------------------------------------+---------+------------------------+
| wide_state_25x300                       | 23.7 ms | 24.7 ms: 1.04x slower  |
+-----------------------------------------+---------+------------------------+
| fanout_to_subgraph_10x_sync             | 55.5 ms | 58.6 ms: 1.05x slower  |
+-----------------------------------------+---------+------------------------+
| react_agent_10x_sync                    | 23.2 ms | 25.3 ms: 1.09x slower  |
+-----------------------------------------+---------+------------------------+
| react_agent_10x                         | 30.6 ms | 33.6 ms: 1.10x slower  |
+-----------------------------------------+---------+------------------------+
| fanout_to_subgraph_10x_checkpoint_sync  | 98.7 ms | 109 ms: 1.10x slower   |
+-----------------------------------------+---------+------------------------+
| fanout_to_subgraph_10x_checkpoint       | 80.5 ms | 89.5 ms: 1.11x slower  |
+-----------------------------------------+---------+------------------------+
| fanout_to_subgraph_100x_sync            | 550 ms  | 615 ms: 1.12x slower   |
+-----------------------------------------+---------+------------------------+
| react_agent_10x_checkpoint              | 39.3 ms | 44.4 ms: 1.13x slower  |
+-----------------------------------------+---------+------------------------+
| fanout_to_subgraph_100x_checkpoint_sync | 1000 ms | 1.14 sec: 1.14x slower |
+-----------------------------------------+---------+------------------------+
| react_agent_100x                        | 342 ms  | 394 ms: 1.15x slower   |
+-----------------------------------------+---------+------------------------+
| react_agent_100x_sync                   | 273 ms  | 323 ms: 1.18x slower   |
+-----------------------------------------+---------+------------------------+
| react_agent_10x_checkpoint_sync         | 36.5 ms | 43.5 ms: 1.19x slower  |
+-----------------------------------------+---------+------------------------+
| react_agent_100x_checkpoint_sync        | 618 ms  | 740 ms: 1.20x slower   |
+-----------------------------------------+---------+------------------------+
| react_agent_100x_checkpoint             | 645 ms  | 812 ms: 1.26x
import re
from pathlib import Path

Expand All @@ -22,6 +22,8 @@
)

elif cell.cell_type == "code":
# Remove noqa comments
cell.source = re.sub(r'#\s*noqa.*$', '', cell.source, flags=re.MULTILINE)
# escape ``` in code
cell.source = cell.source.replace("```", r"\`\`\`")
# escape ``` in output
Expand Down
1 change: 0 additions & 1 deletion docs/cassettes/stream-multiple_e9e9ffb0-2cd5-466f-b70b-b6ed51b852d1.msgpack.zlib
View file
Open in desktop

This file was deleted.

1 change: 0 additions & 1 deletion docs/cassettes/stream-updates_e9e9ffb0-2cd5-466f-b70b-b6ed51b852d1.msgpack.zlib
View file
Open in desktop

This file was deleted.

1 change: 0 additions & 1 deletion docs/cassettes/stream-values_c122bf15-a489-47bf-b482-a744a54e2cc4.msgpack.zlib
View file
Open in desktop

This file was deleted.

1 change: 0 additions & 1 deletion docs/cassettes/stream-values_e9e9ffb0-2cd5-466f-b70b-b6ed51b852d1.msgpack.zlib
View file
Open in desktop

This file was deleted.

1 change: 0 additions & 1 deletion ...nts-from-within-tools-without-langchain_45c96a79-4147-42e3-89fd-d942b2b49f6c.msgpack.zlib
View file
Open in desktop

This file was deleted.

1 change: 1 addition & 0 deletions ...ttes/streaming-events-from-within-tools_2c30c7b4-62df-4855-8219-d5e1a1a09be9.msgpack.zlib
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
eNrtnU9v3MYVwGv05kOPPbOLAGkNccX9L62gw1qSLVmWZXslR0piLGbJx+V4SQ49HK60Mnyo23vBol+gsSM1guMkcNAmadNbgR76BexDvkG/Qx9Xq0iCA80iK6kG8nSQVktyyPnNmzdv3rx5fLLXAxlzEV56zkMFktkK/4nTJ3sSHiYQq9/vBqA84Ty7vdpce5pI/uqKp1QU1ycnWcTzIoKQ8bwtgsleYdL2mJrEz5EPg2KetYXTf33pF49yAcQx60CcqxsfPMpJ4QN+yiUxyNyEkbMF3jtU2VdzLDT6IjEU+L4RgLGFRRpdHjqGcA2uIIgNbgS84ynDzb7loaE8MFzh+2KLhx0j8pkNdePdNjhSiODdvHGTx8rAUnxg+KFkxIntDYuKIWKSqew6LCUw2n2DGViBgOWNxqB0208cwC/bkoNrOBDbkkdZ5bLnATYsKZ97fB/rEQgH/KwWnUiZZWEGPORZ/WIlgQV4QMkEHu95wByk/odnnohV+uIkx8+YbQNeDqEtHHyw9NPODo8m8NauzxTsI6sQBq2U7ncBIpP5vAe7B1eln7Mo8rnNsuOTD2IRPh+yNVU/gjcP72dNYGLLhCr9uhH3Q3sVn6SxNHm7j60eGoV8pZwvfb5txorx0MdWNH2GD7UbDY7//fiBiNldLMkcSlS6e3Dxi+PniDj9eIXZq80TRTJpe+nHTAbV8svj38skVDyAdG/u9pu3Gx48ul0pXyjkp784UXBWo/TTwZ/64DcXfztRCCjZN22BZaV/tl4cwvIh7CgvfVqsWX+REEcoy/C7XbxMJfGTZ9gw8J9/7w1l+qPV5cMW/e5nv3w2j42UfrvmJRNGyTJuoDgXrWLFKEzVK1bdsozrK2vP54a3Wcva5BXK+raahF72zYGkzBjYk2QMajZRrjn1xZpkYexiQy0cCsWe7SVhF5z9uR8Uh28zccDqZfXBzmbCdiRiMIePmT7fMO8edG9zaf7lgeyZQnZYyHcGspF+krUyPgQPvxwejqTIisSbm0GcPp2yrBfDI4cNsI8VtcyCZVqFb7ZN7Fbg84AjzMHvoT7B9i9Z+PPVm2co0QVUPZ8UKtbBzz+PnyMhwKfJbn9UUnEaf/7xw2d9X1o5O2m6VPvm5HlI96ikp8Ug/urN48MyPrLi59uHJ5vcSV+9g/+0gFn2tAsFlxWhWrGdsmW7UxYwZtUK03a19jU2JrexlKz1IiGxdcFGDar66auJgG1n3W62VKiUqljXmUNd00za8yKrRDxjRBJ8wZzPbNe0UdWAeSCB6d785q3GytLcfhMfck6ILoc/vr7081bLdlvtYHZttXFnaWO5y27aJZevb7WW8+sbd/qbc+5WaaW0+F5oNRbuRe31yOuahVppqljNmsQs5K18IV8wweq9X72zsHh1feX20sY1pZbCUsIKttVbDK6WCg+u32t0nZ5bndsJa1Vxrb+6FXduvn9vsSmChirI9WWxcHdnZVMK5t29PrW5HFar3lYDa8OUNzs5Y6AwcuQ7O+wjJvYRM+sh0/XiYQ+ZMZwBg9n8SeU4Yyzi4LMa+v0Zo5nBBPzLAmiiEp69JUJ49SdkkPS4M+vOte4E6xs3Fkq3mgXnejPpNb319fV2ZVmVWwv3FjaDKSj2ytu3y9YxCOVyxbSGHKpWeWogh0eP/iOf6q8b5vEub65GB6PsXijikLvubhMk9qJ03/ZF4qCel7A7d82829hMv5y2WIlVikW7Xa1VWcUyF967u8d8FKaenb70SrO5erlcys0YAZudqpYtazDo/nY3E76w8/pf/3WYYnXjUY47uXouG6FtHJ/NRm9N9XhYY+vTfH4nqT501uza9g1wvLUIx+ScaD9AtTK8In80pucHigdPsFFRKcAyD+BlXXHicAA8Pv6ZqBXKplUzC1N4FY42PW5DS3Ec+es5HNRY4qvsQD/GcbSFY3oHZISPnt3bjVq1Ijg11q6U7eyensCL0YhAGwIHf9jO1a0JLMRXLFc/NCtyDLUUdpQwK/Z7yyKH/0hwk5jh84WJ7z+eyPmig1qtHR98MZHDm/PYa2HFcGQcnnX/8eXLPx2CR7iaKMU5YnQqo18RoNMBGYtAUqSFxIiRlpHyJBAlHaVs5ooUCNPpmAZzf6KkodQXCTHSMBo4ooiShlLmqCNIOqVEeltrKBEhDaGh05s4nc6p/mH4IXU3DaQCATodUJ4AadTRlSuE6HREV4EsIw0iEiLtcEaANIpozeM04dfOQAiR1g3Zj7jNfL9PpLQOW3LXav0iAmWJKGkoRSIrgSidTkm4hIhUEjmQLobTBAHSLkWGWRQOlkaoSHWT5//cVyKZUhJimsLpQMVJlMXikt9NbwvQLJf00hkYlMRI5weQLKCpCa22jSlGS+QlGSFAEshEolCksRH1mOQiIVHSWtt8hzqcltKvidDphLIt28RINxmhjqZdAtiisY182+NK0cMEgMSIxGhcv78kRBpEXVo/0kL6DQHSGUa0/UjLKIkTimsbyTcyyNJCpvYIjn+HtLeek8+75PvXupE8AEV9jkzucWNJeZYmkASJBIlMyvO3AHwWdkltj7IPgDwBI6zcIiZa4dZxchJJVvcIBqUPEBElTcgNpUnQQyoSIArcojQJ54voFuXZGiFIQtGshLJJUDaJc9fXDSKkM68D5tPOdm00Emv75PunMInxnSOszUMgA0nr/s/eDUQmkn7pNuYOKSbKJ0Hb/2ix7a1IkKAo3naECC7qa3qdLQiRBpEnfJIj2vg/dlwbC2iBjYb+cfuZzyRlI9PO/31hd4kSdTbytJ23BwkkUqCsrfSOLQr+vzAfkhBdEiVS3mMj6vgsjmnrFgVsjStIFI40ajgSdTatRSlFj1bbRkoo3YOQA70LQB99o4RkHRIp2sR1FumSpctsMppoE9cZMAozu0lxSnarJQU4UQkVZz51PNqkND6kEgGiOS9tUjpfRPME6HRA2ftJgKwk2qFEO5Roh9L/PRMQ2DQNoVeTjT/vT2TIVSJJmHSktriiJO7a97hhqTyibYH6RDeSbYEk9whtCyDn7YWtKlFqqZGCcZVHCyYUjjv28qSN58XY6UiYSJhorfsCZruot8kOoBB4CoGnhbe3R4zm6bXuekrkCRglSxDFSYzwXld6Bw69H/hM3ntLkGhOcgZetz4tBpAkURali8p+w3rU3Sj7zdgLSj6jfUoj7i0hTjrNTWpbn9eNkk3RGsm4AUoetylCidxIZ5H2lhBRXBLFJV1IICDYQjLFad5GK5KUSYkcAG9JHDeXkgSJVv9/DCA9k1w8mPAeUflgfvXWwv3Ll/8HjuzTXg==
Loading
Loading