Discussions

• 1 You must be logged in to vote

  🙏

  How to debug a bentoml app like fastapi flavor?

  decadance-dance asked Mar 28, 2024 in Q&A · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Multiple Services & Bentos in the same project

  danieltudosiu asked Feb 7, 2025 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Question about Python 3.10+ support in BentoML (>=1.3.10) and its dependency simple_di

  oogou11 asked Dec 19, 2024 in Q&A · Answered

  

  

  

  

  4
• 1 You must be logged in to vote

  💡

  Integration with https://github.com/michaelfeil/infinity

  michaelfeil asked Jun 11, 2024 in Ideas · Answered

  

  

  2
• 1 You must be logged in to vote

  #️⃣

  Incorrect Link in Observability Module: Metrics Redirects to Tracing.

  oogou11 asked Nov 5, 2024 in General · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to save model for ONNX and Keras after bentoml 1.4

  cceasy asked Oct 29, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to Dynamically Allocate Resources with Limited GPU Resources?

  oogou11 asked Oct 9, 2024 in Q&A · Answered

  

  

  3
• 3 You must be logged in to vote

  🙏

  Is the gRPC in BentoML stable and actively maintained?

  ryan-3m asked Mar 3, 2023 in Q&A · Answered

  

  

  

  

  10
• 2 You must be logged in to vote

  🙏

  Best practice for multiple service serving

  tguner-arteriaai asked Jun 3, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Unnecessary Error Message Prefix in API Responses

  takhyun12 asked Aug 9, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to assign a separate GPU to each worker?

  Dawnfz-Lenfeng asked Jul 31, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  question: How to use replica in BentoML?

  Dawnfz-Lenfeng asked Jul 29, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is there away in v1.2 to assemble docker image from a local folder (as it was in v0.13), not from a model store?

  Ziange asked Jun 14, 2024 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🙏

  How to setup authentication

  ProVega asked Jun 21, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Get duplicate log from bentoml CLI when override with structlog

  quannguyenleanh asked Jun 27, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to build a service that dynamically loads embedding models?

  kobiche asked Jun 3, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Example for kubeflow in latest version missing

  kobiche asked Jun 3, 2024 in General · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Got stuck with define bytes as api input

  ntvuongg asked Apr 30, 2024 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🙏

  Is is possible to use Llava model with bentoml?

  michelgirault asked May 16, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Is it possible to save_model NVIDIA NeMo?

  Ormared asked May 15, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  bentoml.depends on distributed services on kubernetes

  zsaladin asked Apr 12, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Issue when using bentoml 1.1.11 in the cloud vs using it in local

  xcadenas-veridas asked Apr 15, 2024 in Q&A · Unanswered

  

  

  0
• 3 You must be logged in to vote

  🙏

  Which one do I have to choose between OpenLLM and BentoVLLM?

  zsaladin asked Apr 12, 2024 in Q&A · Unanswered

  

  

  0
• 3 You must be logged in to vote

  🙏

  resources configuration in bentoml.service

  zsaladin asked Apr 12, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to run bentoml service on multiple instances without BentoCloud?

  mihow asked Mar 29, 2024 in Q&A · Unanswered

  

  

  1