feature: BentoML Client as a separate package

[judahrand]

Feature request

BentoML Client should exist as a separate Python package.

Motivation

It is a pretty hard no-go for my team to install the whole of bentoml into the Python environment which will be the client to our BentoML services. This is due to the huge number of unneeded dependencies including Starlette and Open Telemetry. It seems to me that this section of BentoML should really be a separate package?

Other

No response

[aarnphm]

not currently on our high-priority list, but we will consider this as we have some plans for batch inference.

[judahrand]

not currently on our high-priority list, but we will consider this as we have some plans for batch inference.

This might actually end up being a blocking problem for us 😢