Ability to prompt for json output ?

[snimavat]

The base seems to be there, would be great, if there was flexibility to provide/extend prompt and expect back a json response.
I would like to send a pdf which has structure, and want gpt to convert it to specific json format... it does it very well,
so instead of coding it myself, i would rather prefer to use/extend zerox if there was flexibility of output format and ability to costomize prompt

[pradhyumna85]

@snimavat The python api has option to override the system prompt Refer the readme.

But still there are some postprocessing/cleanups which zerox does on the output from the vision model.

So I would say in your custom system prompt, say to output your required JSON but still encapsulate it in ```json markdown block (so that it doesn't result in some unexpected behaviour) which you can trim out later on your own and convert the json text to say python dict using json.loads function,

@tylermaran, this issue can be closed.

[snimavat]

@pradhyumna85 thanks for response, but i think the issue should not be closed.

Not keeping zerox tied to markdown only will increase the utility of this helpful project and can increase usage.

There's no reason, why zerox should remain tied to markdown.... its could be a little ocr framework tht makes it easy to get ocr done through LLM and get the output in format of user's choice. it can support markdown/json out of the box, but can expose the raw output text too tht user can post process to as he desires

Zerox as general purpose llm based ocr library will be more attractive thn zerox as ocr markdown library

[pradhyumna85]

@snimavat make sense. Adding a flag to the zerox api to skip markdown based post-processing (formatmarkdown function) could be done incase user is interested in raw output in conjunction with custom system prompt. I can raise a PR for this.
@tylermaran, @annapo23 any thoughts on how to proceed?

Edit:
@tylermaran, @annapo23, I have raised PR #40 for your review.