Backend support for LLM live stream output results

Description

  • Backend to support LLM live time streaming the output instead of utilizing typewritter effect


Why?

  • To lessen the perceived slowness of Weave.

  • To make the Run/Stop button in sync with the output

Slack Discussion
https://chasm-talk.slack.com/archives/C05PHU191GX/p1701922842309839

Please authenticate to join the conversation.

Upvoters
Status

Open

Board

πŸ’‘ Request a feature

Date

About 2 years ago

Author

Suzy Lam

Subscribe to post

Get notified by email when there are changes.