Only using the server side

[markNZed]

I'm refactoring some code and wanted to replace a node package with Vercel ai. It was a little painful to see how to "hack" this in. Basically it is reading from the stream on the server and calling existing routines for sending over a websocket from the callbacks the OpenAIStream stream provides:

    response = new Promise((resolve, reject) => {
          let partialText = "";
          const stream = OpenAIStream(response, {
            onStart: async () => {},
            onToken: async (token) => {
              partialText += token;
              const partialResponse = { delta: token, text: partialText };
              SendIncrementalWs(wsSendTask, partialResponse, instanceId);
            },
            onCompletion: async (completion) => {
              if (useCache) {
                cacheStore_async.set(computedCacheKey, completion);
              }
              resolve(completion);
            }
          })
          const reader = stream.getReader();
          function read() {
            reader.read().then(({ done, value }) => {
              if (done) { return }
              read();
            });
          }
          read();
      });

Perhaps this is useful for someone and perhaps there could be a small addition to the docs or an example for replacing just the backend. I guess others will want to refactor code that is using other libraries. I expect to refactor further to use Vercel ai on the frontend but it needs to be done step by step.