Upstash · Method
client.batch
QStash can call LLM APIs with retries, callbacks, queues, and batching. Send a valid chat completion request to the llm destination and provide a callback URL for the asynchronous response.
Last updated
Syntax
client.publishJSON({ api: { name: "llm", provider }, body: chatCompletionRequest, callback: callbackUrl })In-depth API docs are only for subscribers: parameters, examples, common mistakes and interview practice.
SubscribeRelated
CallbacksQueuesBatchingRetriesOpenAI-compatible LLM providersHelicone