Stream tanggapan chat

Setel stream: true kanggo nampa tanggapan kanthi bertahap. Jaga sambungan HTTP tetep mbukak, parse acara SSE lengkap lan tambahi saben delta konten sapisan.

curl --no-buffer --fail-with-body https://api.shareai.now/api/v1/chat/completions \
  -H "Authorization: Bearer $SHAREAI_API_KEY" \
  -H "Content-Type: application/json" \
  --data '{"model":"MODEL_IDENTIFIER","messages":[{"role":"user","content":"Explain server-sent events briefly."}],"stream":true}'

Waca watesan acara#

SSE misahake acara nganggo garis kosong. Potongan jaringan bisa misahake nilai JSON utawa ngemot sawetara acara, mula aja parse saben bacaan jaringan minangka tanggapan JSON lengkap. Decode UTF-8 kanthi bertahap lan simpen data sing ora lengkap nganti acara rampung.

data: {"object":"chat.completion.chunk","choices":[{"index":0,"delta":{"content":"Hello"},"finish_reason":null}]}

data: {"object":"chat.completion.chunk","choices":[{"index":0,"delta":{},"finish_reason":"stop"}]}

data: [DONE]

Render konten sapisan#

Tambahi choices[0].delta.content yen ana. Jaga spasi lan tembung sing diulang. Potongan sing mung peran utawa final bisa uga ora duwe konten. Anggep [DONE] minangka terminator aliran.

Tangani kesalahan aliran#

Priksa status HTTP sadurunge mlebu parser SSE. Sawise streaming diwiwiti, tangani event: error acara lan sambungan sing ora dikarepake. Tandhani jawaban sing kaganggu minangka ora lengkap lan wenehi pangguna kesempatan kanggo nyoba maneh kanthi eksplisit. Aja nambah jawaban independen kaping pindho menyang output parsial.

Batal saka aplikasi sampeyan#

Gunakake mekanisme pembatalan klien HTTP sampeyan nalika pangguna mandhegake generasi. Tansah pembatalan, kegagalan jaringan, lan jawaban sing rampung dadi status UI sing kapisah. Aja janji yen nutup sambungan klien bakal mbatalake panggunaan sing wis diproses.