abort isn't fully aborting?

[Madd0g]

I'm using ollama from 2 clients but having this problem only with BMO.

If I abort the stream with /s the UI says "Stream Aborted" but the next message can sometimes take a very long time, I'm getting the feeling that the server is still generating even when the client has aborted.

This is a new problem which appeared in a recent version, it used to work.

Thanks!

[twalderman]

I have experienced this as well. Tyoically have to wait for ollama to finish streaming in the background or switch models to stop the background activity. Stop generating is not working. I have tried adding "/s" to the PARAMETER STOP commands but I cant say if that worked in cases because I havent thoroughly tested it. If you want to give that I shot, let me know.

[longy2k]

v2.2.0

I was using the Ollama-js API which does not support AbortController.

All the API connections are now using fetch besides the REST API Connection (non-stream) and all Anthropic models.

As long as no CORS restrictions are applied, Ollama and any other API connections will actually abort the server.

Let me know if I missed anything, thanks!