First time Pinkio user, I can get to the webui just fine, but it just generates 1kb empty files.

[NergiZed]

First time using this, so I don't know how to report the bugs well.

In the terminal, I see this, which is obviously where the operation fails:

Using optimized parameters for high-end GPU Connection error to API at http://127.0.0.1:1234/v1/completions Retrying in 2 seconds... (attempt 2/3) Connection error to API at http://127.0.0.1:1234/v1/completions Retrying in 4 seconds... (attempt 3/3) Connection error to API at http://127.0.0.1:1234/v1/completions Max retries reached. Token generation failed.

Attached is the rest of the log.

logs.zip

Anyhow thanks and I hope my issue can be resolved easily.

[SimPov]

Same issue :(

[Javiondox]

Go to LM Studio, go to the "discover" tab on the left, search for "orpheus-3b-0.1-ft-Q4_K_M-GGUF", select the model on the top, go to the developer tab, and change the status to running and try again.

(If you need a specific language, look the list here: https://github.com/Lex-au/Orpheus-FastAPI and search the model for the language you need, as the first one seems to be for English only)