-
Notifications
You must be signed in to change notification settings - Fork 436
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
Unable to run any models on llama.cpp:cuda in Docker - 500 errors
bugSomething isn't workingSomething isn't workingengine::llamacppllama.cpp backend (LlamaCppServer); GPU/CPU LLM inference (Vulkan, ROCm, Metal)llama.cpp backend (LlamaCppServer); GPU/CPU LLM inference (Vulkan, ROCm, Metal)runtime::cudaNVIDIA CUDA runtimeNVIDIA CUDA runtimeStatus: Open.#2879 In lemonade-sdk/lemonade;llamacpp.rocm_bin: latest serves a stale binary (de69995) despite installer logging an upgrade to the newest build
bugSomething isn't workingSomething isn't workingengine::llamacppllama.cpp backend (LlamaCppServer); GPU/CPU LLM inference (Vulkan, ROCm, Metal)llama.cpp backend (LlamaCppServer); GPU/CPU LLM inference (Vulkan, ROCm, Metal)runtime::rocmAMD ROCm runtimeAMD ROCm runtimeStatus: Open.#2875 In lemonade-sdk/lemonade;Implement toggle for mobile app store redirect.l
enhancementNew feature or requestNew feature or requestStatus: Open.#2872 In lemonade-sdk/lemonade;Installing backend:llamacpp:cuda uses TAR on 7zip requires Windows 11 22H2+ breaking Win10 and older Win11 support
area::installerWindows MSI / macOS DMG / Debian / RPM packagingWindows MSI / macOS DMG / Debian / RPM packagingbugSomething isn't workingSomething isn't workingengine::llamacppllama.cpp backend (LlamaCppServer); GPU/CPU LLM inference (Vulkan, ROCm, Metal)llama.cpp backend (LlamaCppServer); GPU/CPU LLM inference (Vulkan, ROCm, Metal)runtime::cudaNVIDIA CUDA runtimeNVIDIA CUDA runtimeStatus: Open.#2861 In lemonade-sdk/lemonade;Allow pulling a model at a specific Hugging Face revision, so a model can be locked to one commit
area::apiHTTP REST API surface and route handlersHTTP REST API surface and route handlersenhancementNew feature or requestNew feature or requestStatus: Open.#2860 In lemonade-sdk/lemonade;Moving from Quick Rules/ Advanced Rules to Natural Language Router removes the rules without any warning
bugSomething isn't workingSomething isn't workingenhancementNew feature or requestNew feature or requestStatus: Open.#2859 In lemonade-sdk/lemonade;feat: Backends Performance Leaderboard/QA Tracking for performance
enhancementNew feature or requestNew feature or requestStatus: Open.#2858 In lemonade-sdk/lemonade;extract_zip() missing strip-components/wrapper-folder handling — causes silent extraction failures on Windows (e.g. flm:npu)
bugSomething isn't workingSomething isn't workingengine::flmFastFlowLM backend (NPU); multi-modal LLM/ASR/embeddings/rerankingFastFlowLM backend (NPU); multi-modal LLM/ASR/embeddings/rerankingStatus: Open.#2856 In lemonade-sdk/lemonade;Enable Image Upscaling For External Generate/Edit Calls
area::apiHTTP REST API surface and route handlersHTTP REST API surface and route handlersengine::sdstable-diffusion.cpp backend; image generation/edit/variationsstable-diffusion.cpp backend; image generation/edit/variationsenhancementNew feature or requestNew feature or requestStatus: Open.#2836 In lemonade-sdk/lemonade;Streaming chat/completions: backend errors are forwarded without SSE framing, so clients see a silent empty stream
area::apiHTTP REST API surface and route handlersHTTP REST API surface and route handlersbugSomething isn't workingSomething isn't workingStatus: Open.#2826 In lemonade-sdk/lemonade;lm-eval-harness loglikelihood tasks fail on /api/v1/completions — does it return prompt-token logprobs (echo)?
area::apiHTTP REST API surface and route handlersHTTP REST API surface and route handlersenhancementNew feature or requestNew feature or requestStatus: Open.#2822 In lemonade-sdk/lemonade;Can't choose Lemondate - only Github Copilot?
bugSomething isn't workingSomething isn't workingStatus: Open.#2801 In lemonade-sdk/lemonade;