Product snapshot

llama.cpp

Users are experiencing multiple crashes and stability issues with the Vulkan backend, particularly when running Gemma 4 models, multimodal vision pipelines, and handling large prompts. These issues include assertion failures, invalid pointer crashes, memory leaks, and incorrect memory estimation that prevent reliable inference. Additionally, users need better documentation for multimodal model configuration and expanded audio modality support.