Product snapshot

LiteLLM

Users are reporting multiple bugs affecting various LLM provider integrations (Bedrock, Vertex AI, Azure, Modal, Predibase, Together AI) including streaming inconsistencies, crashes, and incorrect parameter handling. Additionally, users want improved observability through built-in latency profiling and want to address security vulnerabilities in dependencies. These issues collectively affect the reliability and accuracy of the proxy when serving requests across different cloud providers and model types.