Semantic cache for LLM applications
Store a model's answers and serve them again for prompts that mean the same thing. Built into every KiviDB Cloud database, with OpenAI embeddings or your own vectors.
Store a model's answers and serve them again for prompts that mean the same thing. Built into every KiviDB Cloud database, with OpenAI embeddings or your own vectors.