Semantic caching with LangCache on Redis Cloud on Docs

Create a LangCache service

Mon, 01 Jan 0001 00:00:00 +0000

Redis LangCache provides vector search capabilities and efficient caching for AI-powered applications. This guide walks you through creating and configuring a LangCache service in Redis Cloud.

Prerequisites

To create a LangCache service, you will need:

Use the LangCache API on Redis Cloud

Mon, 01 Jan 0001 00:00:00 +0000

You can use the LangCache API and SDK from your client app to store and retrieve LLM, RAG, or agent responses.

To access the LangCache API, you need:

LangCache API base URL
LangCache service API key
Cache ID

For LangCache on Redis Cloud, the base URL and cache ID are available in the LangCache service's Configuration page in the Connectivity section.

The LangCache API key is only available immediately after you create the LangCache service. If you lost this value, you will need to replace the service API key to be able to use the LangCache API.

View and edit LangCache service

Mon, 01 Jan 0001 00:00:00 +0000

After you have created your first LangCache service, selecting LangCache from the Redis Cloud Console menu will take you to the LangCache Services page.

This page displays a list of all LangCache services associated with your account.

Select your LangCache service from the list to view the service's details.

Configuration tab

The Configuration tab lets you view the details of your LangCache service. It contains the following sections:

Monitor a LangCache service

Mon, 01 Jan 0001 00:00:00 +0000

You can monitor a LangCache service's performance from the Metrics tab of the service's page.

The Metrics tab provides a series of graphs showing performance data for your LangCache service.

You can switch between hourly, daily, and weekly stats using the Hour, Day, and Week buttons at the top of the page. Each graph also includes minimum, average, maximum, and latest values.