Learn

Memorystore to Redis Cloud

Before migrating to Redis Cloud, you should evaluate the migration and consider the best option. Read this guide to determine which migration strategy is right for you.

Offline data migration#

Create a Google Cloud Storage bucket with proper permissions#

  1. 1.Open Google Cloud Storage bucket.
  2. 2.Create a new bucket to store Memorystore backups.
  3. 3.Under Choose how to control access to objects, uncheck Enforce public access prevention on this bucket
  4. 4.In the Google Cloud Storage bucket, under the Permissions tab, click Grant Access.
  5. 5.In the Grant access menu under Add principals, enter: service@redislabs-prod-clusters.iam.gserviceaccount.com
  6. 6.Under Assign roles, select Cloud Storage ⇒ Storage Object User
  7. 7.Click Save.

Import RDB file from Google Cloud Storage to Redis Cloud#

  1. 1.In the Redis Cloud console, select the target database from the database list.
  2. 2.Click Import.
  3. 3.Enter the details for the RDB file:
  4. 4.Source type - Select Google Cloud Storage.
  5. 5.Source path - Enter the URL for the RDB file: gs://bucketname/[path/]filename.rdb
  6. 6.For sharded databases with multiple RDB files, select Add source to add another RDB file.
  7. 7.Select Import.
  8. 8.Validate your migration and redirect your application’s traffic to the new Redis Cloud endpoint.

Live data migration#

Your Memorystore instance must be accessed from a Compute Engine instance with proper permissions. The following guide assumes that your Memorystore instance is reachable from the internet via a Compute Engine instance.

Enable notify-keyspace-events in Memorystore#

  1. 1.Go to the Memorystore for Redis page in the Google Cloud console. 
  2. 2.Click the Instance ID of your migration source.
  3. 3.Click Edit.
  4. 4.The Configurations section is now visible. Click click Add Configuration to add a new configuration.
  5. 5.In the configuration dropdown, select notify-keyspace-events
  6. 6.For the Value, enter KEA
  7. 7.Click Save.

Create a Compute Engine instance#

  1. 1.Go to the Google Cloud Compute Engine console.
  2. 2.Click Create Instance
  3. 3.For the operating system, Ubuntu is preferred.
  4. 4.Ensure that the Compute Engine instance is created in the same region as your Memorystore instance
  5. 5.Ensure that the Compute Engine instance uses the same Authorized network.
  6. 6.Click Create.

Install redis-tools, Java, and RIOT#

  1. 1.In the Google Cloud Compute Engine console, click SSH to connect to your instance.
  2. 2.Install the redis-cli tool:
sudo apt update && sudo apt install -y redis-tools

3. Verify the connectivity with the Memorystore instance, replace MEMORYSTORE_ENDPOINT with your Memorystore endpoint.

redis-cli -h MEMORYSTORE_ENDPOINT -p 6379

4. Install Java, we recommended using OpenJDK 21 or later:

sudo apt install -y openjdk-21-jdk

5. Install RIOT. Download the desired release. Then, unzip the package and make sure the RIOT binaries are in place, as shown here:

wget https://github.com/redis/riot/releases/download/v4.2.3/riot-4.2.3.tar && tar -xvf riot-4.2.3.tar && cd riot-4.2.3/bin/

6. You can check the version of RIOT by running the command below:

./riot --version
Response
------------------------------------------------------------
riot 4.2.3
------------------------------------------------------------
Build time:   2025-02-16 18:35:57Z
Revision: 	d7a319522e4e72a2b5277e5a15bd715d557dedb6
JVM:      	21.0.6 (Ubuntu 21.0.6+7-Ubuntu-120.04.1)
------------------------------------------------------------

Replicate Memorystore to Redis Cloud#

Once Java and RIOT are installed, you are all set to begin the migration process which replicates data directly from the source (Memory) to the target (Redis Cloud). 

  1. 1.Log into the Redis Cloud console.
  2. 2.Click on your migration target and take note of the public endpoint, username, and password
  3. 3.You can replicate the data from Memorystore to Redis Cloud by running the below command: sudo ./riot replicate redis://MEMORYSTORE_ENDPOINT:port redis://username:password@REDIS_CLOUD_ENDPOINT:port --mode live
  4. 4.If you are migrating from a Memorystore cluster, you must include the --source-cluster option
  5. 5.If you are migrating to a Redis Cloud cluster, you must include the --target-cluster option.
  6. 6.Validate your migration and redirect your application’s traffic to the new Redis Cloud endpoint.

Note:

The live replication mechanism does not guarantee data consistency. Redis sends keyspace notifications over pub/sub which does not provide guaranteed delivery. It is possible that RIOT can miss some notifications in case of network failures for example.

Also, depending on the type, size, and rate of change of data structures on the source it is possible that RIOT cannot keep up with the change stream. For example if a big set is repeatedly updated, RIOT will need to read the whole set on each update and transfer it over to the target database. With a big-enough set, RIOT could fall behind and the internal queue could fill up leading up to updates being dropped.

For those potentially problematic migrations it is recommended to perform some preliminary sizing using Redis statistics and bigkeys/memkeys in tandem with --mem-limit. If you need assistance please contact your Redis account team.

For more information, see: