Data transformation

The key functionality that RDI performs is mapping the data coming from Debezium Server (representing a Source Database row data or row state change) into a Redis key with a value of Hash or JSON. There are two types of data transformations in RDI:

  1. By default, each source row is converted into one Hash or one JSON key in Redis. This conversion uses the Debezium schema-based conversion. The incoming data includes the schema and RDI uses a set of handlers to automatically convert each source column to a Redis Hash field or JSON type based on the Debezium type in the schema. See data type conversion for a full reference on these conversions.

  2. If the user wants to add or modify this default mapping, RDI provides declarative data transformations. These transformations are represented in YAML files. Each file contains a job, which is a set of transformations per source table. See declarative transformations for more information.

More info

Back to top ↑