Graphite vs Redis

Choosing the right database is a critical choice when building any software application. All databases have different strengths and weaknesses when it comes to performance, so deciding which database has the most benefits and the most minor downsides for your specific use case and data model is an important decision. Below you will find an overview of the key concepts, architecture, features, use cases, and pricing models of Graphite and Redis so you can quickly see how they compare against each other.

The primary purpose of this article is to compare how Graphite and Redis perform for workloads involving time series data, not for all possible use cases. Time series data typically presents a unique challenge in terms of database performance. This is due to the high volume of data being written and the query patterns to access that data. This article doesn’t intend to make the case for which database is better; it simply provides an overview of each database so you can make an informed decision.

Graphite Overview

Graphite is an open-source monitoring and graphing tool created in 2006 by Orbitz and open sourced in 2008. Graphite is designed for storing time series data and is widely used for collecting, storing, and visualizing metrics from various sources, such as application performance, system monitoring, and business analytics.

Redis Overview

Redis, which stands for Remote Dictionary Server, is an open-source, in-memory data structure store that can be used as a database, cache, and message broker. It was created by Salvatore Sanfilippo in 2009 and has since gained significant popularity due to its high performance and flexibility. Redis supports various data structures, such as strings, hashes, lists, sets, sorted sets with range queries, bitmaps, hyperloglogs, and geospatial indexes with radius queries.

Graphite for Time Series Data

Graphite is specifically designed and optimized for time series data. It uses the Whisper database format, which efficiently stores and manages time series data by automatically aggregating and expiring data based on user-defined retention policies. Graphite supports a wide range of functions for querying, transforming, and aggregating time series data, enabling users to create custom graphs and dashboards. However, as Graphite focuses exclusively on time series data, it may not be suitable for other types of data or use cases that require more advanced data modeling or querying capabilities.

Redis for Time Series Data

Redis has a dedicated module for working with time series data called RedisTimeSeries. RedisTimeSeries offers functionality like downsampling, data retention policies, and specialized queries for time series data in Redis. Being an in-memory database, Redis will be very fast for reading and writing time series data, but due to the cost of RAM compared to disk using Redis could become expensive depending on the size of your dataset. If your use case doesn’t require extremely fast response times, you could save money by going with a more traditional time series database.

Graphite Key Concepts

• Metric: A metric in Graphite represents a time series data point, consisting of a path (name), timestamp, and value.
• Series: A series is a collection of metrics that are all related to the same thing. For example, you might have a series for CPU usage, a series for memory usage, and a series for disk usage.
• Whisper: Whisper is a fixed-size, file-based time series database format used by Graphite. It automatically manages data retention and aggregation.
• Carbon: Carbon is the daemon responsible for receiving, caching, and storing metrics in Graphite. It listens for incoming metrics and writes them to Whisper files.
• Graphite-web: Graphite-web is the web application that provides a user interface for visualizing and querying the stored time series data.

Redis Key Concepts

• In-memory store: Redis stores data in memory, which allows for faster data access and manipulation compared to disk-based databases .
• Data structures: Redis supports a wide range of data structures, including strings, hashes, lists, sets, and more, which provide flexibility in how data is modeled and stored.
• Persistence: Redis offers optional data persistence, allowing data to be periodically saved to disk or written to a log for durability.
• Pub/Sub: Redis provides a publish/subscribe messaging system, enabling real-time communication between clients without the need for a centralized message broker.

Graphite Architecture

Graphite’s architecture consists of several components, including Carbon, Whisper, and Graphite-web. Carbon is responsible for receiving metrics from various sources, caching them in memory, and storing them in Whisper files. Whisper is a file-based time series database format that efficiently manages data retention and aggregation. Graphite-web is the web application that provides a user interface for querying and visualizing the stored time series data. Graphite can be deployed on a single server or distributed across multiple servers for improved performance and scalability.

Redis Architecture

Redis is a NoSQL database that uses a key-value data model, where each key is associated with a value stored as one of Redis’ supported data structures. The database is single-threaded, which simplifies its internal architecture and reduces contention. Redis can be deployed as a standalone server, a cluster, or a master-replica setup for scalability and high availability. The Redis Cluster mode automatically shards data across multiple nodes, providing data partitioning and fault tolerance.