You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: website/docs/azure/overview.md
+22-27Lines changed: 22 additions & 27 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -12,37 +12,30 @@ The Azure Cosmos DB Garnet Cache is currently in an expanded Private Preview. Pl
12
12
13
13
## Key Benefits
14
14
15
-
Azure Cosmos DB Garnet Cache is a cloud-native caching service that combines the performance advantages of Garnet with Azure's managed service capabilities. It offers:
15
+
Azure Cosmos DB Garnet Cache is a cloud-native caching service that combines the performance advantages of Garnet with Azure's managed service capabilities. Unlike traditional single-threaded caches or caches that are hash-partitioned within each node, Garnet uses a shared-everything architecture within nodes where all threads directly access the single shared memory space. This architectural advantage allows Garnet to maintain sub-millisecond latencies even under heavy load with thousands of concurrent client connections and translates to cost savings for applications with many simultaneous users. It offers:
16
16
17
17
-**Ultra-Low Latency**: Sub-millisecond latency with 3ms at the 99th percentile.
18
-
-**Performance**: Supports millions of operations per second with linear scalability across multiple nodes.
19
-
-**Cost Optimization**: Per node pricing with multiple performance tiers and no licensing fees.
20
-
-**Fully Managed**: No infrastructure to manage, patch, or maintain while delivering enterprise features like high availability and data persistence.
18
+
-**Throughput**: Supports millions of operations per second with linear scalability across nodes. Performance scales efficiently even with thousands of concurrent connections.
19
+
-**Scalability**: Optimized performance with vertical and horizontal scaling as well as configurable replication for increased read throughput.
20
+
-**Data Persistence**: Data durability with non-blocking Append Only File (AOF) checkpoints. Maintains full throughput with no performance penalty.
21
+
-**Cost Optimization**: Per node pricing with multiple performance tiers and no licensing fees. Cost-effective at scale for workloads where cache size is driven by throughput requirements (as opposed to memory size).
22
+
-**Fully Managed**: No infrastructure to manage, patch, or maintain while delivering enterprise features for high availability, security and more.
21
23
22
24
## Common Use Cases
23
25
24
-
Azure Cosmos DB Garnet Cache is ideal for distributed caching across multiple application instances and a wide range of caching scenarios:
26
+
Azure Cosmos DB Garnet Cache supports distributed caching across multiple application instances and is designed for workloads where throughput efficiency and data durability matter. Here are scenarios where Garnet's unique advantages deliver the most value:
25
27
26
-
### Application Cache
27
-
Cache frequently accessed database queries, API responses, and computed results to reduce backend load and improve response times.
28
+
### High-Concurrency Applications
29
+
Live trading and financial tick systems, multiplayer and gaming services, and IoT platforms with thousands of simultaneous connections. Garnet's multi-threaded architecture maintains sub-millisecond latency and consistent throughput even under heavy concurrent load, eliminating the performance degradation single-threaded caches experience with many parallel requests.
28
30
29
-
### Session Store
30
-
Store user session data, shopping carts, and user preferences.
31
+
### Mission-Critical Caching with Durability
32
+
Applications where losing cached data is not acceptable like user sessions, payment information, and transaction data. Garnet's non-blocking AOF persistence eliminates the traditional tradeoff between persistence and throughput. It lets you durably cache critical data without sacrificing performance.
31
33
32
-
### Gaming & Leaderboards
33
-
Leverage sorted sets for leaderboards, player rankings, and game state management.
34
+
### AI-Powered Applications
35
+
Vector search for recommendation engines, semantic search, and AI applications. Store and query high-dimensional vectors using VectorSet data structures with DiskANN indexing for single-digit millisecond vector search at scale.
34
36
35
-
### Vector Search & AI Applications
36
-
Store and search high-dimensional vectors for recommendation engines, similarity search, and AI-powered features using VectorSet data structures with DiskANN indexing.
37
-
38
-
### Content Delivery
39
-
Cache static content, configuration data, and frequently accessed information close to your users for faster delivery.
40
-
41
-
### Rate Limiting & Counters
42
-
Implement distributed rate limiting, usage quotas, and real-time counters across multiple application instances.
43
-
44
-
### Pub/Sub Messaging
45
-
Enable real-time communication between applications with Redis-compatible publish/subscribe messaging patterns for event-driven architectures, notifications, and live updates.
37
+
### Cost-Optimized At-Scale Infrastructure
38
+
Applications where high throughput requirements drive infrastructure costs. Garnet's multi-threaded efficiency means you can handle the same throughput with smaller SKUs or fewer cache nodes than other solutions, directly reducing operational costs and complexity.
46
39
47
40
## Features
48
41
@@ -53,7 +46,10 @@ Enable real-time communication between applications with Redis-compatible publis
53
46
|[**Scaling**](./cluster-configuration.md#scaling-options)| Horizontal scaling with sharding and replication or scale up SKU size |
|[**Data persistence**](./resiliency.md#data-persistence)| Append only file (AOF) checkpointing |
49
+
|[**Advanced data structures**](./api-compatibility.md)| Support for Hash, Set, Sorted Set in addition to String |
56
50
|**Vector search**| VectorSet support with DiskANN indexing |
51
+
|**Scripting**| Lua scripting |
52
+
|**Pub/Sub**| Publish/subscribe messaging |
57
53
|[**Authentication**](./security.md#authentication-and-access-control)| Microsoft Entra ID RBAC |
58
54
|[**Network isolation**](./security.md#network-security)| Virtual network support with no public internet access |
59
55
|[**Encryption**](./security.md#encryption-at-rest)| At rest and in transit with TLS |
@@ -62,6 +58,10 @@ Enable real-time communication between applications with Redis-compatible publis
62
58
63
59
*This is an estimated value. Actual availability varies depending on configuration. See [high availability](./resiliency.md#high-availability) for more information.
64
60
61
+
### Compatible with Redis clients
62
+
63
+
Just like self-hosted Garnet, Azure Cosmos DB Garnet Cache uses the Redis RESP protocol, making it compatible with existing Redis clients and tools. You can migrate from Redis or other cache solutions with minimal code changes. Azure Cosmos DB Garnet Cache supports a subset of the self-hosted Garnet commands including Strings, Hashes, Sets, Sorted Sets, Pub/Sub, Lua scripting, and more. See the full list of [supported commands](./api-compatibility.md).
64
+
65
65
### Available Tiers
66
66
67
67
Azure Cosmos DB Garnet Cache offers two performance tiers to match your workload requirements. An overview of single-node specs is below for each tier based on the [available SKUs](./cluster-configuration.md#available-tiers). Each cluster can be scaled to have one or more nodes of the same SKU determined by the shard count and replication factor configured. This allows for custom cache sizes up to 5TB+ that match your specific workload needs.
@@ -78,11 +78,6 @@ Recommended for in-memory databases, large datasets, gaming leaderboards, vector
78
78
-**vCPUs**: 2-32 cores
79
79
-**Network**: Up to 16 Gbps
80
80
81
-
82
-
## Compatible with Redis clients
83
-
84
-
Just like self-hosted Garnet, Azure Cosmos DB Garnet Cache uses the Redis RESP protocol, making it compatible with existing Redis clients and tools. You can migrate from Redis or other cache solutions with minimal code changes. Azure Cosmos DB Garnet Cache supports a subset of the self-hosted Garnet commands. See the full list of [supported commands](./api-compatibility.md).
85
-
86
81
## Getting Started
87
82
88
83
Ready to get started? Check out our [quick start guide](./quickstart.md) to create your first Azure Cosmos DB Garnet Cache instance in minutes.
0 commit comments