redis-developer/redis-ai-resources

✨ A curated list of awesome community resources, integrations, and examples of Redis in the AI ecosystem.

Redis: AI Resources

✨ A curated list of awesome community resources including content, integrations, documentation and examples for Redis in the AI ecosystem.

Table of Contents

• Redis as a Vector Database
• Redis as a Feature Store

---

Vector Database

The following list provides resources, integrations, and examples for Redis as a Vector Database.

Integrations/Tools

• ⭐ RedisVL - a dedicated Python client lib for Redis as a Vector DB.
• ⭐ LangChain Python - popular Python client lib for building LLM applications. powered by Redis.
• ⭐ LangChain JS - popular JS client lib for building LLM applications. powered by Redis.
• ⭐ LlamaIndex - LlamaIndex Integration for Redis as a vector Database (formerly GPT-index).
• Semantic Kernel - popular lib by MSFT to integrate LLMs with plugins.
• Metal - an all-inclusive LLM development platform for building RAG applications. Built on top of Redis as a vector database and high performance data layer.
• RelevanceAI - Platform to ag, search and analyze unstructured data faster, built on Redis.
• DocArray - DocArray Integration of Redis as a VectorDB by Jina AI.
• ChatGPT Memory - contextual and adaptive memory for ChatGPT
• Haystack Example - Haystack Integration (example) of Redis as a VectorDB.
• Mantium AI

Examples

Quickstarts

Resource	Description
⭐ Hands-On Redis Workshops	Hands-on workshops for Redis JSON, Search, and VSS / Gen AI.
⭐ Redis VSS Getting Started - 3 Ways	Getting started VSS demo covering RedisVL, Redis Python, and LangChain
⭐ OpenAI Cookbook Examples	OpenAI Cookbook examples using Redis as a vector database
Redis VSS - Simple Streamlit Demo	Streamlit demo of Redis Vector Search
Redis VSS - LabLab AI Quickstart	Quickstart notebook sponspored by LabLab AI for their AI hackathons.
Redis VSS Documentation Quickstart	Redis.io VSS Quickstart code.

Question & Answer

Resource	Description	Stars
⭐ ArxivChatGuru	Streamlit demo of QnA over Arxiv documents with Redis & OpenAI
⭐ Azure OpenAI Embeddings Q&A	OpenAI and Redis as a Q&A service on Azure
LLM Document Chat	Using LlamaIndex and Redis to chat with Documents
GCP Vertex AI "Chat Your PDF"	Chat with a PDF using Redis & VertexAI LLMs
LLMChat	Full-stack implementation using FastAPI, Redis, OpenAI and Flutter.
Example eCommerce Chatbot	eCommerce Chatbot with Redis, LangChain, and OpenAI
Food-GPT	Food-GPT is a QnA Chat System
Redis vector bot	Redis vector bot for Ecommerce QnA
Local Model QnA Example	Local LLMs embeddings with Redis as vector db

NLP & Information Retrieval

Resource	Description	Stars
⭐ ChatGPT Retrieval Plugin	ChatGPT plugin for retrieving personal documents
⭐ Auto-GPT	Experimental OSS app showcasing GPT-4 with Redis as a vectorized memory store
⭐ arXiv Paper Search	Semantic search over arXiv scholarly papers
⭐ Motörhead	Rust-based IR server for LLMs backed by Redis
Financial News Demo	Sentiment analysis and Semantic similarity in Financial News articles
Romeo GPT	AI Document management assistant
The Pattern	CORD19 medical NLP pipeline with Redis
GPT Vectors Example	Code associated with the blog post below: "Storing and querying embeddings with Redis"
Azure OpenAI Redis Deployment Template	Terraform template automates the end-to-end deployment of Azure OpenAI applications using Redis Enterprise as a vector database
VSS for Finance	Searching through SEC filings with Redis VSS

Recommendation Systems

Resource	Description	Stars
⭐ Redis Merlin RecSys	3 Redis & NVIDIA Merlin Recommendation System Architectures
⭐ Visual Product Search	eCommerce product search (with image and text)
Product Recommendations with DocArray / Jina	Content-based product recommendations with Redis and DocArray
Amazon Berkeley Product Dataset Demo	Redis VSS demo on Amazon Berkeley product dataset

Other

Resource	Description	Stars
VectorVerse	Vector Database comparison app
Simple Vector Similarity Intro	Dockerized Jupyter Notebook & Streamlit demo of Redis Vector Search
Redis Solution Architects VSS Examples	Examples of VSS in Python
TopVecSim	Topic Similarity with Redis VSS
Java Demo	Redis VSS demo in Java
Redis VSS Go template	Redis VSS template in Go
Redis VSS Demo	Redis VSS demo with celebrity faces

Redis Vector Search Engineering Lab Submissions - Submissions to the first Redis VSS hackathon.

Resource	Description	Stars
arXiv CoPilot	Chrome extension that finds relevant/similar academic papers while performing research
AskYeves Question & Answer App	QA & Search Engine modeled after the infamous Yves Saint Laurent
Darwinian Paper Explorer App	Explore arXiv scholarly papers over time with topic evolution and search
PapersWithCode Browser Extension	Chrome extension for the PapersWithCode site that finds relevant/similar papers
Document Search + CLI	Search engine for documents with a CLI

RediSearch Clients

Client	Language	License	Stars
Redis-Py	Python	MIT
RedisVL	Python (Alpha)	MIT
jedis	Java	MIT
node-redis	Node.js	MIT
nredisstack	.NET	MIT
redisearch-go	Go	BSD
redisearch-api-rs	Rust	BSD

For a full list of RediSearch clients, see RediSearch Clients. For a full list of Redis Clients see Redis Clients.

Content

• ⭐ NVIDIA Developer Blog -- Offline to Online: Feature Storage for Real Time Recommendation Systems with NVIDIA Merlin
• Vector Similarity Search: From Basics to Production - Introductory blog post to VSS and Redis as a VectorDB.
• AI-Powered Document Search - Blog post covering AI Powered Document Search Use Cases & Architectures.
• Vector Search on Azure - Using Azure Redis Enterprise for Vector Search
• Vector Databases and Large Language Models - Talk given at LLMs in Production Part 1 by Sam Partee.
• Vector Databases and AI-powered Search Talk - Video "Vector Databases and AI-powered Search" given by Sam Partee at SDSC 2023.
• Engineering Lab Review - Review of the first Redis VSS Hackathon.
• Real-Time Product Recommendations - Content-based recsys design with Redis and DocArray.
• Redis as a Vector Database - Hackathon review blog post covering Redis as a VectorDB.
• LabLab AI Redis Tech Page
• Storing and querying for embeddings with Redis
• Building Intelligent Apps with Redis Vector Similarity Search
• Rediscovering Redis for Vector Similarity
• VSS Cheat Sheet - Redis Vector Search Cheat Sheet by Datascience Dojo.
• RedisDays Keynote - Video "Infuse Real-Time AI Into Your "Financial Services" Application".
• RedisDays Trading Signals - Video "Using AI to Reveal Trading Signals Buried in Corporate Filings".
• LLM Stack Hackathon writeup - Building a QnA Slack bot for the MLOps Community Hackathon with OpenAI and Redis

Benchmarks

• Vector Database Benchmarks - Jina AI VectorDB benchmarks comparing Redis against others.
• ANN Benchmarks - Standard ANN Benchmarks site. Only using single Redis OSS instance/client.

Documentation

• Redis Vector Database QuickStart
• Redis Vector Similarity Docs - Official Redis literature for Vector Similarity Search.
• Redis-py Search Docs - Redis-py client library docs for RediSearch.
• Redis-py General Docs - Redis-py client library documentation.
• Redis Stack - Redis Stack documentation.
• Redis Clients - Redis client list.

---

Feature Store

The following list provides resources, integrations, and examples for Redis as a Feature Store.

Examples

Recommendation Systems

Resource	Description	Stars
⭐ Redis Merlin RecSys	Redis & NVIDIA Merlin Recommendation System architectures
Market-basket-analysis	An exmaple of predicting shopping baskets on passed purchases

Life Sciences / Healthcare

Resource	Description	Stars
⭐ Redis Vaccine Forecaster	End-to-end ML system to predict vaccine demand deployed in GCP with Redis, Feast, Triton, and Vertex AI.

Image/Video

Resource	Description	Stars
Animal Recognition Demo	An example of using Redis Streams, RedisGears and RedisAI for Realtime Video Analytics (i.e. filtering cats)
Realtime Video Analytics	An example of using Redis Streams, RedisGears, RedisAI and RedisTimeSeries for Realtime Video Analytics (i.e. counting people)

Finance

Resource	Description	Stars
Redis + Feast + Ray Demo	A demo pipeline using Redis as an online feature store with Feast for orchestration and Ray for training and model serving
⭐ Loan Prediction Example	Loan prediction example with Redis as the feature store and serving layer.

Other

Resource	Description	Stars
Redis SQL	Indexed SQL queries on Redis data using Trino
Redis GraphQL	GraphQL queries on Redis data
RedisAI Examples	A collection of examples using RedisAI

Materialization and Orchestration

Resource	Description	Stars
⭐ Spark-Redis	Spark-Redis is a connector that allows you to stream data from Spark to Redis
⭐ Feast	Feast feature orchestration system framework
Feathr	Feathr is a feature orchestration framework created by Linkedin
Redis Kafka	Redis Kafka Connect is a connector that allows you to stream data from Kafka to Redis

Content

• What is a Feature Store? - introductory blog post on feature stores
• Building a Gigascale Feature Store with Redis - blog post on DoorDash's feature store architecture
• Feature Store Comparison - comparison between a few feature store options.
• Feature Storage with Feast and Redis - blog post outlining basic Redis+Feast usage.

Benchmarks

• Feast Feature Serving Benchmarks - Feast-published benchmarks on Redis vs DynamoDB vs Datastore for feature retrieval.

Documentation

• Redis-py General Docs - Redis-py client library documentation.
• RedisJSON - RedisJSON Module.
• RedisAI - RedisAI Module.
• RedisTimeSeries - Redis Time Series Module.
• RedisConnect - a distributed platform that enables real-time event streaming, transformation, and propagation of changed-data events from heterogeneous data platforms to Redis.

Integrations

• FeatureForm - open-source Feature Store orchestration framework.
• Feast - open-source Feature Store orchestration framework.
• Feathr - open-source Feature Store orchestration framework pioneered by LinkedIn.
• Tecton - fully-managed Feature Store service.

---

Have other contributions? Checkout our contributing guidelines.

redis-ai-resources's Issues

Update the redis client list in the OpenAI cookbook

https://github.com/openai/openai-cookbook/tree/main/examples/vector_databases/redis

This README needs to contain accurate info on the supported client side libraries for Redis VSS.

Contribute a QnA example to the OpenAI Cookbook (python)

The existing cookbook just touches the surface:
https://github.com/openai/openai-cookbook/blob/main/examples/vector_databases/redis/getting-started-with-redis-and-openai.ipynb

Contribute a new end-to-end notebook in Python that showcases using Redis VSS for a question-and-answer style demo. Use the code here: https://github.com/RedisVentures/redis-openai-qna as a reasonable source of inspiration / starting point.

Create nodejs vector database examples set

Create Node vector database examples for each of the following features using the Python OpenAI cookbook as a reference:

• JSON + VSS
• Hybrid Querying
• QnA
• performance "fine tuning"

Contribute the code examples either in jupyter notebook or as a script with comments. We will want this to be testable by a CI agent moving forward. Feel free to leverage assets you've already made in order to accelerate the development,. but we need to aggregate these here for optimal reach.

Contribute advanced Hybrid search example in OpenAI Cookbook (python)

The existing cookbook just touches the surface:
https://github.com/openai/openai-cookbook/blob/main/examples/vector_databases/redis/getting-started-with-redis-and-openai.ipynb

Contribute a Python notebook that demonstrates complex Hybrid queries with Redis VSS and other search features (an ecommerce dataset might work nicely) including

• Numeric range filters
• Tag filters
• Full text search "filters"
• Client-side hybrid scoring combing both BM25 lexical AND semantic search. This could be done in a pipeline to send 1 redis call to fetch both search results (top K) and then merge the sets. Show performance improvement with this technique over pure lexical or pure semantic?

Create java vector database example set

Create Java vector database examples for each of the following features using the Python OpenAI cookbook as a reference:

• JSON + VSS
• Hybrid Querying
• QnA
• performance "fine tuning"

Contribute the code examples either in jupyter notebook or as a script with comments. We will want this to be testable by a CI agent moving forward. Feel free to leverage assets you've already made in order to accelerate the development,. but we need to aggregate these here for optimal reach.

Contribute search fine-tuning examples to OpenAI cookbook repo (python)

The existing cookbook just touches the surface:
https://github.com/openai/openai-cookbook/blob/main/examples/vector_databases/redis/getting-started-with-redis-and-openai.ipynb

Create a notebook that highlights the following:

• Combining Redis VSS and other search features (for improved performance)
• Show examples "fine tuning" the HNSW params for VSS and compare recall to a FLAT index structure.
• Show difference between using pipelines for multiple searches vs individual Redis calls (latency improvement)
• Anything else you guys think is relevant here from a search performance perspective?

Contribute a Redis JSON + VSS example to OpenAI Cookbook (python)

The existing cookbook just touches the surface:
https://github.com/openai/openai-cookbook/blob/main/examples/vector_databases/redis/getting-started-with-redis-and-openai.ipynb

Contribute a new end-to-end notebook in Python that showcases using JSON and Search together (and using OpenAI embeddings). Highlight the following:

• Proper JSON setup and indexing
• Different index configurations
• Common querying patterns (including multi-vector, and some basic filtering)