Docker
This guide will walk you through installing and running R2R using Docker, which is the quickest and easiest way to get started.
Prerequisites
- Docker installed on your system. If you haven’t installed Docker yet, please refer to the official Docker installation guide.
Install the R2R CLI & Python SDK
First, install the R2R CLI and Python SDK:
Start R2R with Docker
Cloud LLM RAG
Cloud LLM RAG
To start R2R with OpenAI as the default LLM inference and embedding provider:
Refer here for more information on how to configure various LLM providers.
Local LLMs
Local LLMs
To start R2R with your local computer as the default LLM inference provider:
Then, in a separate terminal you will need to run Ollama to provide completions:
The code above assumes that Ollama has already been installed. If you have not yet done so, then refer to the official Ollama webpage for installation instructions. For more information on local installation, refer here.
Custom Configuration
Custom Configuration
R2R offers flexibility in selecting and configuring LLMs, allowing you to optimize your RAG pipeline for various use cases. Execute the command below run deploy R2R with your own custom configuration:
Learn in detail how to configure your deployment here.
The above command will automatically pull the necessary Docker images and start all the required containers, including R2R, Hatchet, and Postgres+pgvector. The required additional services come bundled into the full R2R Docker Compose by default.
The end result is a live server at http://localhost:7272 serving the R2R API.
In addition to launching a RESTful API, the R2R Docker also launches a applications at localhost:7273 and localhost:7274, which you can read more about here.
Stopping R2R
Safely stop your system by running r2r docker-down to avoid potential shutdown complications.
Next Steps
After successfully installing R2R:
-
Verify Installation: Ensure all components are running correctly by accessing the R2R API at http://localhost:7272/v2/health.
-
Quick Start: Follow our R2R Quickstart Guide to set up your first RAG application.
-
In-Depth Tutorial: For a more comprehensive understanding, work through our R2R Walkthrough.
-
Customize Your Setup: Configure R2R components with the Configuration Guide.
If you encounter any issues during installation or setup, please use our Discord community or GitHub repository to seek assistance.
Docker
This guide will walk you through installing and running R2R using Docker, which is the quickest and easiest way to get started.
Prerequisites
- Docker installed on your system. If you haven’t installed Docker yet, please refer to the official Docker installation guide.
Install the R2R CLI & Python SDK
First, install the R2R CLI and Python SDK:
Start R2R with Docker
Cloud LLM RAG
Cloud LLM RAG
To start R2R with OpenAI as the default LLM inference and embedding provider:
Refer here for more information on how to configure various LLM providers.
Local LLMs
Local LLMs
To start R2R with your local computer as the default LLM inference provider:
Then, in a separate terminal you will need to run Ollama to provide completions:
The code above assumes that Ollama has already been installed. If you have not yet done so, then refer to the official Ollama webpage for installation instructions. For more information on local installation, refer here.
Custom Configuration
Custom Configuration
R2R offers flexibility in selecting and configuring LLMs, allowing you to optimize your RAG pipeline for various use cases. Execute the command below run deploy R2R with your own custom configuration:
Learn in detail how to configure your deployment here.
The above command will automatically pull the necessary Docker images and start all the required containers, including R2R, Hatchet, and Postgres+pgvector. The required additional services come bundled into the full R2R Docker Compose by default.
The end result is a live server at http://localhost:7272 serving the R2R API.
In addition to launching a RESTful API, the R2R Docker also launches a applications at localhost:7273 and localhost:7274, which you can read more about here.
Stopping R2R
Safely stop your system by running r2r docker-down to avoid potential shutdown complications.
Next Steps
After successfully installing R2R:
-
Verify Installation: Ensure all components are running correctly by accessing the R2R API at http://localhost:7272/v2/health.
-
Quick Start: Follow our R2R Quickstart Guide to set up your first RAG application.
-
In-Depth Tutorial: For a more comprehensive understanding, work through our R2R Walkthrough.
-
Customize Your Setup: Configure R2R components with the Configuration Guide.
If you encounter any issues during installation or setup, please use our Discord community or GitHub repository to seek assistance.