reroute

Cohere: Command R+ (08-2024)

cohere/command-r-plus-08-2024

command-r-plus-08-2024 is an update of the Command R+ with roughly 50% higher throughput and 25% lower latencies as compared to the previous Command R+ version, while keeping the hardware footprint...

Modalities
In / Out Price
$2.50 / $10 per 1M
Context
128K
Released
Aug 30, 2024
Knowledge Cutoff
Mar 2024

API

Reroute speaks the OpenAI Chat Completions format. Point any OpenAI SDK at https://www.reroute.wtf/api/v1 and use cohere/command-r-plus-08-2024 as the model.

You need an API key
Keys start with sk-rr-v1- and are shown once.
Create API key
curl https://www.reroute.wtf/api/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $REROUTE_API_KEY" \
  -d '{
  "model": "cohere/command-r-plus-08-2024",
  "messages": [
    { "role": "user", "content": "What is the meaning of life?" }
  ]
}'

Streaming

Set stream: true to receive server-sent events. The final chunk carries usage and cost.

curl -N https://www.reroute.wtf/api/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer $REROUTE_API_KEY" \
  -d '{ "model": "cohere/command-r-plus-08-2024", "stream": true,
        "messages": [{ "role": "user", "content": "Count to five" }] }'