command-r-plus-08-2024 is an update of the Command R+ with roughly 50% higher throughput and 25% lower latencies as compared to the previous Command R+ version, while keeping the hardware footprint...
Reroute speaks the OpenAI Chat Completions format. Point any OpenAI SDK at https://www.reroute.wtf/api/v1 and use cohere/command-r-plus-08-2024 as the model.
curl https://www.reroute.wtf/api/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $REROUTE_API_KEY" \
-d '{
"model": "cohere/command-r-plus-08-2024",
"messages": [
{ "role": "user", "content": "What is the meaning of life?" }
]
}'Set stream: true to receive server-sent events. The final chunk carries usage and cost.
curl -N https://www.reroute.wtf/api/v1/chat/completions \
-H "Content-Type: application/json" \
-H "Authorization: Bearer $REROUTE_API_KEY" \
-d '{ "model": "cohere/command-r-plus-08-2024", "stream": true,
"messages": [{ "role": "user", "content": "Count to five" }] }'