search legion

Review · LLM APIs

Cohere review

A broad enterprise AI stack with deployment options to control, but production API costs and North pricing are hard to pin down.

6.8/10Search Legion score

We may earn a commission if you buy through links on this page. It never changes a score or a ranking. How we make money

The bottom line

A capable enterprise AI platform, but opaque production pricing makes cost comparisons difficult.

Cohere covers more than text generation: its models handle search, speech recognition, translation, and document parsing, while North adds agents and workflow tools. Its homepage says customers can deploy privately on-premises or in isolated VPCs; Model Vault offers isolated inference. That control and range suit enterprise teams, not buyers looking for a simple, price-transparent API swap.

The trial API key is free but rate-limited and barred from production or commercial use. Production API rates and North pricing aren't published in the published pricing details; North and Compass are custom-priced. Model Vault does publish GPU-hour rates, starting at $3 on demand, with a temporary $1 rate for L4 24GB through March 31, 2027. Reddit feedback is mixed: one LocalLLaMA thread welcomed early model access, while another sharply debated Cohere's safety claims.

Good fit if

  • Enterprise teams needing private deployment
  • Businesses combining search and AI agents
  • Teams evaluating hosted model inference

Skip it if

  • Buyers needing clear API token pricing
  • Production users seeking a free tier
  • Small teams wanting fixed monthly costs
Cohere homepage
Cohere homepage, captured Nov 6, 2026

ScoresHow it rates

  • Features8.3
  • Ease of use6.4
  • Value for money6
  • Support6
  • User sentiment5.2

What works

  • Free, rate-limited API calls for prototyping
  • On-premises and isolated VPC deployment options
  • Models cover generation, search, speech, translation, and parsing
  • Model Vault publishes GPU-hour rates
  • North includes agents, automations, skills, and libraries

What doesn't

  • Trial API calls aren't allowed for production or commercial use
  • Current production API token rates aren't published
  • North and Compass require custom enterprise pricing
  • Model Vault costs accrue by GPU-hour
  • Reddit reaction to a Cohere safety post is divided

01What Cohere actually does

Cohere is an enterprise AI platform, not a single chatbot or a conventional SEO tool. It combines business-focused language and search models with products for building and deploying AI applications. North is its platform for agents, automations, skills, and libraries. The model lineup includes Command for generative AI, Embed for semantic representations used in search and other applications, and models for speech recognition, translation, and document parsing.

Deployment choice is central to the offer: Cohere’s homepage says customers can run its technology privately on-premises or in isolated virtual private clouds. Model Vault is described as an isolated inference platform. Teams can also use Cohere APIs, with free, rate-limited trial calls and separately billed production access. North and Compass, its business search and discovery product, are listed with custom enterprise pricing, so Cohere is aimed chiefly at organizations prepared to evaluate deployment and contract costs—not buyers looking for a transparent, fixed-price subscription.

02Where Cohere is strong

Cohere’s clearest strength is the breadth of its enterprise stack. A team can pair Embed for semantic search, Parse for document processing, and Command for generation, while North packages agents, automations, skills, and libraries. Compass adds pre-built data connectors, an intelligent search experience, document parsing, and a managed index, according to the pricing details. That gives buyers a route to business search and workflow automation without treating every use case as a standalone model API.

Deployment flexibility may matter more than the model list for organizations with infrastructure or data-control requirements. Cohere says customers can deploy privately on-premises or in isolated VPCs, while Model Vault provides isolated inference. The pricing page also publishes GPU-hour rates for Model Vault rather than hiding every cost behind a sales call. Listed on-demand rates range from $3.00 per GPU-hour for L4 24GB to $12.50 for GB200 192GB; promotional rates run through March 31, 2027. Trial API calls are free, which gives teams a way to prototype before production access. These options make Cohere worth considering when control and enterprise search matter more than a simple self-serve price.

03Where it falls short

The main buying problem is price opacity. The pricing information lists North and Compass as custom-priced, and production API access as pay-as-you-go, but does not publish current model-specific API rates here. That makes it hard to forecast a production workload or compare Cohere with a vendor that exposes per-token prices. Production access is also a separate requirement: the free trial key is rate-limited and cannot be used for production or commercial purposes.

The billing threshold deserves attention. Production API usage is billed at month end or when the balance reaches $250 outstanding. Model Vault’s published GPU-hour rates are more concrete, but hourly inference can still be difficult to budget without workload estimates; reserved capacity pricing requires contacting sales. Promotional GPU rates are time-limited, ending March 31, 2027, and the pricing page says further discounts may depend on monthly commits. Cohere therefore gives buyers useful deployment choices, but not a complete, public cost estimate for the whole platform. Teams should get production API rates and enterprise quotes before treating a prototype as a cost comparison.

04Cohere pricing: what you'll actually pay

Cohere’s trial API key is free, but it is rate-limited and barred from production or commercial use. Production API access is pay-as-you-go, billed at month-end or when your balance reaches $250. Current model-specific API rates are not published on the vendor's site, so you can’t make a reliable token-cost comparison from it.

North and Compass use custom enterprise pricing. Model Vault is priced by GPU-hour: listed on-demand rates range from $3.00 for an L4 24GB to $12.50 for a GB200 192GB. Promotional rates run through March 31, 2027; for example, the L4 is $1.00 and the GB200 is $10.00 per GPU-hour during the promotion. Reserved capacity requires a sales quote, and further discounts may apply to monthly commits.

The listed token rates for Command, Command R and related models are explicitly legacy rates for existing customers—not a dependable quote for a new production deployment. Budgeting is therefore the catch: ask Cohere for current rates and enterprise pricing before comparing total cost.

Full Cohere pricing breakdown →

05Switching to (or from) Cohere

Cohere brings models, search and agents under one enterprise platform, with deployment options that include on-premises and isolated VPCs. That may suit teams consolidating those workloads, but replacing a model or search stack still means checking integrations, prompts, indexes and workflows against the new setup. The published product information does not specify migration tooling, supported export formats or a data-export process, so get those details in writing before committing.

The switching risk depends on how much you build around North, Compass or Model Vault. The sources describe their capabilities, but don’t document portability between them and another provider. Treat portability as an open procurement question, not a promised feature.

We don’t have sourced Reddit reports in the published material, so we can’t attribute reasons for leaving Cohere to users. If you’re evaluating a move away, ask about data retrieval, contract terms and the work required to replace each connected model and service before estimating migration cost.

From the threadsWhat users say

Reddit reactions are mixed: some users welcome Cohere’s community engagement and Canadian identity, while others question its local-model support, safety claims, and ability to compete. Enterprise buyers also raised a practical concern: changing an AI workflow’s harness can mean real migration work, not just swapping models.

Community engagement
A lab that actually interacts with the community in a non-commercial way? Unheard of! I wish the best for all of you guys
r/LocalLLaMA · view thread
Local model support
if you want real feedback from this community then llama.cpp support is essentially mandatory
r/LocalLLaMA · view thread
Safety debate
Fearmongering or not, it's nice to be able discuss open models' "intents",
r/LocalLLaMA · view thread
Switching friction
the harness is what businesses will be loyal to
r/canada · view thread

Questions people ask

What is Cohere, and who is it for?

Cohere is an enterprise AI platform offering models and deployment options, rather than just a chatbot. Its products include North for agents and workflows, Command for generative AI, and models for speech recognition, translation, document parsing, and search. The product and deployment options are aimed at businesses that need control over how AI runs.

How much does Cohere cost?

The pricing page lists free, rate-limited Trial API calls for prototyping, but does not publish current production API rates in the published pricing details. North and Compass have custom enterprise pricing. Model Vault is priced by GPU per hour: listed on-demand rates range from $3.00 to $12.50, with promotional rates through March 31, 2027.

Can I use Cohere for free in production?

No. According to the pricing details, the free Trial API key is rate-limited and is not permitted for production or commercial use. Production API access requires approval and is pay-as-you-go, billed at month end or when the balance reaches $250 outstanding. Current model-specific API rates are not published on the vendor's site.

Can Cohere run in our own environment?

Cohere’s homepage says customers can deploy privately on-premises or in isolated VPCs. It also describes Model Vault as an isolated inference platform. If private deployment is a requirement, confirm which deployment option covers your security and operational needs; the published information does not specify every configuration or its price.

Will switching to Cohere mean changing our AI workflow?

It may. Cohere’s North is an enterprise platform for agents, automations, skills, and libraries, so buyers should check how it fits their existing workflows. One Reddit commenter argued that changing an agent harness can mean lost capabilities and relearning, while swapping a model may be less disruptive. Cohere’s migration support is not specified here.

Sources

  1. Cohere homepage
  2. Cohere pricing page
  3. Reddit: Cohere's unreleased coding model (early access for localllama)
  4. Reddit: Arguably unethical behavior from Cohere
  5. Reddit: Canadian ChatGPT (Not US, not China): Cohere
  6. Reddit: Cohere unveils latest AI platform with more agentic features for businesses