Cohere SDK Patterns

Overview

Production-ready patterns for Cohere SDK usage in TypeScript and Python.

Prerequisites

• Completed cohere-install-auth setup
• Familiarity with async/await patterns
• Understanding of error handling best practices

Instructions

Step 1: Implement Singleton Pattern (Recommended)

// src/cohere/client.ts
import { CohereClient } from '@cohere/sdk';

let instance: CohereClient | null = null;

export function getCohereClient(): CohereClient {
  if (!instance) {
    instance = new CohereClient({
      apiKey: process.env.COHERE_API_KEY!,
      // Additional options
    });
  }
  return instance;
}

Step 2: Add Error Handling Wrapper

import { CohereError } from '@cohere/sdk';

async function safeCohereCall<T>(
  operation: () => Promise<T>
): Promise<{ data: T | null; error: Error | null }> {
  try {
    const data = await operation();
    return { data, error: null };
  } catch (err) {
    if (err instanceof CohereError) {
      console.error({
        code: err.code,
        message: err.message,
      });
    }
    return { data: null, error: err as Error };
  }
}

Step 3: Implement Retry Logic

async function withRetry<T>(
  operation: () => Promise<T>,
  maxRetries = 3,
  backoffMs = 1000
): Promise<T> {
  for (let attempt = 1; attempt <= maxRetries; attempt++) {
    try {
      return await operation();
    } catch (err) {
      if (attempt === maxRetries) throw err;
      const delay = backoffMs * Math.pow(2, attempt - 1);
      await new Promise(r => setTimeout(r, delay));
    }
  }
  throw new Error('Unreachable');
}

Output

• Type-safe client singleton
• Robust error handling with structured logging
• Automatic retry with exponential backoff
• Runtime validation for API responses

Error Handling

Examples

Factory Pattern (Multi-tenant)

const clients = new Map<string, CohereClient>();

export function getClientForTenant(tenantId: string): CohereClient {
  if (!clients.has(tenantId)) {
    const apiKey = getTenantApiKey(tenantId);
    clients.set(tenantId, new CohereClient({ apiKey }));
  }
  return clients.get(tenantId)!;
}

Python Context Manager

from contextlib import asynccontextmanager
from cohere import CohereClient

@asynccontextmanager
async def get_cohere_client():
    client = CohereClient()
    try:
        yield client
    finally:
        await client.close()

Zod Validation

import { z } from 'zod';

const cohereResponseSchema = z.object({
  id: z.string(),
  status: z.enum(['active', 'inactive']),
  createdAt: z.string().datetime(),
});

Resources

• Cohere SDK Reference
• Cohere API Types
• Zod Documentation

Next Steps

Apply patterns in cohere-core-workflow-a for real-world usage.