New

    Introducing AutoEvals: Find the right model for your task

    AnthropicMultimodal Model

    Claude Haiku 4.5

    Anthropic's small, fast Claude — near-Sonnet quality at a fraction of the price. The right default for high-volume production work: classification, extraction, summarization, and low-latency chat where cost per call is the binding constraint.

    import OpenAI from "openai";
    
    const openai = new OpenAI({
      baseURL: "https://api.inference.net/v1",
      apiKey: "<YOUR_API_KEY>",
    });
    
    const completion = await openai.chat.completions.create({
      model: "claude-haiku-4-5",
      messages: [
        {
          role: "user",
          content: "What is the meaning of life?"
        }
      ],
      stream: true,
    });
    
    for await (const chunk of completion) {
      process.stdout.write(chunk.choices[0]?.delta.content as string);
    }
    Prompt caching
    1. Keep the stable system content block byte-identical across calls.
    2. Mark it with cache_control: { "type": "ephemeral" } to set a cache point.
    3. Check usage.prompt_tokens_details.cached_tokens in the response to confirm cache reads. Initial writes may appear in cache-creation usage fields.
    {
      "messages": [{
        "role": "system",
        "content": [{
          "type": "text",
          "text": "Stable system content...",
          "cache_control": { "type": "ephemeral" }
        }]
      }]
    }

    Start building with Claude Haiku 4.5 today

    Serverless, OpenAI-compatible, and billed per token. No commitments.