GoogleMultimodal Model

Gemini 2.5 Flash Lite

The fastest, cheapest model in the Gemini 2.5 line. Flash Lite is built for latency-sensitive, high-throughput work — classification, translation, routing — while keeping the full 1M-token multimodal context.

import OpenAI from "openai";

const openai = new OpenAI({
  baseURL: "https://api.inference.net/v1",
  apiKey: "<YOUR_API_KEY>",
});

const completion = await openai.chat.completions.create({
  model: "gemini-2.5-flash-lite",
  messages: [
    {
      role: "user",
      content: "What is the meaning of life?"
    }
  ],
  stream: true,
});

for await (const chunk of completion) {
  process.stdout.write(chunk.choices[0]?.delta.content as string);
}

import OpenAI from "openai";

const openai = new OpenAI({
  baseURL: "https://api.inference.net/v1",
  apiKey: "<YOUR_API_KEY>",
});

const completion = await openai.chat.completions.create({
  model: "gemini-2.5-flash-lite",
  messages: [
    {
      role: "user",
      content: "What is the meaning of life?"
    }
  ],
  stream: true,
});

for await (const chunk of completion) {
  process.stdout.write(chunk.choices[0]?.delta.content as string);
}

Prompt caching

No special request field is needed. Keep the prompt prefix stable and byte-identical across calls.
As a practical target, use roughly 9,000 tokens in the stable prefix; this is not a guaranteed provider minimum.
Check usage.prompt_tokens_details.cached_tokens in the response to confirm cache reads.

Related models

Model

InputCache readOutput

Kimi K3

1024K input contextVisionToolsReasoning$3.00 / $15.002 variants

977K input contextVisionToolsReasoning$0.10 / $0.50

256K input contextTools$0.102 / $0.48

125K input context$0.05 / $0.23

$0.05

$0.23

Schematron V2 Turbo

125K input context$0.03 / $0.15

$0.03

$0.15

Start building with Gemini 2.5 Flash Lite today

Serverless, OpenAI-compatible, and billed per token. No commitments.