New

    DeepSeek V4.1 Flash 1017 is now available on Inference.net

    GoogleMultimodal Model

    Gemini 3.7 Flash

    Google's latest and most capable Flash model, built for complex coding, agentic workflows, and reliable multi-step execution. Same 1M-token multimodal context as 3.6 Flash, sharper reasoning and tool use, at Flash pricing.

    import OpenAI from "openai";
    
    const openai = new OpenAI({
      baseURL: "https://api.inference.net/v1",
      apiKey: "<YOUR_API_KEY>",
    });
    
    const completion = await openai.chat.completions.create({
      model: "gemini-3.7-flash",
      messages: [
        {
          role: "user",
          content: "What is the meaning of life?"
        }
      ],
      stream: true,
    });
    
    for await (const chunk of completion) {
      process.stdout.write(chunk.choices[0]?.delta.content as string);
    }
    Prompt caching
    1. Keep the stable system content block byte-identical across calls.
    2. Mark it with cache_control: { "type": "ephemeral" } to set a cache point.
    3. Long prompts are required. As a practical target, use roughly 4,000 stable tokens for Gemini 3.1 Pro Preview or 9,000 for the other listed Gemini models; these are not guaranteed provider minimums.
    4. Check usage.prompt_tokens_details.cached_tokens in the response to confirm cache reads.
    {
      "messages": [{
        "role": "system",
        "content": [{
          "type": "text",
          "text": "Stable system content...",
          "cache_control": { "type": "ephemeral" }
        }]
      }]
    }

    Start building with Gemini 3.7 Flash today

    Serverless, OpenAI-compatible, and billed per token. No commitments.