One post tagged with "supernova"

LiteLLM now supports gemini-3.1-flash-lite-preview with full day 0 support!

Deploy this version​

docker run \
-e STORE_MODEL_IN_DB=True \
-p 4000:4000 \
ghcr.io/berriai/litellm:main-v1.80.8-stable.1

pip install litellm==v1.80.8-stable.1

What's New​

Supports all four thinking levels:

• MINIMAL: Ultra-fast responses with minimal reasoning
• LOW: Simple instruction following
• MEDIUM: Balanced reasoning for complex tasks
• HIGH: Maximum reasoning depth (dynamic)

Quick Start​

from litellm import completion

response = completion(
    model="gemini/gemini-3.1-flash-lite-preview",
    messages=[{"role": "user", "content": "Extract key entities from this text: ..."}],
)

print(response.choices[0].message.content)

from litellm import completion

# Use MEDIUM thinking for complex reasoning tasks
response = completion(
    model="gemini/gemini-3.1-flash-lite-preview",
    messages=[{"role": "user", "content": "Analyze this dataset and identify patterns"}],
    reasoning_effort="medium",  # low, medium , high
)

print(response.choices[0].message.content)

model_list:
  - model_name: gemini-3.1-flash-lite
    litellm_params:
      model: gemini/gemini-3.1-flash-lite-preview
      api_key: os.environ/GEMINI_API_KEY
  
  # Or use Vertex AI
  - model_name: vertex-gemini-3.1-flash-lite
    litellm_params:
      model: vertex_ai/gemini-3.1-flash-lite-preview
      vertex_project: your-project-id
      vertex_location: us-central1

litellm --config /path/to/config.yaml

curl -X POST http://localhost:4000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer <YOUR-LITELLM-KEY>" \
  -d '{
    "model": "gemini-3.1-flash-lite",
    "messages": [{"role": "user", "content": "Extract structured data from this text"}],
    "reasoning_effort": "low"
  }'

Supported Endpoints​

LiteLLM provides full end-to-end support for Gemini 3.1 Flash Lite Preview on:

• ✅ /v1/chat/completions - OpenAI-compatible chat completions endpoint
• ✅ /v1/responses - OpenAI Responses API endpoint (streaming and non-streaming)
• ✅ /v1/messages - Anthropic-compatible messages endpoint
• ✅ /v1/generateContent – Google Gemini API compatible endpoint

All endpoints support:

• Streaming and non-streaming responses
• Function calling with thought signatures
• Multi-turn conversations
• All Gemini 3-specific features (thinking levels, thought signatures)
• Full multimodal support (text, image, audio, video)

reasoning_effort Mapping for Gemini 3.1​

LiteLLM automatically maps OpenAI's reasoning_effort parameter to Gemini's thinkingLevel: