Skip to main content
Reasoning models, such as Google’s Gemma 4, return information about their reasoning steps alongside the final answer. This page explains how to identify reasoning-capable models on Serverless Inference, where to find reasoning output in a response, and how to turn reasoning on or off for models that support toggling it. Use this guide to inspect a model’s intermediate reasoning or to control whether reasoning appears in a response. To determine whether a model supports reasoning, check the following Supported models table or the Supported Features section of its catalog page in the UI. Reasoning information appears in the reasoning field of responses. The value of this field is null in the responses of non-reasoning models.

Supported models with reasoning

The following table lists the Serverless Inference models that can return reasoning output, and how each one behaves:
  • Always on: The model always returns reasoning output. You can’t disable it.
  • Enabled by default / Disabled by default: You can turn reasoning output on or off. The table shows the default when you don’t specify a setting.
  • Adaptive; model chooses by default: The model decides per request whether to return reasoning output. You can override this.

Models with Always on reasoning

If a model is listed as Always on in the preceding Supported models table, it always includes reasoning, and you can’t disable it.

Disable reasoning

If a model is listed as Enabled by default in the preceding Supported models table, you can disable reasoning to reduce token usage or simplify the response. To opt out of reasoning for a request, in chat_template_kwargs, set the enable_thinking flag to False (Python) or false (Bash). After the request completes, the response omits the reasoning content:

Enable reasoning

If a model is listed as Disabled by default in the preceding Supported models table, you can enable reasoning by setting the enable_thinking flag to True (Python) or true (Bash) in the preceding code snippet.