mirascope.core.azure.stream
The AzureStream
class for convenience around streaming LLM calls.
Usage
Class AzureStream
A class for convenience around streaming Azure LLM calls.
Example:
from mirascope.core import prompt_template
from mirascope.core.azure import azure_call
@azure_call("gpt-4o-mini", stream=True)
def recommend_book(genre: str) -> str:
return f"Recommend a {genre} book"
stream = recommend_book("fantasy") # returns `AzureStream` instance
for chunk, _ in stream:
print(chunk.content, end="", flush=True)
Bases:
BaseStream[AzureCallResponse, AzureCallResponseChunk, UserMessage, AssistantMessage, ToolMessage, ChatRequestMessage, AzureTool, ChatCompletionsToolDefinition, AsyncAzureDynamicConfig | AzureDynamicConfig, AzureCallParams, CompletionsFinishReason]Attributes
Name | Type | Description |
---|---|---|
cost_metadata | CostMetadata | Get metadata required for cost calculation. |
Function construct_call_response
Constructs the call response from a consumed AzureStream.
Parameters
Name | Type | Description |
---|---|---|
self | Any | - |
Returns
Type | Description |
---|---|
AzureCallResponse | - |