Interface AnnotationOptions

List of tag keys to propagate to LLM Observability cost and token metrics emitted from this span. Each key must already be present in tags from this call or from a previous annotation on the same span.

A single input string, object, or a list of objects based on the span kind:

1. LLM spans: accepts a string, or an object of the form {content: "...", role: "..."}, or a list of objects with the same signature.
2. Embedding spans: accepts a string, list of strings, or an object of the form {text: "...", ...}, or a list of objects with the same signature.
3. Other: any JSON serializable type

Object of JSON serializable key-value metadata pairs relevant to the input/output operation described by the LLM Observability span.

Object of JSON serializable key-value metrics (number) pairs, such as {input,output,total}Tokens

A single output string, object, or a list of objects based on the span kind:

1. LLM spans: accepts a string, or an object of the form {content: "...", role: "..."}, or a list of objects with the same signature.
2. Retrieval spans: An object containing any of the key value pairs {name: str, id: str, text: str, source: number} or a list of dictionaries with the same signature.
3. Other: any JSON serializable type

A Prompt object that represents the prompt used for an LLM call. Only used on llm spans.

Object of JSON serializable key-value tag pairs to set or update on the LLM Observability span regarding the span's context.

A list of ToolDefinition object that represents the tools available to the LLM for this span Each definition requires a name and optionally accepts description, schema, and version.