Class ObservabilityPipelineDatabricksZerobusDestination

The databricks_zerobus destination sends logs to Databricks using the Zerobus ingestion API, streaming data directly into your Databricks Lakehouse.

Supported pipeline types: Logs, rehydration

Hierarchy

  • ObservabilityPipelineDatabricksZerobusDestination

Constructors

Properties

additionalProperties?: {
    [key: string]: any;
}

A container for additional, undeclared properties. This is a holder for any undeclared properties as specified with the 'additionalProperties' keyword in the OAS document.

Type declaration

  • [key: string]: any

OAuth credentials for authenticating with the Databricks Zerobus ingestion API.

Configuration for buffer settings on destination components.

id: string

The unique identifier for this component.

ingestionEndpointKey?: string

Name of the environment variable or the secret identifier that references the Databricks Zerobus ingestion endpoint, which is used to stream data directly into your Databricks Lakehouse.

inputs: string[]

A list of component IDs whose output is used as the input for this component.

tableName: string

The fully qualified name of your target Databricks table. Make sure this table already exists in your Databricks workspace before deploying.

The destination type. The value must be databricks_zerobus.

unityCatalogEndpointKey?: string

Name of the environment variable or the secret identifier that references your Databricks workspace URL, which is used to communicate with the Unity Catalog API.

Generated using TypeDoc