Discovery API:dataplex.v1
Medium Impact
Docs

Dataplex adds LLM token tracking for Data Documentation

The GoogleCloudDataplexV1DataScanEvent has been expanded to include a dataDocumentation result object. This object contains a comprehensive billableTokenUsage breakdown, covering inputTokenCount, outputTokenCount, cachedContentTokenCount, and even thoughtsTokenCount for reasoning-heavy (Chain-of-Thought) scans. Additionally, GoogleCloudDataplexV1DataScanEventDataProfileResult now reports dcuConsumed, allowing for precise monitoring of Dataplex Compute Units (DCUs) used during data profiling. These changes enable developers to better monitor the costs and performance of AI-driven metadata insights.