A new PipelineConfig schema has been introduced, allowing developers to specify a pipelineType (DATAFORM, SQL, or NOTEBOOK) and a relative path within a Git repository. This configuration is now integrated into CodeCompilationConfig, WorkflowInvocation, and InstallNpmPackagesRequest. Additionally, the API now supports repository snapshots in Google Cloud Storage via GcsRepositorySnapshotDestination and GcsRepositorySnapshotMetadata, which are used to track the state of repositories for scheduled notebooks. NotebookAction also now explicitly exposes the filePath of the notebook within the repository.
Released (7d lead)Medium Impact
Docs