Class: Google::Cloud::Datastream::V1::BigQueryDestinationConfig
- Inherits:
-
Object
- Object
- Google::Cloud::Datastream::V1::BigQueryDestinationConfig
- Extended by:
- Protobuf::MessageExts::ClassMethods
- Includes:
- Protobuf::MessageExts
- Defined in:
- proto_docs/google/cloud/datastream/v1/datastream_resources.rb
Overview
BigQuery destination configuration
Defined Under Namespace
Classes: AppendOnly, BlmtConfig, Merge, SingleTargetDataset, SourceHierarchyDatasets
Instance Attribute Summary collapse
-
#append_only ⇒ ::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::AppendOnly
Append only mode.
-
#blmt_config ⇒ ::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::BlmtConfig
Optional.
-
#data_freshness ⇒ ::Google::Protobuf::Duration
The guaranteed data freshness (in seconds) when querying tables created by the stream.
-
#merge ⇒ ::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::Merge
The standard mode.
-
#single_target_dataset ⇒ ::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::SingleTargetDataset
Single destination dataset.
-
#source_hierarchy_datasets ⇒ ::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::SourceHierarchyDatasets
Source hierarchy datasets.
Instance Attribute Details
#append_only ⇒ ::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::AppendOnly
Returns Append only mode
Note: The following fields are mutually exclusive: append_only
, merge
. If a field in that set is populated, all other fields in the set will automatically be cleared.
1283 1284 1285 1286 1287 1288 1289 1290 1291 1292 1293 1294 1295 1296 1297 1298 1299 1300 1301 1302 1303 1304 1305 1306 1307 1308 1309 1310 1311 1312 1313 1314 1315 1316 1317 1318 1319 1320 1321 1322 1323 1324 1325 1326 1327 1328 1329 1330 1331 1332 1333 1334 1335 1336 1337 1338 1339 1340 1341 1342 1343 1344 1345 1346 1347 1348 1349 1350 1351 1352 1353 1354 1355 1356 1357 1358 1359 1360 1361 1362 1363 1364 1365 1366 1367 1368 1369 1370 1371 1372 1373 1374 1375 1376 1377 1378 1379 1380 1381 1382 1383 1384 1385 1386 |
# File 'proto_docs/google/cloud/datastream/v1/datastream_resources.rb', line 1283 class BigQueryDestinationConfig include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # A single target dataset to which all data will be streamed. # @!attribute [rw] dataset_id # @return [::String] # The dataset ID of the target dataset. # DatasetIds allowed characters: # https://cloud.google.com/bigquery/docs/reference/rest/v2/datasets#datasetreference. class SingleTargetDataset include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end # Destination datasets are created so that hierarchy of the destination data # objects matches the source hierarchy. # @!attribute [rw] dataset_template # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::SourceHierarchyDatasets::DatasetTemplate] # The dataset template to use for dynamic dataset creation. class SourceHierarchyDatasets include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # Dataset template used for dynamic dataset creation. # @!attribute [rw] location # @return [::String] # Required. The geographic location where the dataset should reside. See # https://cloud.google.com/bigquery/docs/locations for supported # locations. # @!attribute [rw] dataset_id_prefix # @return [::String] # If supplied, every created dataset will have its name prefixed by the # provided value. The prefix and name will be separated by an underscore. # i.e. <prefix>_<dataset_name>. # @!attribute [rw] kms_key_name # @return [::String] # Describes the Cloud KMS encryption key that will be used to # protect destination BigQuery table. The BigQuery Service Account # associated with your project requires access to this encryption key. # i.e. # projects/\\{project}/locations/\\{location}/keyRings/\\{key_ring}/cryptoKeys/\\{cryptoKey}. # See https://cloud.google.com/bigquery/docs/customer-managed-encryption # for more information. class DatasetTemplate include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end end # The configuration for BLMT. # @!attribute [rw] bucket # @return [::String] # Required. The Cloud Storage bucket name. # @!attribute [rw] root_path # @return [::String] # The root path inside the Cloud Storage bucket. # @!attribute [rw] connection_name # @return [::String] # Required. The bigquery connection. # Format: `{project}.{location}.{name}` # @!attribute [rw] file_format # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::BlmtConfig::FileFormat] # Required. The file format. # @!attribute [rw] table_format # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::BlmtConfig::TableFormat] # Required. The table format. class BlmtConfig include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # Supported file formats for BigLake managed tables. module FileFormat # Default value. FILE_FORMAT_UNSPECIFIED = 0 # Parquet file format. PARQUET = 1 end # Supported table formats for BigLake managed tables. module TableFormat # Default value. TABLE_FORMAT_UNSPECIFIED = 0 # Iceberg table format. ICEBERG = 1 end end # AppendOnly mode defines that all changes to a table will be written to the # destination table. class AppendOnly include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end # Merge mode defines that all changes to a table will be merged at the # destination table. class Merge include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end end |
#blmt_config ⇒ ::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::BlmtConfig
Returns Optional. Big Lake Managed Tables (BLMT) configuration.
1283 1284 1285 1286 1287 1288 1289 1290 1291 1292 1293 1294 1295 1296 1297 1298 1299 1300 1301 1302 1303 1304 1305 1306 1307 1308 1309 1310 1311 1312 1313 1314 1315 1316 1317 1318 1319 1320 1321 1322 1323 1324 1325 1326 1327 1328 1329 1330 1331 1332 1333 1334 1335 1336 1337 1338 1339 1340 1341 1342 1343 1344 1345 1346 1347 1348 1349 1350 1351 1352 1353 1354 1355 1356 1357 1358 1359 1360 1361 1362 1363 1364 1365 1366 1367 1368 1369 1370 1371 1372 1373 1374 1375 1376 1377 1378 1379 1380 1381 1382 1383 1384 1385 1386 |
# File 'proto_docs/google/cloud/datastream/v1/datastream_resources.rb', line 1283 class BigQueryDestinationConfig include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # A single target dataset to which all data will be streamed. # @!attribute [rw] dataset_id # @return [::String] # The dataset ID of the target dataset. # DatasetIds allowed characters: # https://cloud.google.com/bigquery/docs/reference/rest/v2/datasets#datasetreference. class SingleTargetDataset include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end # Destination datasets are created so that hierarchy of the destination data # objects matches the source hierarchy. # @!attribute [rw] dataset_template # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::SourceHierarchyDatasets::DatasetTemplate] # The dataset template to use for dynamic dataset creation. class SourceHierarchyDatasets include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # Dataset template used for dynamic dataset creation. # @!attribute [rw] location # @return [::String] # Required. The geographic location where the dataset should reside. See # https://cloud.google.com/bigquery/docs/locations for supported # locations. # @!attribute [rw] dataset_id_prefix # @return [::String] # If supplied, every created dataset will have its name prefixed by the # provided value. The prefix and name will be separated by an underscore. # i.e. <prefix>_<dataset_name>. # @!attribute [rw] kms_key_name # @return [::String] # Describes the Cloud KMS encryption key that will be used to # protect destination BigQuery table. The BigQuery Service Account # associated with your project requires access to this encryption key. # i.e. # projects/\\{project}/locations/\\{location}/keyRings/\\{key_ring}/cryptoKeys/\\{cryptoKey}. # See https://cloud.google.com/bigquery/docs/customer-managed-encryption # for more information. class DatasetTemplate include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end end # The configuration for BLMT. # @!attribute [rw] bucket # @return [::String] # Required. The Cloud Storage bucket name. # @!attribute [rw] root_path # @return [::String] # The root path inside the Cloud Storage bucket. # @!attribute [rw] connection_name # @return [::String] # Required. The bigquery connection. # Format: `{project}.{location}.{name}` # @!attribute [rw] file_format # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::BlmtConfig::FileFormat] # Required. The file format. # @!attribute [rw] table_format # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::BlmtConfig::TableFormat] # Required. The table format. class BlmtConfig include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # Supported file formats for BigLake managed tables. module FileFormat # Default value. FILE_FORMAT_UNSPECIFIED = 0 # Parquet file format. PARQUET = 1 end # Supported table formats for BigLake managed tables. module TableFormat # Default value. TABLE_FORMAT_UNSPECIFIED = 0 # Iceberg table format. ICEBERG = 1 end end # AppendOnly mode defines that all changes to a table will be written to the # destination table. class AppendOnly include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end # Merge mode defines that all changes to a table will be merged at the # destination table. class Merge include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end end |
#data_freshness ⇒ ::Google::Protobuf::Duration
Returns The guaranteed data freshness (in seconds) when querying tables created by the stream. Editing this field will only affect new tables created in the future, but existing tables will not be impacted. Lower values mean that queries will return fresher data, but may result in higher cost.
1283 1284 1285 1286 1287 1288 1289 1290 1291 1292 1293 1294 1295 1296 1297 1298 1299 1300 1301 1302 1303 1304 1305 1306 1307 1308 1309 1310 1311 1312 1313 1314 1315 1316 1317 1318 1319 1320 1321 1322 1323 1324 1325 1326 1327 1328 1329 1330 1331 1332 1333 1334 1335 1336 1337 1338 1339 1340 1341 1342 1343 1344 1345 1346 1347 1348 1349 1350 1351 1352 1353 1354 1355 1356 1357 1358 1359 1360 1361 1362 1363 1364 1365 1366 1367 1368 1369 1370 1371 1372 1373 1374 1375 1376 1377 1378 1379 1380 1381 1382 1383 1384 1385 1386 |
# File 'proto_docs/google/cloud/datastream/v1/datastream_resources.rb', line 1283 class BigQueryDestinationConfig include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # A single target dataset to which all data will be streamed. # @!attribute [rw] dataset_id # @return [::String] # The dataset ID of the target dataset. # DatasetIds allowed characters: # https://cloud.google.com/bigquery/docs/reference/rest/v2/datasets#datasetreference. class SingleTargetDataset include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end # Destination datasets are created so that hierarchy of the destination data # objects matches the source hierarchy. # @!attribute [rw] dataset_template # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::SourceHierarchyDatasets::DatasetTemplate] # The dataset template to use for dynamic dataset creation. class SourceHierarchyDatasets include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # Dataset template used for dynamic dataset creation. # @!attribute [rw] location # @return [::String] # Required. The geographic location where the dataset should reside. See # https://cloud.google.com/bigquery/docs/locations for supported # locations. # @!attribute [rw] dataset_id_prefix # @return [::String] # If supplied, every created dataset will have its name prefixed by the # provided value. The prefix and name will be separated by an underscore. # i.e. <prefix>_<dataset_name>. # @!attribute [rw] kms_key_name # @return [::String] # Describes the Cloud KMS encryption key that will be used to # protect destination BigQuery table. The BigQuery Service Account # associated with your project requires access to this encryption key. # i.e. # projects/\\{project}/locations/\\{location}/keyRings/\\{key_ring}/cryptoKeys/\\{cryptoKey}. # See https://cloud.google.com/bigquery/docs/customer-managed-encryption # for more information. class DatasetTemplate include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end end # The configuration for BLMT. # @!attribute [rw] bucket # @return [::String] # Required. The Cloud Storage bucket name. # @!attribute [rw] root_path # @return [::String] # The root path inside the Cloud Storage bucket. # @!attribute [rw] connection_name # @return [::String] # Required. The bigquery connection. # Format: `{project}.{location}.{name}` # @!attribute [rw] file_format # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::BlmtConfig::FileFormat] # Required. The file format. # @!attribute [rw] table_format # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::BlmtConfig::TableFormat] # Required. The table format. class BlmtConfig include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # Supported file formats for BigLake managed tables. module FileFormat # Default value. FILE_FORMAT_UNSPECIFIED = 0 # Parquet file format. PARQUET = 1 end # Supported table formats for BigLake managed tables. module TableFormat # Default value. TABLE_FORMAT_UNSPECIFIED = 0 # Iceberg table format. ICEBERG = 1 end end # AppendOnly mode defines that all changes to a table will be written to the # destination table. class AppendOnly include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end # Merge mode defines that all changes to a table will be merged at the # destination table. class Merge include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end end |
#merge ⇒ ::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::Merge
Returns The standard mode
Note: The following fields are mutually exclusive: merge
, append_only
. If a field in that set is populated, all other fields in the set will automatically be cleared.
1283 1284 1285 1286 1287 1288 1289 1290 1291 1292 1293 1294 1295 1296 1297 1298 1299 1300 1301 1302 1303 1304 1305 1306 1307 1308 1309 1310 1311 1312 1313 1314 1315 1316 1317 1318 1319 1320 1321 1322 1323 1324 1325 1326 1327 1328 1329 1330 1331 1332 1333 1334 1335 1336 1337 1338 1339 1340 1341 1342 1343 1344 1345 1346 1347 1348 1349 1350 1351 1352 1353 1354 1355 1356 1357 1358 1359 1360 1361 1362 1363 1364 1365 1366 1367 1368 1369 1370 1371 1372 1373 1374 1375 1376 1377 1378 1379 1380 1381 1382 1383 1384 1385 1386 |
# File 'proto_docs/google/cloud/datastream/v1/datastream_resources.rb', line 1283 class BigQueryDestinationConfig include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # A single target dataset to which all data will be streamed. # @!attribute [rw] dataset_id # @return [::String] # The dataset ID of the target dataset. # DatasetIds allowed characters: # https://cloud.google.com/bigquery/docs/reference/rest/v2/datasets#datasetreference. class SingleTargetDataset include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end # Destination datasets are created so that hierarchy of the destination data # objects matches the source hierarchy. # @!attribute [rw] dataset_template # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::SourceHierarchyDatasets::DatasetTemplate] # The dataset template to use for dynamic dataset creation. class SourceHierarchyDatasets include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # Dataset template used for dynamic dataset creation. # @!attribute [rw] location # @return [::String] # Required. The geographic location where the dataset should reside. See # https://cloud.google.com/bigquery/docs/locations for supported # locations. # @!attribute [rw] dataset_id_prefix # @return [::String] # If supplied, every created dataset will have its name prefixed by the # provided value. The prefix and name will be separated by an underscore. # i.e. <prefix>_<dataset_name>. # @!attribute [rw] kms_key_name # @return [::String] # Describes the Cloud KMS encryption key that will be used to # protect destination BigQuery table. The BigQuery Service Account # associated with your project requires access to this encryption key. # i.e. # projects/\\{project}/locations/\\{location}/keyRings/\\{key_ring}/cryptoKeys/\\{cryptoKey}. # See https://cloud.google.com/bigquery/docs/customer-managed-encryption # for more information. class DatasetTemplate include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end end # The configuration for BLMT. # @!attribute [rw] bucket # @return [::String] # Required. The Cloud Storage bucket name. # @!attribute [rw] root_path # @return [::String] # The root path inside the Cloud Storage bucket. # @!attribute [rw] connection_name # @return [::String] # Required. The bigquery connection. # Format: `{project}.{location}.{name}` # @!attribute [rw] file_format # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::BlmtConfig::FileFormat] # Required. The file format. # @!attribute [rw] table_format # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::BlmtConfig::TableFormat] # Required. The table format. class BlmtConfig include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # Supported file formats for BigLake managed tables. module FileFormat # Default value. FILE_FORMAT_UNSPECIFIED = 0 # Parquet file format. PARQUET = 1 end # Supported table formats for BigLake managed tables. module TableFormat # Default value. TABLE_FORMAT_UNSPECIFIED = 0 # Iceberg table format. ICEBERG = 1 end end # AppendOnly mode defines that all changes to a table will be written to the # destination table. class AppendOnly include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end # Merge mode defines that all changes to a table will be merged at the # destination table. class Merge include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end end |
#single_target_dataset ⇒ ::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::SingleTargetDataset
Returns Single destination dataset.
Note: The following fields are mutually exclusive: single_target_dataset
, source_hierarchy_datasets
. If a field in that set is populated, all other fields in the set will automatically be cleared.
1283 1284 1285 1286 1287 1288 1289 1290 1291 1292 1293 1294 1295 1296 1297 1298 1299 1300 1301 1302 1303 1304 1305 1306 1307 1308 1309 1310 1311 1312 1313 1314 1315 1316 1317 1318 1319 1320 1321 1322 1323 1324 1325 1326 1327 1328 1329 1330 1331 1332 1333 1334 1335 1336 1337 1338 1339 1340 1341 1342 1343 1344 1345 1346 1347 1348 1349 1350 1351 1352 1353 1354 1355 1356 1357 1358 1359 1360 1361 1362 1363 1364 1365 1366 1367 1368 1369 1370 1371 1372 1373 1374 1375 1376 1377 1378 1379 1380 1381 1382 1383 1384 1385 1386 |
# File 'proto_docs/google/cloud/datastream/v1/datastream_resources.rb', line 1283 class BigQueryDestinationConfig include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # A single target dataset to which all data will be streamed. # @!attribute [rw] dataset_id # @return [::String] # The dataset ID of the target dataset. # DatasetIds allowed characters: # https://cloud.google.com/bigquery/docs/reference/rest/v2/datasets#datasetreference. class SingleTargetDataset include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end # Destination datasets are created so that hierarchy of the destination data # objects matches the source hierarchy. # @!attribute [rw] dataset_template # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::SourceHierarchyDatasets::DatasetTemplate] # The dataset template to use for dynamic dataset creation. class SourceHierarchyDatasets include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # Dataset template used for dynamic dataset creation. # @!attribute [rw] location # @return [::String] # Required. The geographic location where the dataset should reside. See # https://cloud.google.com/bigquery/docs/locations for supported # locations. # @!attribute [rw] dataset_id_prefix # @return [::String] # If supplied, every created dataset will have its name prefixed by the # provided value. The prefix and name will be separated by an underscore. # i.e. <prefix>_<dataset_name>. # @!attribute [rw] kms_key_name # @return [::String] # Describes the Cloud KMS encryption key that will be used to # protect destination BigQuery table. The BigQuery Service Account # associated with your project requires access to this encryption key. # i.e. # projects/\\{project}/locations/\\{location}/keyRings/\\{key_ring}/cryptoKeys/\\{cryptoKey}. # See https://cloud.google.com/bigquery/docs/customer-managed-encryption # for more information. class DatasetTemplate include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end end # The configuration for BLMT. # @!attribute [rw] bucket # @return [::String] # Required. The Cloud Storage bucket name. # @!attribute [rw] root_path # @return [::String] # The root path inside the Cloud Storage bucket. # @!attribute [rw] connection_name # @return [::String] # Required. The bigquery connection. # Format: `{project}.{location}.{name}` # @!attribute [rw] file_format # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::BlmtConfig::FileFormat] # Required. The file format. # @!attribute [rw] table_format # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::BlmtConfig::TableFormat] # Required. The table format. class BlmtConfig include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # Supported file formats for BigLake managed tables. module FileFormat # Default value. FILE_FORMAT_UNSPECIFIED = 0 # Parquet file format. PARQUET = 1 end # Supported table formats for BigLake managed tables. module TableFormat # Default value. TABLE_FORMAT_UNSPECIFIED = 0 # Iceberg table format. ICEBERG = 1 end end # AppendOnly mode defines that all changes to a table will be written to the # destination table. class AppendOnly include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end # Merge mode defines that all changes to a table will be merged at the # destination table. class Merge include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end end |
#source_hierarchy_datasets ⇒ ::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::SourceHierarchyDatasets
Returns Source hierarchy datasets.
Note: The following fields are mutually exclusive: source_hierarchy_datasets
, single_target_dataset
. If a field in that set is populated, all other fields in the set will automatically be cleared.
1283 1284 1285 1286 1287 1288 1289 1290 1291 1292 1293 1294 1295 1296 1297 1298 1299 1300 1301 1302 1303 1304 1305 1306 1307 1308 1309 1310 1311 1312 1313 1314 1315 1316 1317 1318 1319 1320 1321 1322 1323 1324 1325 1326 1327 1328 1329 1330 1331 1332 1333 1334 1335 1336 1337 1338 1339 1340 1341 1342 1343 1344 1345 1346 1347 1348 1349 1350 1351 1352 1353 1354 1355 1356 1357 1358 1359 1360 1361 1362 1363 1364 1365 1366 1367 1368 1369 1370 1371 1372 1373 1374 1375 1376 1377 1378 1379 1380 1381 1382 1383 1384 1385 1386 |
# File 'proto_docs/google/cloud/datastream/v1/datastream_resources.rb', line 1283 class BigQueryDestinationConfig include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # A single target dataset to which all data will be streamed. # @!attribute [rw] dataset_id # @return [::String] # The dataset ID of the target dataset. # DatasetIds allowed characters: # https://cloud.google.com/bigquery/docs/reference/rest/v2/datasets#datasetreference. class SingleTargetDataset include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end # Destination datasets are created so that hierarchy of the destination data # objects matches the source hierarchy. # @!attribute [rw] dataset_template # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::SourceHierarchyDatasets::DatasetTemplate] # The dataset template to use for dynamic dataset creation. class SourceHierarchyDatasets include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # Dataset template used for dynamic dataset creation. # @!attribute [rw] location # @return [::String] # Required. The geographic location where the dataset should reside. See # https://cloud.google.com/bigquery/docs/locations for supported # locations. # @!attribute [rw] dataset_id_prefix # @return [::String] # If supplied, every created dataset will have its name prefixed by the # provided value. The prefix and name will be separated by an underscore. # i.e. <prefix>_<dataset_name>. # @!attribute [rw] kms_key_name # @return [::String] # Describes the Cloud KMS encryption key that will be used to # protect destination BigQuery table. The BigQuery Service Account # associated with your project requires access to this encryption key. # i.e. # projects/\\{project}/locations/\\{location}/keyRings/\\{key_ring}/cryptoKeys/\\{cryptoKey}. # See https://cloud.google.com/bigquery/docs/customer-managed-encryption # for more information. class DatasetTemplate include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end end # The configuration for BLMT. # @!attribute [rw] bucket # @return [::String] # Required. The Cloud Storage bucket name. # @!attribute [rw] root_path # @return [::String] # The root path inside the Cloud Storage bucket. # @!attribute [rw] connection_name # @return [::String] # Required. The bigquery connection. # Format: `{project}.{location}.{name}` # @!attribute [rw] file_format # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::BlmtConfig::FileFormat] # Required. The file format. # @!attribute [rw] table_format # @return [::Google::Cloud::Datastream::V1::BigQueryDestinationConfig::BlmtConfig::TableFormat] # Required. The table format. class BlmtConfig include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # Supported file formats for BigLake managed tables. module FileFormat # Default value. FILE_FORMAT_UNSPECIFIED = 0 # Parquet file format. PARQUET = 1 end # Supported table formats for BigLake managed tables. module TableFormat # Default value. TABLE_FORMAT_UNSPECIFIED = 0 # Iceberg table format. ICEBERG = 1 end end # AppendOnly mode defines that all changes to a table will be written to the # destination table. class AppendOnly include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end # Merge mode defines that all changes to a table will be merged at the # destination table. class Merge include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end end |