- NAME
-
- gcloud alpha dataproc clusters create - create a cluster
- SYNOPSIS
-
-
gcloud alpha dataproc clusters create(CLUSTER:--region=REGION) [--async] [--autoscaling-policy=AUTOSCALING_POLICY] [--bucket=BUCKET] [--cluster-type=TYPE] [--delete-max-idle=DELETE_MAX_IDLE] [--driver-pool-accelerator=[type=TYPE,[count=COUNT],…]] [--driver-pool-boot-disk-size=DRIVER_POOL_BOOT_DISK_SIZE] [--driver-pool-boot-disk-type=DRIVER_POOL_BOOT_DISK_TYPE] [--driver-pool-id=DRIVER_POOL_ID] [--driver-pool-local-ssd-interface=DRIVER_POOL_LOCAL_SSD_INTERFACE] [--driver-pool-machine-type=DRIVER_POOL_MACHINE_TYPE] [--driver-pool-min-cpu-platform=PLATFORM] [--driver-pool-size=DRIVER_POOL_SIZE] [--enable-component-gateway] [--engine=ENGINE] [--initialization-action-timeout=TIMEOUT; default="10m"] [--initialization-actions=CLOUD_STORAGE_URI,[…]] [--labels=[KEY=VALUE,…]] [--master-accelerator=[type=TYPE,[count=COUNT],…]] [--master-attached-disks=MASTER_ATTACHED_DISKS] [--master-boot-disk-provisioned-iops=MASTER_BOOT_DISK_PROVISIONED_IOPS] [--master-boot-disk-provisioned-throughput=MASTER_BOOT_DISK_PROVISIONED_THROUGHPUT] [--master-boot-disk-size=MASTER_BOOT_DISK_SIZE] [--master-boot-disk-type=MASTER_BOOT_DISK_TYPE] [--master-local-ssd-interface=MASTER_LOCAL_SSD_INTERFACE] [--master-machine-type=MASTER_MACHINE_TYPE] [--master-min-cpu-platform=PLATFORM] [--min-secondary-worker-fraction=MIN_SECONDARY_WORKER_FRACTION] [--node-group=NODE_GROUP] [--num-driver-pool-local-ssds=NUM_DRIVER_POOL_LOCAL_SSDS] [--num-master-local-ssds=NUM_MASTER_LOCAL_SSDS] [--num-masters=NUM_MASTERS] [--num-secondary-worker-local-ssds=NUM_SECONDARY_WORKER_LOCAL_SSDS] [--num-worker-local-ssds=NUM_WORKER_LOCAL_SSDS] [--optional-components=[COMPONENT,…]] [--private-ipv6-google-access-type=PRIVATE_IPV6_GOOGLE_ACCESS_TYPE] [--properties=[PREFIX:PROPERTY=VALUE,…]] [--secondary-worker-accelerator=[type=TYPE,[count=COUNT],…]] [--secondary-worker-attached-disks=SECONDARY_WORKER_ATTACHED_DISKS] [--secondary-worker-boot-disk-size=SECONDARY_WORKER_BOOT_DISK_SIZE] [--secondary-worker-boot-disk-type=SECONDARY_WORKER_BOOT_DISK_TYPE] [--secondary-worker-local-ssd-interface=SECONDARY_WORKER_LOCAL_SSD_INTERFACE] [--secondary-worker-machine-types=type=MACHINE_TYPE[,type=MACHINE_TYPE…][,rank=RANK]] [--secondary-worker-standard-capacity-base=SECONDARY_WORKER_STANDARD_CAPACITY_BASE] [--secondary-worker-standard-capacity-percent-above-base=SECONDARY_WORKER_STANDARD_CAPACITY_PERCENT_ABOVE_BASE] [--shielded-integrity-monitoring] [--shielded-secure-boot] [--shielded-vtpm] [--stop-max-idle=STOP_MAX_IDLE] [--temp-bucket=TEMP_BUCKET] [--worker-accelerator=[type=TYPE,[count=COUNT],…]] [--worker-attached-disks=WORKER_ATTACHED_DISKS] [--worker-boot-disk-provisioned-iops=WORKER_BOOT_DISK_PROVISIONED_IOPS] [--worker-boot-disk-provisioned-throughput=WORKER_BOOT_DISK_PROVISIONED_THROUGHPUT] [--worker-boot-disk-size=WORKER_BOOT_DISK_SIZE] [--worker-boot-disk-type=WORKER_BOOT_DISK_TYPE] [--worker-local-ssd-interface=WORKER_LOCAL_SSD_INTERFACE] [--worker-min-cpu-platform=PLATFORM] [--auto-zone-exclude-zones=[ZONE,…] |--zone=ZONE,-zZONE] [--dataproc-metastore=DATAPROC_METASTORE|--bigquery-metastore--bigquery-metastore-database-location=BIGQUERY_METASTORE_DATABASE_LOCATION--bigquery-metastore-project-id=BIGQUERY_METASTORE_PROJECT_ID] [--delete-expiration-time=DELETE_EXPIRATION_TIME|--delete-max-age=DELETE_MAX_AGE] [--gce-pd-kms-key=GCE_PD_KMS_KEY:--gce-pd-kms-key-keyring=GCE_PD_KMS_KEY_KEYRING--gce-pd-kms-key-location=GCE_PD_KMS_KEY_LOCATION--gce-pd-kms-key-project=GCE_PD_KMS_KEY_PROJECT] [--metadata=KEY=VALUE,[KEY=VALUE,…]--resource-manager-tags=KEY=VALUE,[KEY=VALUE,…]--scopes=SCOPE,[SCOPE,…]--service-account=SERVICE_ACCOUNT--tags=TAG,[TAG,…]--network=NETWORK|--subnet=SUBNET--reservation=RESERVATION--reservation-affinity=RESERVATION_AFFINITY; default="any"] [--image=IMAGE|--image-version=VERSION] [--kerberos-config-file=KERBEROS_CONFIG_FILE|--enable-kerberos--kerberos-root-principal-password-uri=KERBEROS_ROOT_PRINCIPAL_PASSWORD_URI[--kerberos-kms-key=KERBEROS_KMS_KEY:--kerberos-kms-key-keyring=KERBEROS_KMS_KEY_KEYRING--kerberos-kms-key-location=KERBEROS_KMS_KEY_LOCATION--kerberos-kms-key-project=KERBEROS_KMS_KEY_PROJECT]] [--kms-key=KMS_KEY:--kms-keyring=KMS_KEYRING--kms-location=KMS_LOCATION--kms-project=KMS_PROJECT] [--no-address|--public-ip-address] [--single-node|--min-num-workers=MIN_NUM_WORKERS--num-secondary-workers=NUM_SECONDARY_WORKERS--num-workers=NUM_WORKERS--secondary-worker-type=TYPE; default="preemptible"] [--stop-expiration-time=STOP_EXPIRATION_TIME|--stop-max-age=STOP_MAX_AGE] [--worker-machine-type=WORKER_MACHINE_TYPE|--worker-machine-types=type=MACHINE_TYPE[,type=MACHINE_TYPE…][,rank=RANK]] [GCLOUD_WIDE_FLAG …]
-
- DESCRIPTION
-
(ALPHA)Create a cluster. - EXAMPLES
-
To create a cluster, run:
gcloud alpha dataproc clusters create my-cluster --region=us-central1 - POSITIONAL ARGUMENTS
-
-
Cluster resource - The name of the cluster to create. The arguments in this
group can be used to specify the attributes of this resource. (NOTE) Some
attributes are not given arguments in this group but can be set in other ways.
To set the
projectattribute:-
provide the argument
clusteron the command line with a fully specified name; -
provide the argument
--projecton the command line; -
set the property
core/project.
This must be specified.
CLUSTER-
ID of the cluster or fully qualified identifier for the cluster.
To set the
clusterattribute:-
provide the argument
clusteron the command line.
This positional argument must be specified if any of the other arguments in this group are specified.
-
provide the argument
--region=REGION-
Dataproc region for the cluster. Each Dataproc region constitutes an independent
resource namespace constrained to deploying instances into Compute Engine zones
inside the region. Overrides the default
dataproc/regionproperty value for this command invocation.To set the
regionattribute:-
provide the argument
clusteron the command line with a fully specified name; -
provide the argument
--regionon the command line; -
set the property
dataproc/region.
-
provide the argument
-
provide the argument
-
Cluster resource - The name of the cluster to create. The arguments in this
group can be used to specify the attributes of this resource. (NOTE) Some
attributes are not given arguments in this group but can be set in other ways.
- FLAGS
-
--async- Return immediately, without waiting for the operation in progress to complete.
--autoscaling-policy=AUTOSCALING_POLICY-
ID of the autoscaling policy or fully qualified identifier for the autoscaling
policy.
To set the
autoscaling_policyattribute:-
provide the argument
--autoscaling-policyon the command line.
-
provide the argument
--bucket=BUCKET- The Google Cloud Storage bucket to use by default to stage job dependencies, miscellaneous config files, and job driver console output when using this cluster.
--cluster-type=TYPE-
The type of cluster.
TYPEmust be one of:standard,single-node,zero-scale. --delete-max-idle=DELETE_MAX_IDLE- The duration after the last job completes to auto-delete the cluster, such as "2h" or "1d". See $ gcloud topic datetimes for information on duration formats.
--driver-pool-accelerator=[type=TYPE,[count=COUNT],…]-
Attaches accelerators, such as GPUs, to the driver-pool instance(s).
type-
The specific type of accelerator to attach to the instances, such as
nvidia-tesla-t4for NVIDIA T4. Usegcloud compute accelerator-types listto display available accelerator types. count- The number of accelerators to attach to each instance. The default value is 1.
--driver-pool-boot-disk-size=DRIVER_POOL_BOOT_DISK_SIZE-
The size of the boot disk. The value must be a whole number followed by a size
unit of
for kilobyte,KBfor megabyte,MBfor gigabyte, orGBfor terabyte. For example,TBwill produce a 10 gigabyte disk. The minimum size a10GB