Class: Google::Cloud::Dataproc::V1beta2::ClusterConfig

Inherits:
Object
  • Object
show all
Defined in:
lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb

Overview

The cluster config.

Instance Attribute Summary collapse

Instance Attribute Details

#config_bucket ⇒ String

Returns Optional. A Cloud Storage staging bucket used for sharing generated SSH keys and config. If you do not specify a staging bucket, Cloud Dataproc will determine an appropriate Cloud Storage location (US, ASIA, or EU) for your cluster's staging bucket according to the Google Compute Engine zone where your cluster is deployed, and then it will create and manage this project-level, per-location bucket for you.

Returns:

  • (String) —

    Optional. A Cloud Storage staging bucket used for sharing generated SSH keys and config. If you do not specify a staging bucket, Cloud Dataproc will determine an appropriate Cloud Storage location (US, ASIA, or EU) for your cluster's staging bucket according to the Google Compute Engine zone where your cluster is deployed, and then it will create and manage this project-level, per-location bucket for you.



106
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 106

class ClusterConfig; end

#encryption_config ⇒ Google::Cloud::Dataproc::V1beta2::EncryptionConfig

Returns Optional. Encryption settings for the cluster.

Returns:



106
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 106

class ClusterConfig; end

#gce_cluster_config ⇒ Google::Cloud::Dataproc::V1beta2::GceClusterConfig

Returns Required. The shared Compute Engine config settings for all instances in a cluster.

Returns:



106
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 106

class ClusterConfig; end

#initialization_actions ⇒ Array<Google::Cloud::Dataproc::V1beta2::NodeInitializationAction>

Returns Optional. Commands to execute on each node after config is completed. By default, executables are run on master and all worker nodes. You can test a node's role metadata to run an executable on a master or worker node, as shown below using curl (you can also use wget):

ROLE=$(curl -H Metadata-Flavor:Google http://metadata/computeMetadata/v1beta2/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
  ... master specific actions ...
else
  ... worker specific actions ...
fi.

Returns:

  • (Array<Google::Cloud::Dataproc::V1beta2::NodeInitializationAction>) —

    Optional. Commands to execute on each node after config is completed. By default, executables are run on master and all worker nodes. You can test a node's role metadata to run an executable on a master or worker node, as shown below using curl (you can also use wget):

    ROLE=$(curl -H Metadata-Flavor:Google http://metadata/computeMetadata/v1beta2/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
  ... master specific actions ...
else
  ... worker specific actions ...
fi



106
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 106

class ClusterConfig; end

#lifecycle_config ⇒ Google::Cloud::Dataproc::V1beta2::LifecycleConfig

Returns Optional. The config setting for auto delete cluster schedule.

Returns:



106
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 106

class ClusterConfig; end

#master_config ⇒ Google::Cloud::Dataproc::V1beta2::InstanceGroupConfig

Returns Optional. The Compute Engine config settings for the master instance in a cluster.

Returns:



106
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 106

class ClusterConfig; end

#secondary_worker_config ⇒ Google::Cloud::Dataproc::V1beta2::InstanceGroupConfig

Returns Optional. The Compute Engine config settings for additional worker instances in a cluster.

Returns:



106
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 106

class ClusterConfig; end

#software_config ⇒ Google::Cloud::Dataproc::V1beta2::SoftwareConfig

Returns Optional. The config settings for software inside the cluster.

Returns:



106
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 106

class ClusterConfig; end

#worker_config ⇒ Google::Cloud::Dataproc::V1beta2::InstanceGroupConfig

Returns Optional. The Compute Engine config settings for worker instances in a cluster.

Returns:



106
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 106

class ClusterConfig; end