Class: Google::Cloud::Dataproc::V1::ClusterConfig

Inherits:
Object
  • Object
show all
Defined in:
lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb

Overview

The cluster config.

Instance Attribute Summary collapse

Instance Attribute Details

#autoscaling_config ⇒ Google::Cloud::Dataproc::V1::AutoscalingConfig

Returns Optional. Autoscaling config for the policy associated with the cluster. Cluster does not autoscale if this field is unset.

Returns:



119
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 119

class ClusterConfig; end

#config_bucket ⇒ String

Returns Optional. A Cloud Storage bucket used to stage job dependencies, config files, and job driver console output. If you do not specify a staging bucket, Cloud Dataproc will determine a Cloud Storage location (US, ASIA, or EU) for your cluster's staging bucket according to the Compute Engine zone where your cluster is deployed, and then create and manage this project-level, per-location bucket (see Dataproc staging bucket).

Returns:

  • (String) —

    Optional. A Cloud Storage bucket used to stage job dependencies, config files, and job driver console output. If you do not specify a staging bucket, Cloud Dataproc will determine a Cloud Storage location (US, ASIA, or EU) for your cluster's staging bucket according to the Compute Engine zone where your cluster is deployed, and then create and manage this project-level, per-location bucket (see Dataproc staging bucket).



119
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 119

class ClusterConfig; end

#encryption_config ⇒ Google::Cloud::Dataproc::V1::EncryptionConfig

Returns Optional. Encryption settings for the cluster.

Returns:



119
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 119

class ClusterConfig; end

#gce_cluster_config ⇒ Google::Cloud::Dataproc::V1::GceClusterConfig

Returns Optional. The shared Compute Engine config settings for all instances in a cluster.

Returns:



119
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 119

class ClusterConfig; end

#initialization_actions ⇒ Array<Google::Cloud::Dataproc::V1::NodeInitializationAction>

Returns Optional. Commands to execute on each node after config is completed. By default, executables are run on master and all worker nodes. You can test a node's role metadata to run an executable on a master or worker node, as shown below using curl (you can also use wget):

ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
  ... master specific actions ...
else
  ... worker specific actions ...
fi.

Returns:

  • (Array<Google::Cloud::Dataproc::V1::NodeInitializationAction>) —

    Optional. Commands to execute on each node after config is completed. By default, executables are run on master and all worker nodes. You can test a node's role metadata to run an executable on a master or worker node, as shown below using curl (you can also use wget):

    ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
  ... master specific actions ...
else
  ... worker specific actions ...
fi



119
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 119

class ClusterConfig; end

#lifecycle_config ⇒ Google::Cloud::Dataproc::V1::LifecycleConfig

Returns Optional. Lifecycle setting for the cluster.

Returns:



119
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 119

class ClusterConfig; end

#master_config ⇒ Google::Cloud::Dataproc::V1::InstanceGroupConfig

Returns Optional. The Compute Engine config settings for the master instance in a cluster.

Returns:



119
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 119

class ClusterConfig; end

#secondary_worker_config ⇒ Google::Cloud::Dataproc::V1::InstanceGroupConfig

Returns Optional. The Compute Engine config settings for additional worker instances in a cluster.

Returns:



119
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 119

class ClusterConfig; end

#security_config ⇒ Google::Cloud::Dataproc::V1::SecurityConfig

Returns Optional. Security settings for the cluster.

Returns:



119
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 119

class ClusterConfig; end

#software_config ⇒ Google::Cloud::Dataproc::V1::SoftwareConfig

Returns Optional. The config settings for software inside the cluster.

Returns:



119
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 119

class ClusterConfig; end

#worker_config ⇒ Google::Cloud::Dataproc::V1::InstanceGroupConfig

Returns Optional. The Compute Engine config settings for worker instances in a cluster.

Returns:



119
 
# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/clusters.rb', line 119

class ClusterConfig; end