Class: Google::Cloud::Dataproc::V1beta2::ClusterConfig

Inherits:
Object
  • Object
show all
Defined in:
lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb

Overview

The cluster config.

Instance Attribute Summary collapse

Instance Attribute Details

#autoscaling_config ⇒ Google::Cloud::Dataproc::V1beta2::AutoscalingConfig

Returns Optional. Autoscaling config for the policy associated with the cluster. Cluster does not autoscale if this field is unset.

Returns:



122
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 122

class ClusterConfig; end

#config_bucket ⇒ String

Returns Optional. A Google Cloud Storage bucket used to stage job dependencies, config files, and job driver console output. If you do not specify a staging bucket, Cloud Dataproc will determine a Cloud Storage location (US, ASIA, or EU) for your cluster's staging bucket according to the Google Compute Engine zone where your cluster is deployed, and then create and manage this project-level, per-location bucket (see Cloud Dataproc staging bucket).

Returns:

  • (String) —

    Optional. A Google Cloud Storage bucket used to stage job dependencies, config files, and job driver console output. If you do not specify a staging bucket, Cloud Dataproc will determine a Cloud Storage location (US, ASIA, or EU) for your cluster's staging bucket according to the Google Compute Engine zone where your cluster is deployed, and then create and manage this project-level, per-location bucket (see Cloud Dataproc staging bucket).



122
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 122

class ClusterConfig; end

#encryption_config ⇒ Google::Cloud::Dataproc::V1beta2::EncryptionConfig

Returns Optional. Encryption settings for the cluster.

Returns:



122
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 122

class ClusterConfig; end

#endpoint_config ⇒ Google::Cloud::Dataproc::V1beta2::EndpointConfig

Returns Optional. Port/endpoint configuration for this cluster.

Returns:



122
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 122

class ClusterConfig; end

#gce_cluster_config ⇒ Google::Cloud::Dataproc::V1beta2::GceClusterConfig

Returns Optional. The shared Compute Engine config settings for all instances in a cluster.

Returns:



122
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 122

class ClusterConfig; end

#initialization_actions ⇒ Array<Google::Cloud::Dataproc::V1beta2::NodeInitializationAction>

Returns Optional. Commands to execute on each node after config is completed. By default, executables are run on master and all worker nodes. You can test a node's role metadata to run an executable on a master or worker node, as shown below using curl (you can also use wget):

ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1beta2/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
  ... master specific actions ...
else
  ... worker specific actions ...
fi.

Returns:

  • (Array<Google::Cloud::Dataproc::V1beta2::NodeInitializationAction>) —

    Optional. Commands to execute on each node after config is completed. By default, executables are run on master and all worker nodes. You can test a node's role metadata to run an executable on a master or worker node, as shown below using curl (you can also use wget):

    ROLE=$(curl -H Metadata-Flavor:Google
http://metadata/computeMetadata/v1beta2/instance/attributes/dataproc-role)
if [[ "${ROLE}" == 'Master' ]]; then
  ... master specific actions ...
else
  ... worker specific actions ...
fi



122
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 122

class ClusterConfig; end

#lifecycle_config ⇒ Google::Cloud::Dataproc::V1beta2::LifecycleConfig

Returns Optional. The config setting for auto delete cluster schedule.

Returns:



122
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 122

class ClusterConfig; end

#master_config ⇒ Google::Cloud::Dataproc::V1beta2::InstanceGroupConfig

Returns Optional. The Compute Engine config settings for the master instance in a cluster.

Returns:



122
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 122

class ClusterConfig; end

#secondary_worker_config ⇒ Google::Cloud::Dataproc::V1beta2::InstanceGroupConfig

Returns Optional. The Compute Engine config settings for additional worker instances in a cluster.

Returns:



122
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 122

class ClusterConfig; end

#security_config ⇒ Google::Cloud::Dataproc::V1beta2::SecurityConfig

Returns Optional. Security related configuration.

Returns:



122
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 122

class ClusterConfig; end

#software_config ⇒ Google::Cloud::Dataproc::V1beta2::SoftwareConfig

Returns Optional. The config settings for software inside the cluster.

Returns:



122
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 122

class ClusterConfig; end

#worker_config ⇒ Google::Cloud::Dataproc::V1beta2::InstanceGroupConfig

Returns Optional. The Compute Engine config settings for worker instances in a cluster.

Returns:



122
 
# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/clusters.rb', line 122

class ClusterConfig; end