Class: Google::Cloud::Dataproc::V1beta2::Job

Inherits:

Object

• Object
• Google::Cloud::Dataproc::V1beta2::Job

Defined in:

lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb

Overview

A Dataproc job resource.

Instance Attribute Summary

• #driver_control_files_uri ⇒ String

  Output only.

• #driver_output_resource_uri ⇒ String

  Output only.

• #hadoop_job ⇒ Google::Cloud::Dataproc::V1beta2::HadoopJob
• #hive_job ⇒ Google::Cloud::Dataproc::V1beta2::HiveJob
• #job_uuid ⇒ String

  Output only.

• #labels ⇒ Hash{String => String}

  Optional.

• #pig_job ⇒ Google::Cloud::Dataproc::V1beta2::PigJob
• #placement ⇒ Google::Cloud::Dataproc::V1beta2::JobPlacement

  Required.

• #pyspark_job ⇒ Google::Cloud::Dataproc::V1beta2::PySparkJob
• #reference ⇒ Google::Cloud::Dataproc::V1beta2::JobReference

  Optional.

• #scheduling ⇒ Google::Cloud::Dataproc::V1beta2::JobScheduling

  Optional.

• #spark_job ⇒ Google::Cloud::Dataproc::V1beta2::SparkJob
• #spark_r_job ⇒ Google::Cloud::Dataproc::V1beta2::SparkRJob
• #spark_sql_job ⇒ Google::Cloud::Dataproc::V1beta2::SparkSqlJob
• #status ⇒ Google::Cloud::Dataproc::V1beta2::JobStatus

  Output only.

• #status_history ⇒ Array<Google::Cloud::Dataproc::V1beta2::JobStatus>

  Output only.

• #submitted_by ⇒ String

  Output only.

• #yarn_applications ⇒ Array<Google::Cloud::Dataproc::V1beta2::YarnApplication>

  Output only.

Instance Attribute Details

#driver_control_files_uri ⇒ String

Returns Output only. If present, the location of miscellaneous control files which may be used as part of job setup and handling. If not present, control files may be placed in the same location as driver_output_uri.

Returns:

• (String) —

  Output only. If present, the location of miscellaneous control files which may be used as part of job setup and handling. If not present, control files may be placed in the same location as driver_output_uri.

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#driver_output_resource_uri ⇒ String

Returns Output only. A URI pointing to the location of the stdout of the job's driver program.

Returns:

• (String) —

  Output only. A URI pointing to the location of the stdout of the job's driver program.

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#hadoop_job ⇒ Google::Cloud::Dataproc::V1beta2::HadoopJob

Returns:

• (Google::Cloud::Dataproc::V1beta2::HadoopJob)

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#hive_job ⇒ Google::Cloud::Dataproc::V1beta2::HiveJob

Returns:

• (Google::Cloud::Dataproc::V1beta2::HiveJob)

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#job_uuid ⇒ String

Returns Output only. A UUID that uniquely identifies a job within the project over time. This is in contrast to a user-settable reference.job_id that may be reused over time.

Returns:

• (String) —

  Output only. A UUID that uniquely identifies a job within the project over time. This is in contrast to a user-settable reference.job_id that may be reused over time.

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#labels ⇒ Hash{String => String}

Returns Optional. The labels to associate with this job. Label keys must contain 1 to 63 characters, and must conform to RFC 1035. Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035. No more than 32 labels can be associated with a job.

Returns:

• (Hash{String => String}) —

  Optional. The labels to associate with this job. Label keys must contain 1 to 63 characters, and must conform to RFC 1035. Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035. No more than 32 labels can be associated with a job.

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#pig_job ⇒ Google::Cloud::Dataproc::V1beta2::PigJob

Returns:

• (Google::Cloud::Dataproc::V1beta2::PigJob)

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#placement ⇒ Google::Cloud::Dataproc::V1beta2::JobPlacement

Returns Required. Job information, including how, when, and where to run the job.

Returns:

• (Google::Cloud::Dataproc::V1beta2::JobPlacement) —

  Required. Job information, including how, when, and where to run the job.

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#pyspark_job ⇒ Google::Cloud::Dataproc::V1beta2::PySparkJob

Returns:

• (Google::Cloud::Dataproc::V1beta2::PySparkJob)

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#reference ⇒ Google::Cloud::Dataproc::V1beta2::JobReference

Returns Optional. The fully qualified reference to the job, which can be used to obtain the equivalent REST path of the job resource. If this property is not specified when a job is created, the server generates a job_id.

Returns:

• (Google::Cloud::Dataproc::V1beta2::JobReference) —

  Optional. The fully qualified reference to the job, which can be used to obtain the equivalent REST path of the job resource. If this property is not specified when a job is created, the server generates a job_id.

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#scheduling ⇒ Google::Cloud::Dataproc::V1beta2::JobScheduling

Returns Optional. Job scheduling configuration.

Returns:

• (Google::Cloud::Dataproc::V1beta2::JobScheduling) —

  Optional. Job scheduling configuration.

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#spark_job ⇒ Google::Cloud::Dataproc::V1beta2::SparkJob

Returns:

• (Google::Cloud::Dataproc::V1beta2::SparkJob)

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#spark_r_job ⇒ Google::Cloud::Dataproc::V1beta2::SparkRJob

Returns:

• (Google::Cloud::Dataproc::V1beta2::SparkRJob)

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#spark_sql_job ⇒ Google::Cloud::Dataproc::V1beta2::SparkSqlJob

Returns:

• (Google::Cloud::Dataproc::V1beta2::SparkSqlJob)

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#status ⇒ Google::Cloud::Dataproc::V1beta2::JobStatus

Returns Output only. The job status. Additional application-specific status information may be contained in the type_job and yarn_applications fields.

Returns:

• (Google::Cloud::Dataproc::V1beta2::JobStatus) —

  Output only. The job status. Additional application-specific status information may be contained in the type_job and yarn_applications fields.

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#status_history ⇒ Array<Google::Cloud::Dataproc::V1beta2::JobStatus>

Returns Output only. The previous job status.

Returns:

• (Array<Google::Cloud::Dataproc::V1beta2::JobStatus>) —

  Output only. The previous job status.

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#submitted_by ⇒ String

Returns Output only. The email address of the user submitting the job. For jobs submitted on the cluster, the address is username@hostname.

Returns:

• (String) —

  Output only. The email address of the user submitting the job. For jobs submitted on the cluster, the address is username@hostname.

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end

#yarn_applications ⇒ Array<Google::Cloud::Dataproc::V1beta2::YarnApplication>

Returns Output only. The collection of YARN applications spun up by this job.

Beta Feature: This report is available for testing purposes only. It may be changed before final release.

Returns:

• (Array<Google::Cloud::Dataproc::V1beta2::YarnApplication>) —

  Output only. The collection of YARN applications spun up by this job.

  Beta Feature: This report is available for testing purposes only. It may be changed before final release.

# File 'lib/google/cloud/dataproc/v1beta2/doc/google/cloud/dataproc/v1beta2/jobs.rb', line 555

class Job; end