Class: Google::Cloud::Dataproc::V1::Job

Inherits:

Object

• Object
• Google::Cloud::Dataproc::V1::Job

Defined in:

lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb

Overview

A Dataproc job resource.

Instance Attribute Summary

• #driver_control_files_uri ⇒ String

  Output only.

• #driver_output_resource_uri ⇒ String

  Output only.

• #hadoop_job ⇒ Google::Cloud::Dataproc::V1::HadoopJob

  Optional.

• #hive_job ⇒ Google::Cloud::Dataproc::V1::HiveJob

  Optional.

• #job_uuid ⇒ String

  Output only.

• #labels ⇒ Hash{String => String}

  Optional.

• #pig_job ⇒ Google::Cloud::Dataproc::V1::PigJob

  Optional.

• #placement ⇒ Google::Cloud::Dataproc::V1::JobPlacement

  Required.

• #presto_job ⇒ Google::Cloud::Dataproc::V1::PrestoJob

  Optional.

• #pyspark_job ⇒ Google::Cloud::Dataproc::V1::PySparkJob

  Optional.

• #reference ⇒ Google::Cloud::Dataproc::V1::JobReference

  Optional.

• #scheduling ⇒ Google::Cloud::Dataproc::V1::JobScheduling

  Optional.

• #spark_job ⇒ Google::Cloud::Dataproc::V1::SparkJob

  Optional.

• #spark_r_job ⇒ Google::Cloud::Dataproc::V1::SparkRJob

  Optional.

• #spark_sql_job ⇒ Google::Cloud::Dataproc::V1::SparkSqlJob

  Optional.

• #status ⇒ Google::Cloud::Dataproc::V1::JobStatus

  Output only.

• #status_history ⇒ Array<Google::Cloud::Dataproc::V1::JobStatus>

  Output only.

• #yarn_applications ⇒ Array<Google::Cloud::Dataproc::V1::YarnApplication>

  Output only.

Instance Attribute Details

#driver_control_files_uri ⇒ String

Returns Output only. If present, the location of miscellaneous control files which may be used as part of job setup and handling. If not present, control files may be placed in the same location as driver_output_uri.

Returns:

• (String) —

  Output only. If present, the location of miscellaneous control files which may be used as part of job setup and handling. If not present, control files may be placed in the same location as driver_output_uri.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#driver_output_resource_uri ⇒ String

Returns Output only. A URI pointing to the location of the stdout of the job's driver program.

Returns:

• (String) —

  Output only. A URI pointing to the location of the stdout of the job's driver program.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#hadoop_job ⇒ Google::Cloud::Dataproc::V1::HadoopJob

Returns Optional. Job is a Hadoop job.

Returns:

• (Google::Cloud::Dataproc::V1::HadoopJob) —

  Optional. Job is a Hadoop job.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#hive_job ⇒ Google::Cloud::Dataproc::V1::HiveJob

Returns Optional. Job is a Hive job.

Returns:

• (Google::Cloud::Dataproc::V1::HiveJob) —

  Optional. Job is a Hive job.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#job_uuid ⇒ String

Returns Output only. A UUID that uniquely identifies a job within the project over time. This is in contrast to a user-settable reference.job_id that may be reused over time.

Returns:

• (String) —

  Output only. A UUID that uniquely identifies a job within the project over time. This is in contrast to a user-settable reference.job_id that may be reused over time.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#labels ⇒ Hash{String => String}

Returns Optional. The labels to associate with this job. Label keys must contain 1 to 63 characters, and must conform to RFC 1035. Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035. No more than 32 labels can be associated with a job.

Returns:

• (Hash{String => String}) —

  Optional. The labels to associate with this job. Label keys must contain 1 to 63 characters, and must conform to RFC 1035. Label values may be empty, but, if present, must contain 1 to 63 characters, and must conform to RFC 1035. No more than 32 labels can be associated with a job.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#pig_job ⇒ Google::Cloud::Dataproc::V1::PigJob

Returns Optional. Job is a Pig job.

Returns:

• (Google::Cloud::Dataproc::V1::PigJob) —

  Optional. Job is a Pig job.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#placement ⇒ Google::Cloud::Dataproc::V1::JobPlacement

Returns Required. Job information, including how, when, and where to run the job.

Returns:

• (Google::Cloud::Dataproc::V1::JobPlacement) —

  Required. Job information, including how, when, and where to run the job.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#presto_job ⇒ Google::Cloud::Dataproc::V1::PrestoJob

Returns Optional. Job is a Presto job.

Returns:

• (Google::Cloud::Dataproc::V1::PrestoJob) —

  Optional. Job is a Presto job.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#pyspark_job ⇒ Google::Cloud::Dataproc::V1::PySparkJob

Returns Optional. Job is a PySpark job.

Returns:

• (Google::Cloud::Dataproc::V1::PySparkJob) —

  Optional. Job is a PySpark job.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#reference ⇒ Google::Cloud::Dataproc::V1::JobReference

Returns Optional. The fully qualified reference to the job, which can be used to obtain the equivalent REST path of the job resource. If this property is not specified when a job is created, the server generates a job_id.

Returns:

• (Google::Cloud::Dataproc::V1::JobReference) —

  Optional. The fully qualified reference to the job, which can be used to obtain the equivalent REST path of the job resource. If this property is not specified when a job is created, the server generates a job_id.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#scheduling ⇒ Google::Cloud::Dataproc::V1::JobScheduling

Returns Optional. Job scheduling configuration.

Returns:

• (Google::Cloud::Dataproc::V1::JobScheduling) —

  Optional. Job scheduling configuration.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#spark_job ⇒ Google::Cloud::Dataproc::V1::SparkJob

Returns Optional. Job is a Spark job.

Returns:

• (Google::Cloud::Dataproc::V1::SparkJob) —

  Optional. Job is a Spark job.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#spark_r_job ⇒ Google::Cloud::Dataproc::V1::SparkRJob

Returns Optional. Job is a SparkR job.

Returns:

• (Google::Cloud::Dataproc::V1::SparkRJob) —

  Optional. Job is a SparkR job.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#spark_sql_job ⇒ Google::Cloud::Dataproc::V1::SparkSqlJob

Returns Optional. Job is a SparkSql job.

Returns:

• (Google::Cloud::Dataproc::V1::SparkSqlJob) —

  Optional. Job is a SparkSql job.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#status ⇒ Google::Cloud::Dataproc::V1::JobStatus

Returns Output only. The job status. Additional application-specific status information may be contained in the type_job and yarn_applications fields.

Returns:

• (Google::Cloud::Dataproc::V1::JobStatus) —

  Output only. The job status. Additional application-specific status information may be contained in the type_job and yarn_applications fields.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#status_history ⇒ Array<Google::Cloud::Dataproc::V1::JobStatus>

Returns Output only. The previous job status.

Returns:

• (Array<Google::Cloud::Dataproc::V1::JobStatus>) —

  Output only. The previous job status.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end

#yarn_applications ⇒ Array<Google::Cloud::Dataproc::V1::YarnApplication>

Returns Output only. The collection of YARN applications spun up by this job.

Beta Feature: This report is available for testing purposes only. It may be changed before final release.

Returns:

• (Array<Google::Cloud::Dataproc::V1::YarnApplication>) —

  Output only. The collection of YARN applications spun up by this job.

  Beta Feature: This report is available for testing purposes only. It may be changed before final release.

# File 'lib/google/cloud/dataproc/v1/doc/google/cloud/dataproc/v1/jobs.rb', line 586

class Job; end