Class: Google::Apis::DataprocV1::PigJob

Inherits:
Object
  • Object
show all
Includes:
Core::Hashable, Core::JsonObjectSupport
Defined in:
generated/google/apis/dataproc_v1/classes.rb,
generated/google/apis/dataproc_v1/representations.rb,
generated/google/apis/dataproc_v1/representations.rb

Overview

A Cloud Dataproc job for running Pig queries on YARN.

Instance Attribute Summary collapse

Instance Method Summary collapse

Methods included from Core::JsonObjectSupport

#to_json

Methods included from Core::Hashable

process_value, #to_h

Constructor Details

#initialize(**args) ⇒ PigJob


1140
1141
1142
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1140

def initialize(**args)
   update!(**args)
end

Instance Attribute Details

#continue_on_failureBoolean Also known as: continue_on_failure?

[Optional] Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries. Corresponds to the JSON property continueOnFailure


1112
1113
1114
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1112

def continue_on_failure
  @continue_on_failure
end

#jar_file_urisArray<String>

[Optional] HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs. Corresponds to the JSON property jarFileUris


1133
1134
1135
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1133

def jar_file_uris
  @jar_file_uris
end

#logging_configGoogle::Apis::DataprocV1::LoggingConfig

The runtime logging config of the job. Corresponds to the JSON property loggingConfig


1138
1139
1140
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1138

def logging_config
  @logging_config
end

#propertiesHash<String,String>

[Optional] A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/ pig/conf/pig.properties, and classes in user code. Corresponds to the JSON property properties


1127
1128
1129
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1127

def properties
  @properties
end

#query_file_uriString

The HCFS URI of the script that contains the Pig queries. Corresponds to the JSON property queryFileUri


1100
1101
1102
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1100

def query_file_uri
  @query_file_uri
end

#query_listGoogle::Apis::DataprocV1::QueryList

A list of queries to run on a cluster. Corresponds to the JSON property queryList


1105
1106
1107
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1105

def query_list
  @query_list
end

#script_variablesHash<String,String>

[Optional] Mapping of query variable names to values (equivalent to the Pig command: name=[value]). Corresponds to the JSON property scriptVariables


1119
1120
1121
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1119

def script_variables
  @script_variables
end

Instance Method Details

#update!(**args) ⇒ Object

Update properties of this object


1145
1146
1147
1148
1149
1150
1151
1152
1153
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1145

def update!(**args)
  @query_file_uri = args[:query_file_uri] if args.key?(:query_file_uri)
  @query_list = args[:query_list] if args.key?(:query_list)
  @continue_on_failure = args[:continue_on_failure] if args.key?(:continue_on_failure)
  @script_variables = args[:script_variables] if args.key?(:script_variables)
  @properties = args[:properties] if args.key?(:properties)
  @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris)
  @logging_config = args[:logging_config] if args.key?(:logging_config)
end