Class: Google::Apis::DataprocV1::PigJob
- Inherits:
-
Object
- Object
- Google::Apis::DataprocV1::PigJob
- Includes:
- Core::Hashable, Core::JsonObjectSupport
- Defined in:
- generated/google/apis/dataproc_v1/classes.rb,
generated/google/apis/dataproc_v1/representations.rb,
generated/google/apis/dataproc_v1/representations.rb
Overview
A Cloud Dataproc job for running Pig queries on YARN.
Instance Attribute Summary collapse
-
#continue_on_failure ⇒ Boolean
(also: #continue_on_failure?)
[Optional] Whether to continue executing queries if a query fails.
-
#jar_file_uris ⇒ Array<String>
[Optional] HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks.
-
#logging_config ⇒ Google::Apis::DataprocV1::LoggingConfig
The runtime logging config of the job.
-
#properties ⇒ Hash<String,String>
[Optional] A mapping of property names to values, used to configure Pig.
-
#query_file_uri ⇒ String
The HCFS URI of the script that contains the Pig queries.
-
#query_list ⇒ Google::Apis::DataprocV1::QueryList
A list of queries to run on a cluster.
-
#script_variables ⇒ Hash<String,String>
[Optional] Mapping of query variable names to values (equivalent to the Pig command:
name=[value]
).
Instance Method Summary collapse
-
#initialize(**args) ⇒ PigJob
constructor
A new instance of PigJob.
-
#update!(**args) ⇒ Object
Update properties of this object.
Methods included from Core::JsonObjectSupport
Methods included from Core::Hashable
Constructor Details
#initialize(**args) ⇒ PigJob
Returns a new instance of PigJob.
1140 1141 1142 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1140 def initialize(**args) update!(**args) end |
Instance Attribute Details
#continue_on_failure ⇒ Boolean Also known as: continue_on_failure?
[Optional] Whether to continue executing queries if a query fails. The default
value is false
. Setting to true
can be useful when executing independent
parallel queries.
Corresponds to the JSON property continueOnFailure
1112 1113 1114 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1112 def continue_on_failure @continue_on_failure end |
#jar_file_uris ⇒ Array<String>
[Optional] HCFS URIs of jar files to add to the CLASSPATH of the Pig Client
and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs.
Corresponds to the JSON property jarFileUris
1133 1134 1135 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1133 def jar_file_uris @jar_file_uris end |
#logging_config ⇒ Google::Apis::DataprocV1::LoggingConfig
The runtime logging config of the job.
Corresponds to the JSON property loggingConfig
1138 1139 1140 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1138 def logging_config @logging_config end |
#properties ⇒ Hash<String,String>
[Optional] A mapping of property names to values, used to configure Pig.
Properties that conflict with values set by the Cloud Dataproc API may be
overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/
pig/conf/pig.properties, and classes in user code.
Corresponds to the JSON property properties
1127 1128 1129 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1127 def properties @properties end |
#query_file_uri ⇒ String
The HCFS URI of the script that contains the Pig queries.
Corresponds to the JSON property queryFileUri
1100 1101 1102 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1100 def query_file_uri @query_file_uri end |
#query_list ⇒ Google::Apis::DataprocV1::QueryList
A list of queries to run on a cluster.
Corresponds to the JSON property queryList
1105 1106 1107 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1105 def query_list @query_list end |
#script_variables ⇒ Hash<String,String>
[Optional] Mapping of query variable names to values (equivalent to the Pig
command: name=[value]
).
Corresponds to the JSON property scriptVariables
1119 1120 1121 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1119 def script_variables @script_variables end |
Instance Method Details
#update!(**args) ⇒ Object
Update properties of this object
1145 1146 1147 1148 1149 1150 1151 1152 1153 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1145 def update!(**args) @query_file_uri = args[:query_file_uri] if args.key?(:query_file_uri) @query_list = args[:query_list] if args.key?(:query_list) @continue_on_failure = args[:continue_on_failure] if args.key?(:continue_on_failure) @script_variables = args[:script_variables] if args.key?(:script_variables) @properties = args[:properties] if args.key?(:properties) @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris) @logging_config = args[:logging_config] if args.key?(:logging_config) end |