Class: Google::Apis::DataprocV1::SparkSqlJob
- Inherits:
-
Object
- Object
- Google::Apis::DataprocV1::SparkSqlJob
- Includes:
- Core::Hashable, Core::JsonObjectSupport
- Defined in:
- generated/google/apis/dataproc_v1/classes.rb,
generated/google/apis/dataproc_v1/representations.rb,
generated/google/apis/dataproc_v1/representations.rb
Overview
A Cloud Dataproc job for running Spark SQL queries.
Instance Attribute Summary collapse
-
#jar_file_uris ⇒ Array<String>
[Optional] HCFS URIs of jar files to be added to the Spark CLASSPATH.
-
#logging_config ⇒ Google::Apis::DataprocV1::LoggingConfig
The runtime logging config of the job.
-
#properties ⇒ Hash<String,String>
[Optional] A mapping of property names to values, used to configure Spark SQL' s SparkConf.
-
#query_file_uri ⇒ String
The HCFS URI of the script that contains SQL queries.
-
#query_list ⇒ Google::Apis::DataprocV1::QueryList
A list of queries to run on a cluster.
-
#script_variables ⇒ Hash<String,String>
[Optional] Mapping of query variable names to values (equivalent to the Spark SQL command: SET
name="value";
).
Instance Method Summary collapse
-
#initialize(**args) ⇒ SparkSqlJob
constructor
A new instance of SparkSqlJob.
-
#update!(**args) ⇒ Object
Update properties of this object.
Methods included from Core::JsonObjectSupport
Methods included from Core::Hashable
Constructor Details
#initialize(**args) ⇒ SparkSqlJob
Returns a new instance of SparkSqlJob.
1193 1194 1195 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1193 def initialize(**args) update!(**args) end |
Instance Attribute Details
#jar_file_uris ⇒ Array<String>
[Optional] HCFS URIs of jar files to be added to the Spark CLASSPATH.
Corresponds to the JSON property jarFileUris
1186 1187 1188 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1186 def jar_file_uris @jar_file_uris end |
#logging_config ⇒ Google::Apis::DataprocV1::LoggingConfig
The runtime logging config of the job.
Corresponds to the JSON property loggingConfig
1191 1192 1193 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1191 def logging_config @logging_config end |
#properties ⇒ Hash<String,String>
[Optional] A mapping of property names to values, used to configure Spark SQL'
s SparkConf. Properties that conflict with values set by the Cloud Dataproc
API may be overwritten.
Corresponds to the JSON property properties
1181 1182 1183 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1181 def properties @properties end |
#query_file_uri ⇒ String
The HCFS URI of the script that contains SQL queries.
Corresponds to the JSON property queryFileUri
1163 1164 1165 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1163 def query_file_uri @query_file_uri end |
#query_list ⇒ Google::Apis::DataprocV1::QueryList
A list of queries to run on a cluster.
Corresponds to the JSON property queryList
1168 1169 1170 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1168 def query_list @query_list end |
#script_variables ⇒ Hash<String,String>
[Optional] Mapping of query variable names to values (equivalent to the Spark
SQL command: SET name="value";
).
Corresponds to the JSON property scriptVariables
1174 1175 1176 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1174 def script_variables @script_variables end |
Instance Method Details
#update!(**args) ⇒ Object
Update properties of this object
1198 1199 1200 1201 1202 1203 1204 1205 |
# File 'generated/google/apis/dataproc_v1/classes.rb', line 1198 def update!(**args) @query_file_uri = args[:query_file_uri] if args.key?(:query_file_uri) @query_list = args[:query_list] if args.key?(:query_list) @script_variables = args[:script_variables] if args.key?(:script_variables) @properties = args[:properties] if args.key?(:properties) @jar_file_uris = args[:jar_file_uris] if args.key?(:jar_file_uris) @logging_config = args[:logging_config] if args.key?(:logging_config) end |