Class: Mortar::Command::S3

Inherits:
Base
  • Object
show all
Defined in:
lib/mortar/command/s3.rb

Overview

Work with your data on Amazon S3

Instance Attribute Summary

Attributes inherited from Base

#args, #options

Instance Method Summary collapse

Methods inherited from Base

#api, #ask_public, #config_parameters, #get_error_message_context, #git, #initialize, #initialize_embedded_project, #luigi_parameters, namespace, #pig_parameters, #project, #register_api_call, #register_do, #register_project, #spark_script_arguments, #validate_project_name, #validate_project_structure

Methods included from Helpers

#action, #ask, #confirm, #copy_if_not_present_at_dest, #default_host, #deprecate, #display, #display_header, #display_object, #display_row, #display_table, #display_with_indent, #download_to_file, #ensure_dir_exists, #error, error_with_failure, error_with_failure=, extended, extended_into, #format_bytes, #format_date, #format_with_bang, #full_host, #get_terminal_environment, #home_directory, #host, #hprint, #hputs, included, included_into, #installed_with_omnibus?, #json_decode, #json_encode, #line_formatter, #longest, #output_with_bang, #pending_github_team_state_message, #quantify, #redisplay, #retry_on_exception, #running_on_a_mac?, #running_on_windows?, #set_buffer, #shell, #spinner, #status, #string_distance, #styled_array, #styled_error, #styled_hash, #styled_header, #suggestion, #test_name, #ticking, #time_ago, #truncate, #warning, #with_tty, #write_to_file

Constructor Details

This class inherits a constructor from Mortar::Command::Base

Instance Method Details

#get ⇒ Object

s3:get S3_PATH OUTPUT_PATH

Download files from a path in S3 to your local computer.

Examples:

Download from your bucket with:
    $ mortar s3:get s3://mortar-example/out out/



32
33
34
 
# File 'lib/mortar/command/s3.rb', line 32

def get
  do_get("get")
end

#getmerge ⇒ Object

s3:getmerge S3_PATH OUTPUT_PATH

Download and concatenate files from a path in S3 to your local computer. Merges together all of the hadoop output into one file called ‘output’ at specified OUTPUT_PATH

Examples:

Download from your bucket with:
    $ mortar s3:getmerge s3://mortar-example/out out/



44
45
46
 
# File 'lib/mortar/command/s3.rb', line 44

def getmerge
  do_get("getmerge", true)
end