Class: Aws::Glue::Types::HudiTarget

Inherits:
Struct
  • Object
show all
Includes:
Structure
Defined in:
lib/aws-sdk-glue/types.rb

Overview

Specifies an Apache Hudi data source.

See Also:

Constant Summary collapse

SENSITIVE = 
[]

Instance Attribute Summary collapse

Instance Attribute Details

#connection_name ⇒ String

The name of the connection to use to connect to the Hudi target. If your Hudi files are stored in buckets that require VPC authorization, you can set their connection properties here.

Returns:

  • (String) 


12768
12769
12770
12771
12772
12773
12774
12775
 
# File 'lib/aws-sdk-glue/types.rb', line 12768

class HudiTarget < Struct.new(
  :paths,
  :connection_name,
  :exclusions,
  :maximum_traversal_depth)
  SENSITIVE = []
  include Aws::Structure
end

#exclusions ⇒ Array<String>

A list of glob patterns used to exclude from the crawl. For more information, see [Catalog Tables with a Crawler].

[1]: docs.aws.amazon.com/glue/latest/dg/add-crawler.html

Returns:

  • (Array<String>) 


12768
12769
12770
12771
12772
12773
12774
12775
 
# File 'lib/aws-sdk-glue/types.rb', line 12768

class HudiTarget < Struct.new(
  :paths,
  :connection_name,
  :exclusions,
  :maximum_traversal_depth)
  SENSITIVE = []
  include Aws::Structure
end

#maximum_traversal_depth ⇒ Integer

The maximum depth of Amazon S3 paths that the crawler can traverse to discover the Hudi metadata folder in your Amazon S3 path. Used to limit the crawler run time.

Returns:

  • (Integer) 


12768
12769
12770
12771
12772
12773
12774
12775
 
# File 'lib/aws-sdk-glue/types.rb', line 12768

class HudiTarget < Struct.new(
  :paths,
  :connection_name,
  :exclusions,
  :maximum_traversal_depth)
  SENSITIVE = []
  include Aws::Structure
end

#paths ⇒ Array<String>

An array of Amazon S3 location strings for Hudi, each indicating the root folder with which the metadata files for a Hudi table resides. The Hudi folder may be located in a child folder of the root folder.

The crawler will scan all folders underneath a path for a Hudi folder.

Returns:

  • (Array<String>) 


12768
12769
12770
12771
12772
12773
12774
12775
 
# File 'lib/aws-sdk-glue/types.rb', line 12768

class HudiTarget < Struct.new(
  :paths,
  :connection_name,
  :exclusions,
  :maximum_traversal_depth)
  SENSITIVE = []
  include Aws::Structure
end