Class: Aws::Glue::Types::HudiTarget

Inherits:

Struct

• Object
• Struct
• Aws::Glue::Types::HudiTarget

Includes:

Structure

Defined in:

lib/aws-sdk-glue/types.rb

Overview

Specifies an Apache Hudi data source.

See Also:

• AWS API Documentation

Constant Summary

SENSITIVE =

[]

Instance Attribute Summary

• #connection_name ⇒ String

  The name of the connection to use to connect to the Hudi target.

• #exclusions ⇒ Array<String>

  A list of glob patterns used to exclude from the crawl.

• #maximum_traversal_depth ⇒ Integer

  The maximum depth of Amazon S3 paths that the crawler can traverse to discover the Hudi metadata folder in your Amazon S3 path.

• #paths ⇒ Array<String>

  An array of Amazon S3 location strings for Hudi, each indicating the root folder with which the metadata files for a Hudi table resides.

Instance Attribute Details

#connection_name ⇒ String

The name of the connection to use to connect to the Hudi target. If your Hudi files are stored in buckets that require VPC authorization, you can set their connection properties here.

Returns:

• (String)

# File 'lib/aws-sdk-glue/types.rb', line 15222

class HudiTarget < Struct.new(
  :paths,
  :connection_name,
  :exclusions,
  :maximum_traversal_depth)
  SENSITIVE = []
  include Aws::Structure
end

#exclusions ⇒ Array<String>

A list of glob patterns used to exclude from the crawl. For more information, see [Catalog Tables with a Crawler].

[1]: docs.aws.amazon.com/glue/latest/dg/add-crawler.html

Returns:

• (Array<String>)

# File 'lib/aws-sdk-glue/types.rb', line 15222

class HudiTarget < Struct.new(
  :paths,
  :connection_name,
  :exclusions,
  :maximum_traversal_depth)
  SENSITIVE = []
  include Aws::Structure
end

#maximum_traversal_depth ⇒ Integer

The maximum depth of Amazon S3 paths that the crawler can traverse to discover the Hudi metadata folder in your Amazon S3 path. Used to limit the crawler run time.

Returns:

• (Integer)

# File 'lib/aws-sdk-glue/types.rb', line 15222

class HudiTarget < Struct.new(
  :paths,
  :connection_name,
  :exclusions,
  :maximum_traversal_depth)
  SENSITIVE = []
  include Aws::Structure
end

#paths ⇒ Array<String>

An array of Amazon S3 location strings for Hudi, each indicating the root folder with which the metadata files for a Hudi table resides. The Hudi folder may be located in a child folder of the root folder.

The crawler will scan all folders underneath a path for a Hudi folder.

Returns:

• (Array<String>)

# File 'lib/aws-sdk-glue/types.rb', line 15222

class HudiTarget < Struct.new(
  :paths,
  :connection_name,
  :exclusions,
  :maximum_traversal_depth)
  SENSITIVE = []
  include Aws::Structure
end