Class: DataKitten::Dataset

Inherits:
Object
  • Object
show all
Includes:
Hosts, Origins, PublishingFormats
Defined in:
lib/data_kitten/dataset.rb

Overview

Represents a single dataset from some origin (see dcat:Dataset for relevant vocabulary).

Designed to be created with a URI to the dataset, and then to work out metadata from there.

Currently supports Datasets hosted in Git (and optionally on GitHub), and which use the Datapackage metadata format.

Examples:

Load a Dataset from a git repository

dataset = Dataset.new('git://github.com/theodi/dataset-metadata-survey.git')
dataset.supported?         # => true
dataset.origin             # => :git
dataset.host               # => :github
dataset.publishing_format  # => :datapackage

Instance Attribute Summary collapse

Instance Method Summary collapse

Constructor Details

#new(url) ⇒ Dataset #new(options) ⇒ Dataset

Create a new Dataset object

The class will attempt to auto-load metadata from this URL.

Overloads:

  • #new(url) ⇒ Dataset

    Parameters:

    • url (String) —

      A URL that can be used to access the Dataset

  • #new(options) ⇒ Dataset

    Parameters:

    • options (Hash) —

      the details of the Dataset.

    Options Hash (options):

    • :access_url (String) —

      A URL that can be used to access the Dataset.



43
44
45
46
47
48
49
50
51
52
53
54
55
 
# File 'lib/data_kitten/dataset.rb', line 43

def initialize(url_or_options)
  url = case url_or_options
  when Hash
    url_or_options[:access_url]
  else
    url_or_options
  end
  @access_url = DataKitten::Fetcher.wrap(url)

  detect_origin
  detect_host
  detect_publishing_format
end

Instance Attribute Details

#access_url ⇒ String

Returns the URL that gives access to the dataset.

Returns:

  • (String) —

    the URL that gives access to the dataset



30
31
32
 
# File 'lib/data_kitten/dataset.rb', line 30

def access_url
  @access_url
end

#identifier ⇒ String

A unique identifier of the dataset.

Returns:

  • (String) —

    the identifier of the dataset



101
102
103
 
# File 'lib/data_kitten/dataset.rb', line 101

def identifier
  @identifier
end

#metadata ⇒ Object

Returns the value of attribute metadata.



284
285
286
 
# File 'lib/data_kitten/dataset.rb', line 284

def metadata
  @metadata
end

#source ⇒ Object 



65
66
67
 
# File 'lib/data_kitten/dataset.rb', line 65

def source
  @source ||= @access_url.as_json if @access_url.ok?
end

Instance Method Details

#change_history ⇒ Array

A history of changes to the Dataset

Returns:

  • (Array) —

    An array of changes. Exact format depends on the origin and publishing format.



273
274
275
 
# File 'lib/data_kitten/dataset.rb', line 273

def change_history
  []
end

#contributor_agreement_url ⇒ String

The URL of the contributor license agreement

Returns:

  • (String) —

    A URL for the agreement that contributors accept.



250
251
252
 
# File 'lib/data_kitten/dataset.rb', line 250

def contributor_agreement_url
  nil
end

#contributors ⇒ Array<Agent>

A list of contributors

Returns:

  • (Array<Agent>) —

    An array of contributors to the dataset, each as an Agent object.



222
223
224
 
# File 'lib/data_kitten/dataset.rb', line 222

def contributors
  []
end

#crowdsourced? ⇒ Boolean

Has the data been crowdsourced?

Returns:

  • (Boolean) —

    Whether the data has been crowdsourced or not.



243
244
245
 
# File 'lib/data_kitten/dataset.rb', line 243

def crowdsourced?
  false
end

#data_title ⇒ String

The human-readable title of the dataset.

Returns:

  • (String) —

    the title of the dataset.



106
107
108
 
# File 'lib/data_kitten/dataset.rb', line 106

def data_title
  nil
end

#description ⇒ String

A brief description of the dataset

Returns:

  • (String) —

    the description of the dataset.



113
114
115
 
# File 'lib/data_kitten/dataset.rb', line 113

def description
  nil
end

#distributions ⇒ Array<Distribution> Also known as: files, resources

A list of distributions. Has aliases for popular alternative vocabularies.

Returns:

  • (Array<Distribution>) —

    An array of Distribution objects.



257
258
259
 
# File 'lib/data_kitten/dataset.rb', line 257

def distributions
  []
end

#documentation_url ⇒ String

Human-readable documentation for the dataset.

Returns:

  • (String) —

    the URL of the documentation.



127
128
129
 
# File 'lib/data_kitten/dataset.rb', line 127

def documentation_url
  nil
end

#host ⇒ Symbol

Where the dataset is hosted.

Returns:

  • (Symbol) —

    The host. For instance, data loaded from github repositories will return :github. This can be used to control extra host-specific behaviour if required. If no host type is identified, will return nil.



93
94
95
 
# File 'lib/data_kitten/dataset.rb', line 93

def host
  nil
end

#issued ⇒ Date Also known as: release_date

Date the dataset was released

Returns:

  • (Date) —

    the release date of the dataset



142
143
144
 
# File 'lib/data_kitten/dataset.rb', line 142

def issued
  nil
end

#keywords ⇒ Array<string>

Keywords for the dataset

Returns:

  • (Array<string>) —

    an array of keywords



120
121
122
 
# File 'lib/data_kitten/dataset.rb', line 120

def keywords
  []
end

#landing_page ⇒ String

A web page that can be used to gain access to the dataset, its distributions and/or additional information.

Returns:

  • (String) —

    The URL to the dataset



157
158
159
 
# File 'lib/data_kitten/dataset.rb', line 157

def landing_page
  nil
end

#language ⇒ String

The language of the dataset.

Returns:

  • (String) —

    the language of the dataset



229
230
231
 
# File 'lib/data_kitten/dataset.rb', line 229

def language
  nil
end

#licenses ⇒ Array<License>

A list of licenses

Returns:

  • (Array<License>) —

    An array of licenses, each as a License object.



208
209
210
 
# File 'lib/data_kitten/dataset.rb', line 208

def licenses
  []
end

#maintainers ⇒ Array<Agent>

A list of maintainers

Returns:

  • (Array<Agent>) —

    An array of maintainers, each as an Agent object.



194
195
196
 
# File 'lib/data_kitten/dataset.rb', line 194

def maintainers
  []
end

#modified ⇒ Date

Date the dataset was last modified

Returns:

  • (Date) —

    the dataset’s last modified date



150
151
152
 
# File 'lib/data_kitten/dataset.rb', line 150

def modified
  nil
end

#origin ⇒ Symbol

The origin type of the dataset.

Returns:

  • (Symbol) —

    The origin type. For instance, datasets loaded from git repositories will return :git. If no origin type is identified, will return nil.



84
85
86
 
# File 'lib/data_kitten/dataset.rb', line 84

def origin
  nil
end

#publishers ⇒ Array<Agent>

A list of publishers

Returns:

  • (Array<Agent>) —

    An array of publishers, each as an Agent object.



201
202
203
 
# File 'lib/data_kitten/dataset.rb', line 201

def publishers
  []
end

#publishing_format ⇒ Symbol

The publishing format for the dataset.

Returns:

  • (Symbol) —

    The format. For instance, datasets that publish metadata in Datapackage format will return :datapackage. If no format is identified, will return nil.



187
188
189
 
# File 'lib/data_kitten/dataset.rb', line 187

def publishing_format
  nil
end

#release_type ⇒ Symbol

What type of dataset is this? Options are: :web_service for API-accessible data, or :one_off for downloadable data dumps.

Returns:

  • (Symbol) —

    the release type.



135
136
137
 
# File 'lib/data_kitten/dataset.rb', line 135

def release_type
  false
end

#rights ⇒ Object<Rights>

The rights statment for the data

Returns:

  • (Object<Rights>) —

    How the content and data can be used, as well as copyright notice and attribution URL



215
216
217
 
# File 'lib/data_kitten/dataset.rb', line 215

def rights
  nil
end

#sources ⇒ Array<Source>

Where the data is sourced from

Returns:

  • (Array<Source>) —

    the sources of the data, each as a Source object.



171
172
173
 
# File 'lib/data_kitten/dataset.rb', line 171

def sources
  []
end

#spatial ⇒ GeoJSON Geometry

Spatial coverage of the dataset

Returns:

  • (GeoJSON Geometry) —

    A GeoJSON geometry object of the spatial coverage



280
281
282
 
# File 'lib/data_kitten/dataset.rb', line 280

def spatial
  nil
end

#supported? ⇒ Boolean

Can metadata be loaded for this Dataset?

Returns:

  • (Boolean) —

    true if metadata can be loaded, false if it’s an unknown origin type, or has an unknown metadata format.



75
76
77
 
# File 'lib/data_kitten/dataset.rb', line 75

def supported?
  !(origin.nil? || publishing_format.nil?)
end

#temporal ⇒ Object<Temporal>

The temporal coverage of the dataset

Returns:

  • (Object<Temporal>) —

    the start and end dates of the dataset’s temporal coverage



164
165
166
 
# File 'lib/data_kitten/dataset.rb', line 164

def temporal
  nil
end

#theme ⇒ String

The main category the dataset belongs to.

Returns:

  • (String) 


236
237
238
 
# File 'lib/data_kitten/dataset.rb', line 236

def theme
  nil
end

#time_sensitive? ⇒ Boolean

Is the information time-sensitive?

Returns:

  • (Boolean) —

    whether the information will go out of date.



178
179
180
 
# File 'lib/data_kitten/dataset.rb', line 178

def time_sensitive?
  false
end

#update_frequency ⇒ String

How frequently the data is updated.

Returns:

  • (String) —

    The frequency of update expressed as a dct:Frequency.



266
267
268
 
# File 'lib/data_kitten/dataset.rb', line 266

def update_frequency
  nil
end

#uri ⇒ Object 



57
58
59
 
# File 'lib/data_kitten/dataset.rb', line 57

def uri
  URI(@access_url.to_s)
end

#url ⇒ Object 



61
62
63
 
# File 'lib/data_kitten/dataset.rb', line 61

def url
  @access_url.to_s
end