Class: SVMKit::LinearModel::LinearRegression

Inherits:
SGDLinearEstimator show all
Includes:
Base::Regressor
Defined in:
lib/svmkit/linear_model/linear_regression.rb

Overview

LinearRegression is a class that implements ordinary least square linear regression with mini-batch stochastic gradient descent optimization.

Examples:

estimator =
  SVMKit::LinearModel::LinearRegression.new(max_iter: 1000, batch_size: 20, random_seed: 1)
estimator.fit(training_samples, traininig_values)
results = estimator.predict(testing_samples)

Instance Attribute Summary collapse

Attributes included from Base::BaseEstimator

#params

Instance Method Summary collapse

Methods included from Base::Regressor

#score

Constructor Details

#initialize(fit_bias: false, bias_scale: 1.0, max_iter: 1000, batch_size: 10, optimizer: nil, random_seed: nil) ⇒ LinearRegression

Create a new ordinary least square linear regressor.

Parameters:

  • fit_bias (Boolean) (defaults to: false) —

    The flag indicating whether to fit the bias term.

  • bias_scale (Float) (defaults to: 1.0) —

    The scale of the bias term.

  • max_iter (Integer) (defaults to: 1000) —

    The maximum number of iterations.

  • batch_size (Integer) (defaults to: 10) —

    The size of the mini batches.

  • optimizer (Optimizer) (defaults to: nil) —

    The optimizer to calculate adaptive learning rate. If nil is given, Nadam is used.

  • random_seed (Integer) (defaults to: nil) —

    The seed value using to initialize the random generator.



43
44
45
46
47
48
49
50
51
 
# File 'lib/svmkit/linear_model/linear_regression.rb', line 43

def initialize(fit_bias: false, bias_scale: 1.0, max_iter: 1000, batch_size: 10, optimizer: nil, random_seed: nil)
  check_params_float(bias_scale: bias_scale)
  check_params_integer(max_iter: max_iter, batch_size: batch_size)
  check_params_boolean(fit_bias: fit_bias)
  check_params_type_or_nil(Integer, random_seed: random_seed)
  check_params_positive(max_iter: max_iter, batch_size: batch_size)
  super(reg_param: 0.0, fit_bias: fit_bias, bias_scale: bias_scale,
        max_iter: max_iter, batch_size: batch_size, optimizer: optimizer, random_seed: random_seed)
end

Instance Attribute Details

#bias_term ⇒ Numo::DFloat (readonly)

Return the bias term (a.k.a. intercept).

Returns:

  • (Numo::DFloat) —

    (shape: [n_outputs])



28
29
30
 
# File 'lib/svmkit/linear_model/linear_regression.rb', line 28

def bias_term
  @bias_term
end

#rng ⇒ Random (readonly)

Return the random generator for random sampling.

Returns:

  • (Random) 


32
33
34
 
# File 'lib/svmkit/linear_model/linear_regression.rb', line 32

def rng
  @rng
end

#weight_vec ⇒ Numo::DFloat (readonly)

Return the weight vector.

Returns:

  • (Numo::DFloat) —

    (shape: [n_outputs, n_features])



24
25
26
 
# File 'lib/svmkit/linear_model/linear_regression.rb', line 24

def weight_vec
  @weight_vec
end

Instance Method Details

#fit(x, y) ⇒ LinearRegression

Fit the model with given training data.

Parameters:

  • x (Numo::DFloat) —

    (shape: [n_samples, n_features]) The training data to be used for fitting the model.

  • y (Numo::Int32) —

    (shape: [n_samples, n_outputs]) The target values to be used for fitting the model.

Returns:



58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
 
# File 'lib/svmkit/linear_model/linear_regression.rb', line 58

def fit(x, y)
  check_sample_array(x)
  check_tvalue_array(y)
  check_sample_tvalue_size(x, y)

  n_outputs = y.shape[1].nil? ? 1 : y.shape[1]
  n_features = x.shape[1]

  if n_outputs > 1
    @weight_vec = Numo::DFloat.zeros(n_outputs, n_features)
    @bias_term = Numo::DFloat.zeros(n_outputs)
    n_outputs.times { |n| @weight_vec[n, true], @bias_term[n] = partial_fit(x, y[true, n]) }
  else
    @weight_vec, @bias_term = partial_fit(x, y)
  end

  self
end

#marshal_dump ⇒ Hash

Dump marshal data.

Returns:

  • (Hash) —

    The marshal data about LinearRegression.



88
89
90
91
92
93
 
# File 'lib/svmkit/linear_model/linear_regression.rb', line 88

def marshal_dump
  { params: @params,
    weight_vec: @weight_vec,
    bias_term: @bias_term,
    rng: @rng }
end

#marshal_load(obj) ⇒ nil

Load marshal data.

Returns:

  • (nil) 


97
98
99
100
101
102
103
 
# File 'lib/svmkit/linear_model/linear_regression.rb', line 97

def marshal_load(obj)
  @params = obj[:params]
  @weight_vec = obj[:weight_vec]
  @bias_term = obj[:bias_term]
  @rng = obj[:rng]
  nil
end

#predict(x) ⇒ Numo::DFloat

Predict values for samples.

Parameters:

  • x (Numo::DFloat) —

    (shape: [n_samples, n_features]) The samples to predict the values.

Returns:

  • (Numo::DFloat) —

    (shape: [n_samples, n_outputs]) Predicted values per sample.



81
82
83
84
 
# File 'lib/svmkit/linear_model/linear_regression.rb', line 81

def predict(x)
  check_sample_array(x)
  x.dot(@weight_vec.transpose) + @bias_term
end