Class: SVMKit::KernelApproximation::RBF

Inherits:
Object
  • Object
show all
Includes:
Base::BaseEstimator, Base::Transformer
Defined in:
lib/svmkit/kernel_approximation/rbf.rb

Overview

Class for RBF kernel feature mapping.

Refernce:

    1. Rahimi and B. Recht, “Random Features for Large-Scale Kernel Machines,” Proc. NIPS’07, pp.1177–1184, 2007.

Examples:

transformer = SVMKit::KernelApproximation::RBF.new(gamma: 1.0, n_coponents: 128, random_seed: 1)
new_training_samples = transformer.fit_transform(training_samples)
new_testing_samples = transformer.transform(testing_samples)

Instance Attribute Summary collapse

Attributes included from Base::BaseEstimator

#params

Instance Method Summary collapse

Constructor Details

#initialize(gamma: 1.0, n_components: 128, random_seed: nil) ⇒ RBF

Create a new transformer for mapping to RBF kernel feature space.

Parameters:

  • gamma (Float) (defaults to: 1.0) —

    The parameter of RBF kernel: exp(-gamma * x^2).

  • n_components (Integer) (defaults to: 128) —

    The number of dimensions of the RBF kernel feature space.

  • random_seed (Integer) (defaults to: nil) —

    The seed value using to initialize the random generator.



39
40
41
42
43
44
45
46
47
48
 
# File 'lib/svmkit/kernel_approximation/rbf.rb', line 39

def initialize(gamma: 1.0, n_components: 128, random_seed: nil)
  @params = {}
  @params[:gamma] = gamma
  @params[:n_components] = n_components
  @params[:random_seed] = random_seed
  @params[:random_seed] ||= srand
  @rng = Random.new(@params[:random_seed])
  @random_mat = nil
  @random_vec = nil
end

Instance Attribute Details

#random_mat ⇒ Numo::DFloat (readonly)

Return the random matrix for transformation.

Returns:

  • (Numo::DFloat) —

    (shape: [n_features, n_components])



24
25
26
 
# File 'lib/svmkit/kernel_approximation/rbf.rb', line 24

def random_mat
  @random_mat
end

#random_vec ⇒ Numo::DFloat (readonly)

Return the random vector for transformation.

Returns:

  • (Numo::DFloat) —

    (shape: [n_components])



28
29
30
 
# File 'lib/svmkit/kernel_approximation/rbf.rb', line 28

def random_vec
  @random_vec
end

#rng ⇒ Random (readonly)

Return the random generator for transformation.

Returns:

  • (Random) 


32
33
34
 
# File 'lib/svmkit/kernel_approximation/rbf.rb', line 32

def rng
  @rng
end

Instance Method Details

#fit(x) ⇒ RBF

Fit the model with given training data.

Parameters:

  • x (Numo::NArray) —

    (shape: [n_samples, n_features]) The training data to be used for fitting the model. This method uses only the number of features of the data.

Returns:

  • (RBF) —

    The learned transformer itself.



57
58
59
60
61
62
63
64
65
66
 
# File 'lib/svmkit/kernel_approximation/rbf.rb', line 57

def fit(x, _y = nil)
  n_features = x.shape[1]
  @params[:n_components] = 2 * n_features if @params[:n_components] <= 0
  @random_mat = rand_normal([n_features, @params[:n_components]]) * (2.0 * @params[:gamma])**0.5
  n_half_components = @params[:n_components] / 2
  @random_vec = Numo::DFloat.zeros(@params[:n_components] - n_half_components).concatenate(
    Numo::DFloat.ones(n_half_components) * (0.5 * Math::PI)
  )
  self
end

#fit_transform(x) ⇒ Numo::DFloat

Fit the model with training data, and then transform them with the learned model.

Parameters:

  • x (Numo::DFloat) —

    (shape: [n_samples, n_features]) The training data to be used for fitting the model.

Returns:

  • (Numo::DFloat) —

    (shape: [n_samples, n_components]) The transformed data



74
75
76
 
# File 'lib/svmkit/kernel_approximation/rbf.rb', line 74

def fit_transform(x, _y = nil)
  fit(x).transform(x)
end

#marshal_dump ⇒ Hash

Dump marshal data.

Returns:

  • (Hash) —

    The marshal data about RBF.



92
93
94
95
96
97
 
# File 'lib/svmkit/kernel_approximation/rbf.rb', line 92

def marshal_dump
  { params: @params,
    random_mat: @random_mat,
    random_vec: @random_vec,
    rng: @rng }
end

#marshal_load(obj) ⇒ nil

Load marshal data.

Returns:

  • (nil) 


101
102
103
104
105
106
107
 
# File 'lib/svmkit/kernel_approximation/rbf.rb', line 101

def marshal_load(obj)
  @params = obj[:params]
  @random_mat = obj[:random_mat]
  @random_vec = obj[:random_vec]
  @rng = obj[:rng]
  nil
end

#transform(x) ⇒ Numo::DFloat

Transform the given data with the learned model.

Parameters:

  • x (Numo::DFloat) —

    (shape: [n_samples, n_features]) The data to be transformed with the learned model.

Returns:

  • (Numo::DFloat) —

    (shape: [n_samples, n_components]) The transformed data.



84
85
86
87
88
 
# File 'lib/svmkit/kernel_approximation/rbf.rb', line 84

def transform(x)
  n_samples, = x.shape
  projection = x.dot(@random_mat) + @random_vec.tile(n_samples, 1)
  Numo::NMath.sin(projection) * ((2.0 / @params[:n_components])**0.5)
end