gum::learning::DBRowGenerator< ALLOC > Class Template Reference

The base class for all DBRow generators. More...

#include <agrum/tools/database/DBRowGenerator.h>

Inheritance diagram for gum::learning::DBRowGenerator< ALLOC >:

Public Member Functions
Constructors / Destructors
	DBRowGenerator (const std::vector< DBTranslatedValueType, ALLOC< DBTranslatedValueType > > column_types, const DBRowGeneratorGoal goal, const allocator_type &alloc=allocator_type())
	default constructor More...
	DBRowGenerator (const DBRowGenerator< ALLOC > &from)
	copy constructor More...
	DBRowGenerator (const DBRowGenerator< ALLOC > &from, const allocator_type &alloc)
	copy constructor with a given allocator More...
	DBRowGenerator (DBRowGenerator< ALLOC > &&from)
	move constructor More...
	DBRowGenerator (DBRowGenerator< ALLOC > &&from, const allocator_type &alloc)
	move constructor with a given allocator More...
virtual DBRowGenerator< ALLOC > *	clone () const =0
	virtual copy constructor More...
virtual DBRowGenerator< ALLOC > *	clone (const allocator_type &alloc) const =0
	virtual copy constructor with a given allocator More...
virtual	~DBRowGenerator ()
	destructor More...
Accessors / Modifiers
bool	hasRows ()
	returns true if there are still rows that can be output by the DBRowGenerator More...
bool	setInputRow (const DBRow< DBTranslatedValue, ALLOC > &row)
	sets the input row from which the generator will create its output rows More...
virtual const DBRow< DBTranslatedValue, ALLOC > &	generate ()=0
	generate new rows from the input row More...
void	decreaseRemainingRows ()
	decrease the number of remaining output rows More...
virtual void	reset ()
	resets the generator. There are therefore no more ouput row to generate More...
virtual void	setColumnsOfInterest (const std::vector< std::size_t, ALLOC< std::size_t > > &cols_of_interest)
	sets the columns of interest: the output DBRow needs only contain correct values fot these columns More...
virtual void	setColumnsOfInterest (std::vector< std::size_t, ALLOC< std::size_t > > &&cols_of_interest)
	sets the columns of interest: the output DBRow needs only contain correct values fot these columns More...
const std::vector< std::size_t, ALLOC< std::size_t > > &	columnsOfInterest () const
	returns the current set of columns of interest More...
allocator_type	getAllocator () const
	returns the allocator used More...
DBRowGeneratorGoal	goal () const
	returns the goal of the DBRowGenerator More...

Public Types
using	allocator_type = ALLOC< DBTranslatedValue >
	type for the allocators passed in arguments of methods More...

Protected Attributes
std::size_t	nb_remaining_output_rows_ {std::size_t(0)}
	the number of output rows still to retrieve through the generate method More...
std::vector< DBTranslatedValueType, ALLOC< DBTranslatedValueType > >	column_types_
	the types of the columns in the DatabaseTable More...
std::vector< std::size_t, ALLOC< std::size_t > >	columns_of_interest_
	the set of columns of interest More...
DBRowGeneratorGoal	goal_ {DBRowGeneratorGoal::OTHER_THINGS_THAN_REMOVE_MISSING_VALUES}
	the goal of the DBRowGenerator (just remove missing values or not) More...

Protected Member Functions
DBRowGenerator< ALLOC > &	operator= (const DBRowGenerator< ALLOC > &)
	copy constructor More...
DBRowGenerator< ALLOC > &	operator= (DBRowGenerator< ALLOC > &&)
	move constructor More...
virtual std::size_t	computeRows_ (const DBRow< DBTranslatedValue, ALLOC > &row)=0
	the method that computes the set of DBRow instances to output after method setInputRow has been called More...

Detailed Description

template<template< typename > class ALLOC = std::allocator>
class gum::learning::DBRowGenerator< ALLOC >

The base class for all DBRow generators.

A DBRowGenerator instance takes as input a DBRow containing DBTranslatedValue instances provided directly by a DatabaseTable or resulting from a DBRow generation by another DBRowGenerator. Then, it produces from 0 to several instances of DBRow of DBTranslatedValue. This is essentially useful to deal with missing values: during learning, when a DBRow contains some missing values, what should we do with it? Should we discard it? Should we use an EM algorithm to produce several DBRows weighted by their probability of occurrence? Should we use a K-means algorithm to produce only one DBRow of highest probability of occurrence? Using the appropriate DBRowGenerator, you can apply any of these rules when your learning algorithm parses the DatabaseTable. You just need to indicate which DBRowGenerator to use, no line of code needs be changed in your high-level learning algorithm.

As an example of how a DBRowGenerator works, an "Identity" DBRowGenerator takes as input a DBRow and returns it without any further processing, so it "produces" only one output DBRow. An EM DBRowGenerator takes in input a DBRow in which some cells may be missing. In this case, it produces all the possible combinations of values that these missing values may take and it assigns to these combinations a weight proportional to their probability of occurrence according to a given model. As such, it may most often produce several output DBRows.

The standard usage of a DBRowGenerator is the following:

// create a DatabaseTable and fill it
gum::learning::DBTranslatorSet<> set;
for ( int i = 0; i < 10; ++i )
  set.insertTranslator(gum::learning::DBTranslator4LabelizedVariable<>(),i);
gum::learning::DatabaseTable<> database ( set );
// fill the database

// keep in a vector the types of the columns in the database
const std::vector<gum::learning::DBTranslatedValueType>
  column_types ( 10, gum::learning::DBTranslatedValueType::DISCRETE );

// create the generator
gum::learning::DBRowGeneratorIdentity<> generator ( col_types );

// parse the database and produce output rows
for ( auto dbrow : database ) {
  generator.setInputRow ( dbrow );
  while ( generator.hasRows () ) {
    const auto& output_dbrow = generator.generate ();
    // do something with the output dbrow
  }
}

All DBRowGenerator classes should derive from this class. It takes care of the interaction with the RecordCounter / Score classes. The user who wishes to create a new DBRowGenerator, say for instance, one that outputs k times the input row, just has to define the following class (not all the constructors/destructors are required, but we provide them for self-consistency), the important part of which is located from the "Accessors / Modifiers" section on:

template <template<typename> class ALLOC = std::allocator>
class DuplicateGenerator : public DBRowGenerator<ALLOC> {
public:

  using allocator_type = ALLOC<DBTranslatedValue>;

  // ######################################################################
  // Constructors / Destructors
  // ######################################################################

  DuplicateGenerator( const std::vector<DBTranslatedValueType,
                                 ALLOC<DBTranslatedValueType>> column_types,
                      const std::size_t nb_duplicates,
                      const allocator_type& alloc  = allocator_type () )
    : DBRowGenerator<ALLOC> ( column_types, alloc )
    ,  _nb_duplicates_ ( nb_duplicates ) {}

  DuplicateGenerator( const DuplicateGenerator<ALLOC>& from,
                      const allocator_type& alloc )
    : DBRowGenerator<ALLOC>( from, alloc )
    ,  _input_row_( from. _input_row_ )
    ,  _nb_duplicates_ ( from. _nb_duplicates_ ) {}

  DuplicateGenerator( const DuplicateGenerator<ALLOC>& from )
    : DuplicateGenerator<ALLOC> ( from, from.getAllocator () ) {}

  DuplicateGenerator( DuplicateGenerator<ALLOC>&& from,
                      const allocator_type& alloc )
    : DBRowGenerator<ALLOC> ( std::move( from ), alloc )
    ,  _input_row_( from. _input_row_ )
    ,  _nb_duplicates_ ( from. _nb_duplicates_ ) {}

  DuplicateGenerator( DuplicateGenerator<ALLOC>&& from )
    : DuplicateGenerator<ALLOC> ( std::move(from), from.getAllocator() ) {}

  virtual DuplicateGenerator<ALLOC>*
  clone ( const allocator_type& alloc ) const {
    ALLOC<DuplicateGenerator<ALLOC>> allocator ( alloc );
    DuplicateGenerator<ALLOC>* generator = allocator.allocate(1);
    try { allocator.construct ( generator, *this, alloc ); }
    catch ( ... ) {
      allocator.deallocate ( generator, 1 );
      throw;
    }
    return generator;
  }


  virtual DuplicateGenerator<ALLOC>* clone () const {
    return clone ( this->getAllocator () );
  }

  ~DuplicateGenerator() {}


  // ######################################################################
  // Operators
  // ######################################################################

  DuplicateGenerator<ALLOC>&
  operator=( const DuplicateGenerator<ALLOC>& from ) {
    DBRowGenerator<ALLOC>::operator=( from );
     _input_row_ = from. _input_row_;
     _nb_duplicates_ = from. _nb_duplicates_;
    return *this;
  }

  DuplicateGenerator<ALLOC>& operator=( DuplicateGenerator<ALLOC>&& from ) {
    DBRowGenerator<ALLOC>::operator=( std::move( from ) );
     _input_row_ = from. _input_row_;
     _nb_duplicates_ = from. _nb_duplicates_;
    return *this;
  }


  // ######################################################################
  // Accessors / Modifiers
  // ######################################################################

  virtual const DBRow<DBTranslatedValue,ALLOC>& generate() final {
    this->decreaseRemainingRows();
    return * _input_row_;
  }


protected:

  virtual std::size_t
    computeRows_( const DBRow<DBTranslatedValue,ALLOC>& row ) final {
     _input_row_ = &row;
    return  _nb_duplicates_;
  }


private:
  const DBRow<DBTranslatedValue,ALLOC>*  _input_row_ { nullptr };

  std::size_t  _nb_duplicates_ { std::size_t(1) };
};

Definition at line 235 of file DBRowGenerator.h.

Member Typedef Documentation

allocator_type

template<template< typename > class ALLOC = std::allocator>

using gum::learning::DBRowGenerator< ALLOC >::allocator_type = ALLOC< DBTranslatedValue >

type for the allocators passed in arguments of methods

Definition at line 238 of file DBRowGenerator.h.

Constructor & Destructor Documentation

DBRowGenerator() [1/5]

template<template< typename > class ALLOC = std::allocator>

gum::learning::DBRowGenerator< ALLOC >::DBRowGenerator	(	const std::vector< DBTranslatedValueType, ALLOC< DBTranslatedValueType > >	column_types,
		const DBRowGeneratorGoal	goal,
		const allocator_type &	alloc = allocator_type()
	)

default constructor

Parameters

column_types	indicates for each column whether this is a continuous or a discrete one
alloc	the allocator used by all the methods

DBRowGenerator() [2/5]

template<template< typename > class ALLOC = std::allocator>

gum::learning::DBRowGenerator< ALLOC >::DBRowGenerator

(

const DBRowGenerator< ALLOC > &

from

)

copy constructor

DBRowGenerator() [3/5]

template<template< typename > class ALLOC = std::allocator>

gum::learning::DBRowGenerator< ALLOC >::DBRowGenerator	(	const DBRowGenerator< ALLOC > &	from,
		const allocator_type &	alloc
	)

copy constructor with a given allocator

DBRowGenerator() [4/5]

template<template< typename > class ALLOC = std::allocator>

gum::learning::DBRowGenerator< ALLOC >::DBRowGenerator

(

DBRowGenerator< ALLOC > &&

from

)

move constructor

DBRowGenerator() [5/5]

template<template< typename > class ALLOC = std::allocator>

gum::learning::DBRowGenerator< ALLOC >::DBRowGenerator	(	DBRowGenerator< ALLOC > &&	from,
		const allocator_type &	alloc
	)

move constructor with a given allocator

~DBRowGenerator()

template<template< typename > class ALLOC = std::allocator>

virtual gum::learning::DBRowGenerator< ALLOC >::~DBRowGenerator ( )

virtual

destructor

Member Function Documentation

clone() [1/2]

template<template< typename > class ALLOC = std::allocator>

virtual DBRowGenerator< ALLOC >* gum::learning::DBRowGenerator< ALLOC >::clone ( ) const

pure virtual

virtual copy constructor

Implemented in gum::learning::DBRowGeneratorEM< GUM_SCALAR, ALLOC >, gum::learning::DBRowGenerator4CompleteRows< ALLOC >, and gum::learning::DBRowGeneratorIdentity< ALLOC >.

clone() [2/2]

template<template< typename > class ALLOC = std::allocator>

virtual DBRowGenerator< ALLOC >* gum::learning::DBRowGenerator< ALLOC >::clone ( const allocator_type &  alloc ) const

pure virtual

virtual copy constructor with a given allocator

Implemented in gum::learning::DBRowGeneratorEM< GUM_SCALAR, ALLOC >, gum::learning::DBRowGenerator4CompleteRows< ALLOC >, and gum::learning::DBRowGeneratorIdentity< ALLOC >.

columnsOfInterest()

template<template< typename > class ALLOC = std::allocator>

const std::vector< std::size_t, ALLOC< std::size_t > >& gum::learning::DBRowGenerator< ALLOC >::columnsOfInterest

(

)

const

returns the current set of columns of interest

computeRows_()

template<template< typename > class ALLOC = std::allocator>

virtual std::size_t gum::learning::DBRowGenerator< ALLOC >::computeRows_ ( const DBRow< DBTranslatedValue, ALLOC > &  row )

protectedpure virtual

the method that computes the set of DBRow instances to output after method setInputRow has been called

Implemented in gum::learning::DBRowGeneratorEM< GUM_SCALAR, ALLOC >, gum::learning::DBRowGenerator4CompleteRows< ALLOC >, and gum::learning::DBRowGeneratorIdentity< ALLOC >.

decreaseRemainingRows()

template<template< typename > class ALLOC = std::allocator>

void gum::learning::DBRowGenerator< ALLOC >::decreaseRemainingRows

(

)

decrease the number of remaining output rows

When method setInputRow is performed, the DBRowGenerator knows how many output rows it will be able to generate. Each time method decreaseRemainingRows is called, we decrement this number. When the number becomes equal to 0, then there remains no new output row to generate.

generate()

template<template< typename > class ALLOC = std::allocator>

virtual const DBRow< DBTranslatedValue, ALLOC >& gum::learning::DBRowGenerator< ALLOC >::generate ( )

pure virtual

generate new rows from the input row

Implemented in gum::learning::DBRowGenerator4CompleteRows< ALLOC >, gum::learning::DBRowGeneratorEM< GUM_SCALAR, ALLOC >, and gum::learning::DBRowGeneratorIdentity< ALLOC >.

getAllocator()

template<template< typename > class ALLOC = std::allocator>

allocator_type gum::learning::DBRowGenerator< ALLOC >::getAllocator

(

)

const

returns the allocator used

goal()

template<template< typename > class ALLOC = std::allocator>

DBRowGeneratorGoal gum::learning::DBRowGenerator< ALLOC >::goal

(

)

const

returns the goal of the DBRowGenerator

hasRows()

template<template< typename > class ALLOC = std::allocator>

bool gum::learning::DBRowGenerator< ALLOC >::hasRows

(

)

returns true if there are still rows that can be output by the DBRowGenerator

operator=() [1/2]

template<template< typename > class ALLOC = std::allocator>

DBRowGenerator< ALLOC >& gum::learning::DBRowGenerator< ALLOC >::operator= ( const DBRowGenerator< ALLOC > &  )

protected

copy constructor

operator=() [2/2]

template<template< typename > class ALLOC = std::allocator>

DBRowGenerator< ALLOC >& gum::learning::DBRowGenerator< ALLOC >::operator= ( DBRowGenerator< ALLOC > &&  )

protected

move constructor

reset()

template<template< typename > class ALLOC = std::allocator>

virtual void gum::learning::DBRowGenerator< ALLOC >::reset ( )

virtual

resets the generator. There are therefore no more ouput row to generate

setColumnsOfInterest() [1/2]

template<template< typename > class ALLOC = std::allocator>

virtual void gum::learning::DBRowGenerator< ALLOC >::setColumnsOfInterest ( const std::vector< std::size_t, ALLOC< std::size_t > > &  cols_of_interest )

virtual

sets the columns of interest: the output DBRow needs only contain correct values fot these columns

This method is useful, e.g., for EM-like algorithms that need to know which unobserved variables/values need be filled. In this case, the DBRowGenerator still outputs DBRows with the same columns as the DatabaseTable, but only the columns of these DBRows corresponding to those passed in argument to Method setColumnsOfInterest are meaningful. For instance, if a DatabaseTable contains 10 columns and Method setColumnsOfInterest() is applied with vector<> { 0, 3, 4 }, then the DBRowGenerator will output DBRows with 10 columns, in which only columns 0, 3 and 4 are guaranteed to have correct values (columns are always indexed, starting from 0).

setColumnsOfInterest() [2/2]

template<template< typename > class ALLOC = std::allocator>

virtual void gum::learning::DBRowGenerator< ALLOC >::setColumnsOfInterest ( std::vector< std::size_t, ALLOC< std::size_t > > &&  cols_of_interest )

virtual

sets the columns of interest: the output DBRow needs only contain correct values fot these columns

This method is useful, e.g., for EM-like algorithms that need to know which unobserved variables/values need be filled. In this case, the DBRowGenerator still outputs DBRows with the same columns as the DatabaseTable, but only the columns of these DBRows corresponding to those passed in argument to Method setColumnsOfInterest are meaningful. For instance, if a DatabaseTable contains 10 columns and Method setColumnsOfInterest() is applied with vector<> { 0, 3, 4 }, then the DBRowGenerator will output DBRows with 10 columns, in which only columns 0, 3 and 4 are guaranteed to have correct values (columns are always indexed, starting from 0).

setInputRow()

template<template< typename > class ALLOC = std::allocator>

bool gum::learning::DBRowGenerator< ALLOC >::setInputRow

(

const DBRow< DBTranslatedValue, ALLOC > &

row

)

sets the input row from which the generator will create its output rows

Returns

a Boolean indicating whether, from this input DBRow, the DBRowGenerator is capable of outputing at least one row or not

Member Data Documentation

column_types_

template<template< typename > class ALLOC = std::allocator>

std::vector< DBTranslatedValueType, ALLOC< DBTranslatedValueType > > gum::learning::DBRowGenerator< ALLOC >::column_types_

protected

the types of the columns in the DatabaseTable

This is useful to determine whether we need to use the .discr_val field or the .cont_val field in DBTranslatedValue instances.

Definition at line 361 of file DBRowGenerator.h.

columns_of_interest_

template<template< typename > class ALLOC = std::allocator>

std::vector< std::size_t, ALLOC< std::size_t > > gum::learning::DBRowGenerator< ALLOC >::columns_of_interest_

protected

the set of columns of interest

Definition at line 364 of file DBRowGenerator.h.

goal_

template<template< typename > class ALLOC = std::allocator>

DBRowGeneratorGoal gum::learning::DBRowGenerator< ALLOC >::goal_ {DBRowGeneratorGoal::OTHER_THINGS_THAN_REMOVE_MISSING_VALUES}

protected

the goal of the DBRowGenerator (just remove missing values or not)

Definition at line 367 of file DBRowGenerator.h.

nb_remaining_output_rows_

template<template< typename > class ALLOC = std::allocator>

std::size_t gum::learning::DBRowGenerator< ALLOC >::nb_remaining_output_rows_ {std::size_t(0)}

protected

the number of output rows still to retrieve through the generate method

Definition at line 356 of file DBRowGenerator.h.

---

The documentation for this class was generated from the following file:

• agrum/tools/database/DBRowGenerator.h