gum::FMDPSimulator Class Reference

<agrum/FMDP/simulation/fmdpSimulator.h> More...

#include <fmdpSimulator.h>

Inheritance diagram for gum::FMDPSimulator:

Collaboration diagram for gum::FMDPSimulator:

Public Attributes
Instantiation	currentState_
	Tha state in which the system currently is. More...
Instantiation	endState_

Public Member Functions
Constructors, Destructors.
	FMDPSimulator (const FMDP< double > *fmdp)
	Default constructor. More...
	FMDPSimulator (const std::string &resource)
	Default constructor. More...
	~FMDPSimulator ()
	Default destructor. More...
double	reward ()
	Sets the intial statefrom which we begun the simulation. More...
void	perform (Idx)
	Sets the intial statefrom which we begun the simulation. More...
const DiscreteVariable *	primeVar (const DiscreteVariable *mainVar)
	Iteration over the variables of the simulated probleme. More...
SequenceIteratorSafe< const DiscreteVariable *>	beginVariables ()
	Iteration over the variables of the simulated probleme. More...
SequenceIteratorSafe< const DiscreteVariable *>	endVariables ()
	Iteration over the variables of the simulated probleme. More...
virtual const std::string &	actionName (Idx actionId)
	Iteration over the variables of the simulated probleme. More...
SequenceIteratorSafe< Idx >	beginActions ()
	Iteration over the variables of the simulated probleme. More...
SequenceIteratorSafe< Idx >	endActions ()
	Iteration over the variables of the simulated probleme. More...

Protected Member Functions
virtual double	transitionProbability_ (const DiscreteVariable *var, const Instantiation &transit, Idx actionId)
INLINE void	setInitialState (const Instantiation &initialState)
	Sets the intial statefrom which we begun the simulation. More...
void	setInitialStateRandomly ()
	Sets the intial statefrom which we begun the simulation. More...
INLINE void	setEndState (const Instantiation &endState)
	Sets the final states upon which a run is over. More...
virtual bool	hasReachEnd ()
	Tests if end state has been reached. More...
INLINE const Instantiation &	currentState ()
	Sets the intial statefrom which we begun the simulation. More...
virtual Instantiation	randomState_ ()
	Choses a random state as the first test for a run. More...

Detailed Description

<agrum/FMDP/simulation/fmdpSimulator.h>

A class to simulate a Factored Markov Decision Process.

Definition at line 48 of file fmdpSimulator.h.

Constructor & Destructor Documentation

FMDPSimulator() [1/2]

gum::FMDPSimulator::FMDPSimulator

(

const FMDP< double > *

fmdp

)

Default constructor.

Definition at line 47 of file fmdpSimulator.cpp.

References gum::Set< Key, Alloc >::emplace().

                                                         :
      AbstractSimulator(), _fmdp_(const_cast< FMDP< double >* >(fmdp)), _loaded_(false) {
    GUM_CONSTRUCTOR(FMDPSimulator);
  }

Here is the call graph for this function:

FMDPSimulator() [2/2]

gum::FMDPSimulator::FMDPSimulator

(

const std::string &

resource

)

Default constructor.

Definition at line 52 of file fmdpSimulator.cpp.

References gum::Set< Key, Alloc >::emplace().

                                                         : AbstractSimulator(), _loaded_(true) {
    GUM_CONSTRUCTOR(FMDPSimulator);

    _fmdp_ = new FMDP< double >(true);
    FMDPDatReader< double > reader(_fmdp_, ressource);
    reader.trace(false);
    reader.proceed();
  }

Here is the call graph for this function:

~FMDPSimulator()

gum::FMDPSimulator::~FMDPSimulator

(

)

Default destructor.

Definition at line 64 of file fmdpSimulator.cpp.

References gum::Set< Key, Alloc >::emplace().

                                {
    GUM_DESTRUCTOR(FMDPSimulator);
    if (_loaded_) delete _fmdp_;
  }

Here is the call graph for this function:

Member Function Documentation

actionName()

virtual const std::string& gum::FMDPSimulator::actionName ( Idx  actionId )

inlinevirtual

Iteration over the variables of the simulated probleme.

Implements gum::AbstractSimulator.

Definition at line 104 of file fmdpSimulator.h.

{ return _fmdp_->actionName(actionId); }

beginActions()

SequenceIteratorSafe< Idx > gum::FMDPSimulator::beginActions ( )

inlinevirtual

Iteration over the variables of the simulated probleme.

Implements gum::AbstractSimulator.

Definition at line 107 of file fmdpSimulator.h.

{ return _fmdp_->beginActions(); }

beginVariables()

SequenceIteratorSafe< const DiscreteVariable* > gum::FMDPSimulator::beginVariables ( )

inlinevirtual

Iteration over the variables of the simulated probleme.

Implements gum::AbstractSimulator.

Definition at line 90 of file fmdpSimulator.h.

                                                                     {
      return _fmdp_->beginVariables();
    }

currentState()

INLINE const Instantiation& gum::AbstractSimulator::currentState ( )

inlineinherited

Sets the intial statefrom which we begun the simulation.

Definition at line 87 of file abstractSimulator.h.

References gum::AbstractSimulator::reward().

{ return currentState_; }

Here is the call graph for this function:

endActions()

SequenceIteratorSafe< Idx > gum::FMDPSimulator::endActions ( )

inlinevirtual

Iteration over the variables of the simulated probleme.

Implements gum::AbstractSimulator.

Definition at line 108 of file fmdpSimulator.h.

{ return _fmdp_->endActions(); }

endVariables()

SequenceIteratorSafe< const DiscreteVariable* > gum::FMDPSimulator::endVariables ( )

inlinevirtual

Iteration over the variables of the simulated probleme.

Implements gum::AbstractSimulator.

Definition at line 93 of file fmdpSimulator.h.

                                                                   {
      return _fmdp_->endVariables();
    }

hasReachEnd()

bool gum::AbstractSimulator::hasReachEnd ( )

virtualinherited

Tests if end state has been reached.

Reimplemented in gum::FactorySimulator, and gum::TaxiSimulator.

Definition at line 84 of file abstractSimulator.cpp.

References gum::Set< Key, Alloc >::emplace().

                                      {
    if (endState_.empty()) return false;

    for (auto varIter = endState_.variablesSequence().beginSafe();
         varIter != endState_.variablesSequence().endSafe();
         ++varIter)
      if (endState_.val(**varIter) != currentState_.val(**varIter)) return false;
    return true;
  }

Here is the call graph for this function:

perform()

void gum::FMDPSimulator::perform ( Idx  )

virtual

Sets the intial statefrom which we begun the simulation.

Implements gum::AbstractSimulator.

Definition at line 74 of file fmdpSimulator.cpp.

References gum::Set< Key, Alloc >::emplace().

                                          {
    Instantiation newState;
    for (auto varIter = this->beginVariables(); varIter != this->endVariables(); ++varIter) {
      newState.add(**varIter);
      Instantiation transit(currentState_);
      transit.add(*(this->primeVar(*varIter)));

      double proba = (double)std::rand() / (double)RAND_MAX;
      double cdd   = 0.0;
      for (transit.setFirstOut(currentState_); !transit.end(); transit.incOut(currentState_)) {
        cdd += this->transitionProbability_(*varIter, transit, actionId);
        if (proba <= cdd) {
          newState.chgVal(**varIter, transit.val(*(this->primeVar(*varIter))));
          break;
        }
      }
    }
    currentState_ = newState;
  }

Here is the call graph for this function:

primeVar()

const DiscreteVariable* gum::FMDPSimulator::primeVar ( const DiscreteVariable *  mainVar )

inlinevirtual

Iteration over the variables of the simulated probleme.

Implements gum::AbstractSimulator.

Definition at line 85 of file fmdpSimulator.h.

                                                                      {
      return _fmdp_->main2prime(mainVar);
    }

randomState_()

Instantiation gum::AbstractSimulator::randomState_ ( )

protectedvirtualinherited

Choses a random state as the first test for a run.

Reimplemented in gum::FactorySimulator, and gum::TaxiSimulator.

Definition at line 72 of file abstractSimulator.cpp.

References gum::Set< Key, Alloc >::emplace().

                                                {
    Instantiation retState;
    for (auto varIter = this->beginVariables(); varIter != this->endVariables(); ++varIter) {
      retState.add(**varIter);
      retState.chgVal(
         *varIter,
         (Idx)(((double)std::rand() / (double)RAND_MAX) * (double)(*varIter)->domainSize()));
    }
    return retState;
  }

Here is the call graph for this function:

reward()

double gum::FMDPSimulator::reward ( )

inlinevirtual

Sets the intial statefrom which we begun the simulation.

Implements gum::AbstractSimulator.

Definition at line 74 of file fmdpSimulator.h.

{ return _fmdp_->reward()->get(this->currentState_); }

setEndState()

INLINE void gum::AbstractSimulator::setEndState ( const Instantiation &  endState )

inlineinherited

Sets the final states upon which a run is over.

Definition at line 81 of file abstractSimulator.h.

References gum::AbstractSimulator::reward().

{ endState_ = endState; }

Here is the call graph for this function:

setInitialState()

INLINE void gum::AbstractSimulator::setInitialState ( const Instantiation &  initialState )

inlineinherited

Sets the intial statefrom which we begun the simulation.

Definition at line 72 of file abstractSimulator.h.

References gum::AbstractSimulator::reward().

{ currentState_ = initialState; }

Here is the call graph for this function:

setInitialStateRandomly()

void gum::AbstractSimulator::setInitialStateRandomly ( )

inherited

Sets the intial statefrom which we begun the simulation.

Definition at line 64 of file abstractSimulator.cpp.

References gum::Set< Key, Alloc >::emplace().

                                                  {
    bool hre = true;
    while (hre) {
      currentState_ = randomState_();
      hre           = hasReachEnd();
    }
  }

Here is the call graph for this function:

transitionProbability_()

virtual double gum::FMDPSimulator::transitionProbability_ ( const DiscreteVariable *  var, const Instantiation &  transit, Idx  actionId  )

inlineprotectedvirtual

Definition at line 112 of file fmdpSimulator.h.

                                                                            {
      return reinterpret_cast< const MultiDimFunctionGraph< double >* >(
                _fmdp_->transition(actionId, var))
         ->get(transit);
    }

Member Data Documentation

_fmdp_

FMDP< double >* gum::FMDPSimulator::_fmdp_

private

The Factored Markov Decision Process that describes how the system evolves.

Definition at line 123 of file fmdpSimulator.h.

_loaded_

const bool gum::FMDPSimulator::_loaded_

private

Just to know if it should be deleted in the end.

Definition at line 126 of file fmdpSimulator.h.

currentState_

Instantiation gum::AbstractSimulator::currentState_

inherited

Tha state in which the system currently is.

Definition at line 125 of file abstractSimulator.h.

endState_

Instantiation gum::AbstractSimulator::endState_

inherited

Definition at line 125 of file abstractSimulator.h.

---

The documentation for this class was generated from the following files:

• agrum/FMDP/simulation/fmdpSimulator.h
• agrum/FMDP/simulation/fmdpSimulator.cpp