gum::FMDPSimulator Class Reference

<agrum/FMDP/simulation/fmdpSimulator.h> More...

#include <fmdpSimulator.h>

Inheritance diagram for gum::FMDPSimulator:

Collaboration diagram for gum::FMDPSimulator:

Public Attributes
Instantiation	currentState_
	Tha state in which the system currently is. More...
Instantiation	endState_

Public Member Functions
Constructors, Destructors.
	FMDPSimulator (const FMDP< double > *fmdp)
	Default constructor. More...
	FMDPSimulator (const std::string &resource)
	Default constructor. More...
	~FMDPSimulator ()
	Default destructor. More...
double	reward ()
	Sets the intial statefrom which we begun the simulation. More...
void	perform (Idx)
	Sets the intial statefrom which we begun the simulation. More...
const DiscreteVariable *	primeVar (const DiscreteVariable *mainVar)
	Iteration over the variables of the simulated probleme. More...
SequenceIteratorSafe< const DiscreteVariable *>	beginVariables ()
	Iteration over the variables of the simulated probleme. More...
SequenceIteratorSafe< const DiscreteVariable *>	endVariables ()
	Iteration over the variables of the simulated probleme. More...
virtual const std::string &	actionName (Idx actionId)
	Iteration over the variables of the simulated probleme. More...
SequenceIteratorSafe< Idx >	beginActions ()
	Iteration over the variables of the simulated probleme. More...
SequenceIteratorSafe< Idx >	endActions ()
	Iteration over the variables of the simulated probleme. More...

Protected Member Functions
virtual double	transitionProbability_ (const DiscreteVariable *var, const Instantiation &transit, Idx actionId)
INLINE void	setInitialState (const Instantiation &initialState)
	Sets the intial statefrom which we begun the simulation. More...
void	setInitialStateRandomly ()
	Sets the intial statefrom which we begun the simulation. More...
INLINE void	setEndState (const Instantiation &endState)
	Sets the final states upon which a run is over. More...
virtual bool	hasReachEnd ()
	Tests if end state has been reached. More...
INLINE const Instantiation &	currentState ()
	Sets the intial statefrom which we begun the simulation. More...
virtual Instantiation	randomState_ ()
	Choses a random state as the first test for a run. More...

Detailed Description

<agrum/FMDP/simulation/fmdpSimulator.h>

A class to simulate a Factored Markov Decision Process.

Definition at line 48 of file fmdpSimulator.h.

Constructor & Destructor Documentation

FMDPSimulator() [1/2]

gum::FMDPSimulator::FMDPSimulator

(

const FMDP< double > *

fmdp

)

Default constructor.

Definition at line 47 of file fmdpSimulator.cpp.

References gum::Set< Key, Alloc >::emplace().

                                                         :
      AbstractSimulator(), fmdp__(const_cast< FMDP< double >* >(fmdp)),
      loaded__(false) {
    GUM_CONSTRUCTOR(FMDPSimulator);
  }

Here is the call graph for this function:

FMDPSimulator() [2/2]

gum::FMDPSimulator::FMDPSimulator

(

const std::string &

resource

)

Default constructor.

Definition at line 53 of file fmdpSimulator.cpp.

References gum::Set< Key, Alloc >::emplace().

                                                         :
      AbstractSimulator(), loaded__(true) {
    GUM_CONSTRUCTOR(FMDPSimulator);

    fmdp__ = new FMDP< double >(true);
    FMDPDatReader< double > reader(fmdp__, ressource);
    reader.trace(false);
    reader.proceed();
  }

Here is the call graph for this function:

~FMDPSimulator()

gum::FMDPSimulator::~FMDPSimulator

(

)

Default destructor.

Definition at line 66 of file fmdpSimulator.cpp.

References gum::Set< Key, Alloc >::emplace().

                                {
    GUM_DESTRUCTOR(FMDPSimulator);
    if (loaded__) delete fmdp__;
  }

Here is the call graph for this function:

Member Function Documentation

actionName()

virtual const std::string& gum::FMDPSimulator::actionName ( Idx  actionId )

inlinevirtual

Iteration over the variables of the simulated probleme.

Implements gum::AbstractSimulator.

Definition at line 104 of file fmdpSimulator.h.

                                                      {
      return fmdp__->actionName(actionId);
    }

beginActions()

SequenceIteratorSafe< Idx > gum::FMDPSimulator::beginActions ( )

inlinevirtual

Iteration over the variables of the simulated probleme.

Implements gum::AbstractSimulator.

Definition at line 109 of file fmdpSimulator.h.

{ return fmdp__->beginActions(); }

beginVariables()

SequenceIteratorSafe< const DiscreteVariable* > gum::FMDPSimulator::beginVariables ( )

inlinevirtual

Iteration over the variables of the simulated probleme.

Implements gum::AbstractSimulator.

Definition at line 90 of file fmdpSimulator.h.

                                                                     {
      return fmdp__->beginVariables();
    }

currentState()

INLINE const Instantiation& gum::AbstractSimulator::currentState ( )

inlineinherited

Sets the intial statefrom which we begun the simulation.

Definition at line 91 of file abstractSimulator.h.

References gum::AbstractSimulator::reward().

{ return currentState_; }

Here is the call graph for this function:

endActions()

SequenceIteratorSafe< Idx > gum::FMDPSimulator::endActions ( )

inlinevirtual

Iteration over the variables of the simulated probleme.

Implements gum::AbstractSimulator.

Definition at line 110 of file fmdpSimulator.h.

{ return fmdp__->endActions(); }

endVariables()

SequenceIteratorSafe< const DiscreteVariable* > gum::FMDPSimulator::endVariables ( )

inlinevirtual

Iteration over the variables of the simulated probleme.

Implements gum::AbstractSimulator.

Definition at line 93 of file fmdpSimulator.h.

                                                                   {
      return fmdp__->endVariables();
    }

hasReachEnd()

bool gum::AbstractSimulator::hasReachEnd ( )

virtualinherited

Tests if end state has been reached.

Reimplemented in gum::FactorySimulator, and gum::TaxiSimulator.

Definition at line 79 of file abstractSimulator.cpp.

References gum::Set< Key, Alloc >::emplace().

                                      {
    if (endState_.empty()) return false;

    for (auto varIter = endState_.variablesSequence().beginSafe();
         varIter != endState_.variablesSequence().endSafe();
         ++varIter)
      if (endState_.val(**varIter) != currentState_.val(**varIter)) return false;
    return true;
  }

Here is the call graph for this function:

perform()

void gum::FMDPSimulator::perform ( Idx  )

virtual

Sets the intial statefrom which we begun the simulation.

Implements gum::AbstractSimulator.

Definition at line 76 of file fmdpSimulator.cpp.

References gum::Set< Key, Alloc >::emplace().

                                          {
    Instantiation newState;
    for (auto varIter = this->beginVariables(); varIter != this->endVariables();
         ++varIter) {
      newState.add(**varIter);
      Instantiation transit(currentState_);
      transit.add(*(this->primeVar(*varIter)));

      double proba = (double)std::rand() / (double)RAND_MAX;
      double cdd   = 0.0;
      for (transit.setFirstOut(currentState_); !transit.end();
           transit.incOut(currentState_)) {
        cdd += this->transitionProbability_(*varIter, transit, actionId);
        if (proba <= cdd) {
          newState.chgVal(**varIter, transit.val(*(this->primeVar(*varIter))));
          break;
        }
      }
    }
    currentState_ = newState;
  }

Here is the call graph for this function:

primeVar()

const DiscreteVariable* gum::FMDPSimulator::primeVar ( const DiscreteVariable *  mainVar )

inlinevirtual

Iteration over the variables of the simulated probleme.

Implements gum::AbstractSimulator.

Definition at line 85 of file fmdpSimulator.h.

                                                                      {
      return fmdp__->main2prime(mainVar);
    }

randomState_()

Instantiation gum::AbstractSimulator::randomState_ ( )

protectedvirtualinherited

Choses a random state as the first test for a run.

Reimplemented in gum::FactorySimulator, and gum::TaxiSimulator.

Definition at line 66 of file abstractSimulator.cpp.

References gum::Set< Key, Alloc >::emplace().

                                                {
    Instantiation retState;
    for (auto varIter = this->beginVariables(); varIter != this->endVariables();
         ++varIter) {
      retState.add(**varIter);
      retState.chgVal(*varIter,
                      (Idx)(((double)std::rand() / (double)RAND_MAX)
                            * (double)(*varIter)->domainSize()));
    }
    return retState;
  }

Here is the call graph for this function:

reward()

double gum::FMDPSimulator::reward ( )

inlinevirtual

Sets the intial statefrom which we begun the simulation.

Implements gum::AbstractSimulator.

Definition at line 74 of file fmdpSimulator.h.

{ return fmdp__->reward()->get(this->currentState_); }

setEndState()

INLINE void gum::AbstractSimulator::setEndState ( const Instantiation &  endState )

inlineinherited

Sets the final states upon which a run is over.

Definition at line 83 of file abstractSimulator.h.

References gum::AbstractSimulator::reward().

                                                           {
      endState_ = endState;
    }

Here is the call graph for this function:

setInitialState()

INLINE void gum::AbstractSimulator::setInitialState ( const Instantiation &  initialState )

inlineinherited

Sets the intial statefrom which we begun the simulation.

Definition at line 72 of file abstractSimulator.h.

References gum::AbstractSimulator::reward().

                                                                   {
      currentState_ = initialState;
    }

Here is the call graph for this function:

setInitialStateRandomly()

void gum::AbstractSimulator::setInitialStateRandomly ( )

inherited

Sets the intial statefrom which we begun the simulation.

Definition at line 58 of file abstractSimulator.cpp.

References gum::Set< Key, Alloc >::emplace().

                                                  {
    bool hre = true;
    while (hre) {
      currentState_ = randomState_();
      hre           = hasReachEnd();
    }
  }

Here is the call graph for this function:

transitionProbability_()

virtual double gum::FMDPSimulator::transitionProbability_ ( const DiscreteVariable *  var, const Instantiation &  transit, Idx  actionId  )

inlineprotectedvirtual

Definition at line 114 of file fmdpSimulator.h.

                                                                            {
      return reinterpret_cast< const MultiDimFunctionGraph< double >* >(
                fmdp__->transition(actionId, var))
         ->get(transit);
    }

Member Data Documentation

currentState_

Instantiation gum::AbstractSimulator::currentState_

inherited

Tha state in which the system currently is.

Definition at line 129 of file abstractSimulator.h.

endState_

Instantiation gum::AbstractSimulator::endState_

inherited

Definition at line 129 of file abstractSimulator.h.

fmdp__

FMDP< double >* gum::FMDPSimulator::fmdp__

private

The Factored Markov Decision Process that describes how the system evolves.

Definition at line 125 of file fmdpSimulator.h.

loaded__

const bool gum::FMDPSimulator::loaded__

private

Just to know if it should be deleted in the end.

Definition at line 128 of file fmdpSimulator.h.

---

The documentation for this class was generated from the following files:

• agrum/FMDP/simulation/fmdpSimulator.h
• agrum/FMDP/simulation/fmdpSimulator.cpp