![]() |
aGrUM 3.3.2
a C++ library for (probabilistic) graphical models
|
<agrum/FMDP/planning/treeOperatorStrategy.h> More...
#include <treeOperatorStrategy.h>
Public Member Functions | |
Constructor & destructor. | |
| TreeOperatorStrategy () | |
| Default constructor. | |
| ~TreeOperatorStrategy () override | |
| Default destructor. | |
| MultiDimFunctionGraph< GUM_ELEMENT, ExactTerminalNodePolicy > * | getFunctionInstance () override |
| MultiDimFunctionGraph< ArgMaxSet< GUM_ELEMENT, Idx >, SetTerminalNodePolicy > * | getArgMaxFunctionInstance () override |
| MultiDimFunctionGraph< ActionSet, SetTerminalNodePolicy > * | getAggregatorInstance () override |
Protected Member Functions | |
| MultiDimFunctionGraph< GUM_ELEMENT > * | frameTransition_ (const DiscreteVariable *x, const DiscreteVariable *xp) |
| Returns a new function graph P(x'|x) = [x' == x]. | |
| void | deleteFunctionGraph_ (const MultiDimFunctionGraph< GUM_ELEMENT > *f1, const MultiDimFunctionGraph< GUM_ELEMENT > *f2, Idx del) |
| void | deleteFunctionGraph_ (const MultiDimFunctionGraph< ArgMaxSet< GUM_ELEMENT, Idx >, SetTerminalNodePolicy > *f1, const MultiDimFunctionGraph< ArgMaxSet< GUM_ELEMENT, Idx >, SetTerminalNodePolicy > *f2, Idx del) |
Graph Function Operations Methods | |
| MultiDimFunctionGraph< GUM_ELEMENT > * | regress (const MultiDimFunctionGraph< GUM_ELEMENT > *Vold, Idx actionId, const FMDP< GUM_ELEMENT > *fmdp, const gum::VariableSet &elVarSeq) override |
| Computes Qaction for given actionid. | |
| MultiDimFunctionGraph< GUM_ELEMENT > * | maximize (const MultiDimFunctionGraph< GUM_ELEMENT > *f1, const MultiDimFunctionGraph< GUM_ELEMENT > *f2, Idx del=3) override |
| MultiDimFunctionGraph< GUM_ELEMENT > * | minimize (const MultiDimFunctionGraph< GUM_ELEMENT > *f1, const MultiDimFunctionGraph< GUM_ELEMENT > *f2, Idx del=3) override |
| MultiDimFunctionGraph< GUM_ELEMENT > * | multiply (const MultiDimFunctionGraph< GUM_ELEMENT > *f1, const MultiDimFunctionGraph< GUM_ELEMENT > *f2, Idx del=3) override |
| MultiDimFunctionGraph< ArgMaxSet< GUM_ELEMENT, Idx >, SetTerminalNodePolicy > * | argmaximize (const MultiDimFunctionGraph< ArgMaxSet< GUM_ELEMENT, Idx >, SetTerminalNodePolicy > *f1, const MultiDimFunctionGraph< ArgMaxSet< GUM_ELEMENT, Idx >, SetTerminalNodePolicy > *f2, Idx del=3) override |
| ArgMaximizes between f2 and f1. | |
| MultiDimFunctionGraph< GUM_ELEMENT > * | add (const MultiDimFunctionGraph< GUM_ELEMENT > *f1, const MultiDimFunctionGraph< GUM_ELEMENT > *f2, Idx del=1) override |
| Adds reward to given function( whether a f2 or f1). | |
| MultiDimFunctionGraph< GUM_ELEMENT > * | subtract (const MultiDimFunctionGraph< GUM_ELEMENT > *f1, const MultiDimFunctionGraph< GUM_ELEMENT > *f2, Idx del=0) override |
| Subtract current f1 from old f1 to see if threshold is reached or not. | |
<agrum/FMDP/planning/treeOperatorStrategy.h>
A class to find optimal policy for a given FMDP.
Perform a TreeOperatorStrategy planning on given in parameter factored markov decision process
Definition at line 70 of file treeOperatorStrategy.h.
| gum::TreeOperatorStrategy< GUM_ELEMENT >::TreeOperatorStrategy | ( | ) |
Default constructor.
Definition at line 87 of file treeOperatorStrategy_tpl.h.
References TreeOperatorStrategy().
Referenced by TreeOperatorStrategy(), and ~TreeOperatorStrategy().
|
override |
Default destructor.
Definition at line 95 of file treeOperatorStrategy_tpl.h.
References TreeOperatorStrategy().
|
overrideprotectedvirtual |
Adds reward to given function( whether a f2 or f1).
| reward | : R(s) or R(s,a) |
| function | : either V(s) or Q(s,a) |
Implements gum::IOperatorStrategy< GUM_ELEMENT >.
Definition at line 214 of file treeOperatorStrategy_tpl.h.
References gum::TreeOperator< GUM_ELEMENT, COMBINEOPERATOR, TerminalNodePolicy >::compute(), and gum::IOperatorStrategy< GUM_ELEMENT >::deleteFunctionGraph_().
|
overrideprotectedvirtual |
ArgMaximizes between f2 and f1.
Implements gum::IOperatorStrategy< GUM_ELEMENT >.
Definition at line 194 of file treeOperatorStrategy_tpl.h.
References gum::TreeOperator< GUM_ELEMENT, COMBINEOPERATOR, TerminalNodePolicy >::compute(), and gum::IOperatorStrategy< GUM_ELEMENT >::deleteFunctionGraph_().
|
protectedinherited |
Definition at line 78 of file IOperatorStrategy_tpl.h.
|
protectedinherited |
Definition at line 69 of file IOperatorStrategy_tpl.h.
Referenced by gum::MDDOperatorStrategy< GUM_ELEMENT >::add(), gum::TreeOperatorStrategy< GUM_ELEMENT >::add(), gum::MDDOperatorStrategy< GUM_ELEMENT >::argmaximize(), gum::TreeOperatorStrategy< GUM_ELEMENT >::argmaximize(), gum::MDDOperatorStrategy< GUM_ELEMENT >::maximize(), gum::TreeOperatorStrategy< GUM_ELEMENT >::maximize(), gum::MDDOperatorStrategy< GUM_ELEMENT >::minimize(), gum::TreeOperatorStrategy< GUM_ELEMENT >::minimize(), gum::MDDOperatorStrategy< GUM_ELEMENT >::multiply(), gum::TreeOperatorStrategy< GUM_ELEMENT >::multiply(), subtract(), gum::MDDOperatorStrategy< GUM_ELEMENT >::subtract(), and gum::TreeOperatorStrategy< GUM_ELEMENT >::subtract().
|
protectedinherited |
Returns a new function graph P(x'|x) = [x' == x].
It is the transition of a frame variable x, i.e., a variable with no transition for a given action: it keeps its value. The caller owns the returned function graph.
| x | the main variable |
| xp | its primed version |
Definition at line 49 of file IOperatorStrategy_tpl.h.
References gum::MultiDimFunctionGraph< GUM_ELEMENT, TerminalNodePolicy >::add(), gum::DiscreteVariable::domainSize(), getFunctionInstance(), and gum::MultiDimFunctionGraph< GUM_ELEMENT, TerminalNodePolicy >::manager().
Referenced by gum::MDDOperatorStrategy< GUM_ELEMENT >::regress(), gum::TreeOperatorStrategy< GUM_ELEMENT >::regress(), and subtract().
|
overridevirtual |
Implements gum::IOperatorStrategy< GUM_ELEMENT >.
Definition at line 255 of file treeOperatorStrategy_tpl.h.
References gum::MultiDimFunctionGraph< GUM_ELEMENT, TerminalNodePolicy >::getTreeInstance().
|
overridevirtual |
Implements gum::IOperatorStrategy< GUM_ELEMENT >.
Definition at line 248 of file treeOperatorStrategy_tpl.h.
|
overridevirtual |
Implements gum::IOperatorStrategy< GUM_ELEMENT >.
Definition at line 242 of file treeOperatorStrategy_tpl.h.
References gum::MultiDimFunctionGraph< GUM_ELEMENT, TerminalNodePolicy >::getTreeInstance().
|
overrideprotectedvirtual |
Implements gum::IOperatorStrategy< GUM_ELEMENT >.
Definition at line 152 of file treeOperatorStrategy_tpl.h.
References gum::TreeOperator< GUM_ELEMENT, COMBINEOPERATOR, TerminalNodePolicy >::compute(), and gum::IOperatorStrategy< GUM_ELEMENT >::deleteFunctionGraph_().
|
overrideprotectedvirtual |
Implements gum::IOperatorStrategy< GUM_ELEMENT >.
Definition at line 166 of file treeOperatorStrategy_tpl.h.
References gum::TreeOperator< GUM_ELEMENT, COMBINEOPERATOR, TerminalNodePolicy >::compute(), and gum::IOperatorStrategy< GUM_ELEMENT >::deleteFunctionGraph_().
|
overrideprotectedvirtual |
Implements gum::IOperatorStrategy< GUM_ELEMENT >.
Definition at line 179 of file treeOperatorStrategy_tpl.h.
References gum::TreeOperator< GUM_ELEMENT, COMBINEOPERATOR, TerminalNodePolicy >::compute(), and gum::IOperatorStrategy< GUM_ELEMENT >::deleteFunctionGraph_().
|
overrideprotectedvirtual |
Computes Qaction for given actionid.
Performs a multiplication/projection on given qAction.
| qAction | : the computed Q(s,a) |
| pxip | : the transition probabilities for the xip variable |
| xip | : the variable we eliminate on the projection |
Implements gum::IOperatorStrategy< GUM_ELEMENT >.
Definition at line 116 of file treeOperatorStrategy_tpl.h.
References gum::TreeRegress< GUM_ELEMENT, COMBINEOPERATOR, PROJECTOPERATOR, TerminalNodePolicy >::compute(), gum::BijectionImplementation< T1, T2, std::is_scalar< T1 >::value &&std::is_scalar< T2 >::value >::first(), gum::IOperatorStrategy< GUM_ELEMENT >::frameTransition_(), gum::BijectionImplementation< T1, T2, Gen >::insert(), gum::FMDP< GUM_ELEMENT >::mapMainPrime(), RECAST, gum::FMDP< GUM_ELEMENT >::transition(), and gum::MultiDimImplementation< GUM_ELEMENT >::variablesSequence().
|
overrideprotectedvirtual |
Subtract current f1 from old f1 to see if threshold is reached or not.
| old | and new VFuntion |
Implements gum::IOperatorStrategy< GUM_ELEMENT >.
Definition at line 231 of file treeOperatorStrategy_tpl.h.
References gum::TreeOperator< GUM_ELEMENT, COMBINEOPERATOR, TerminalNodePolicy >::compute(), and gum::IOperatorStrategy< GUM_ELEMENT >::deleteFunctionGraph_().