aGrUM 2.3.2
a C++ library for (probabilistic) graphical models
fmdpSimulator.h
Go to the documentation of this file.
1/****************************************************************************
2 * This file is part of the aGrUM/pyAgrum library. *
3 * *
4 * Copyright (c) 2005-2025 by *
5 * - Pierre-Henri WUILLEMIN(_at_LIP6) *
6 * - Christophe GONZALES(_at_AMU) *
7 * *
8 * The aGrUM/pyAgrum library is free software; you can redistribute it *
9 * and/or modify it under the terms of either : *
10 * *
11 * - the GNU Lesser General Public License as published by *
12 * the Free Software Foundation, either version 3 of the License, *
13 * or (at your option) any later version, *
14 * - the MIT license (MIT), *
15 * - or both in dual license, as here. *
16 * *
17 * (see https://agrum.gitlab.io/articles/dual-licenses-lgplv3mit.html) *
18 * *
19 * This aGrUM/pyAgrum library is distributed in the hope that it will be *
20 * useful, but WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, *
21 * INCLUDING BUT NOT LIMITED TO THE WARRANTIES MERCHANTABILITY or FITNESS *
22 * FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE *
23 * AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER *
24 * LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, *
25 * ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR *
26 * OTHER DEALINGS IN THE SOFTWARE. *
27 * *
28 * See LICENCES for more details. *
29 * *
30 * SPDX-FileCopyrightText: Copyright 2005-2025 *
31 * - Pierre-Henri WUILLEMIN(_at_LIP6) *
32 * - Christophe GONZALES(_at_AMU) *
33 * SPDX-License-Identifier: LGPL-3.0-or-later OR MIT *
34 * *
35 * Contact : info_at_agrum_dot_org *
36 * homepage : http://agrum.gitlab.io *
37 * gitlab : https://gitlab.com/agrumery/agrum *
38 * *
39 ****************************************************************************/
40
41
49#ifndef GUM_FMDP_SIMULATOR_H
50#define GUM_FMDP_SIMULATOR_H
51//======================================================================
52//======================================================================
54
55//======================================================================
56
57namespace gum {
68 public:
69 // ===========================================================================
71 // ===========================================================================
73
77 FMDPSimulator(const FMDP< double >* fmdp);
78 FMDPSimulator(const std::string& resource);
79
84
86
87 // ===========================================================================
89 // ===========================================================================
91
93 double reward() { return _fmdp_->reward()->get(this->currentState_); }
94
95 void perform(Idx);
96
98
99 // ===========================================================================
101 // ===========================================================================
103
105 return _fmdp_->main2prime(mainVar);
106 }
107
112
116
118
119 // ===========================================================================
121 // ===========================================================================
123
124 virtual const std::string& actionName(Idx actionId) { return _fmdp_->actionName(actionId); }
125
127 SequenceIteratorSafe< Idx > beginActions() { return _fmdp_->beginActions(); }
128
130
132
133 protected:
134 virtual double transitionProbability_(const DiscreteVariable* var,
135 const Instantiation& transit,
136 Idx actionId) {
137 return reinterpret_cast< const MultiDimFunctionGraph< double >* >(
138 _fmdp_->transition(actionId, var))
139 ->get(transit);
140 }
141
142 private:
146
148 const bool _loaded_;
149 };
150
151} /* namespace gum */
152
153
154#endif // GUM_FMDP_SIMULATOR_H
Class for simulating a discrete time stochastic process.
AbstractSimulator()
Default constructor.
Instantiation currentState_
Tha state in which the system currently is.
Base class for discrete random variable.
SequenceIteratorSafe< const DiscreteVariable * > endVariables()
Iteration over the variables of the simulated probleme.
FMDPSimulator(const FMDP< double > *fmdp)
Default constructor.
SequenceIteratorSafe< const DiscreteVariable * > beginVariables()
Iteration over the variables of the simulated probleme.
SequenceIteratorSafe< Idx > endActions()
Iteration over the variables of the simulated probleme.
FMDP< double > * _fmdp_
The Factored Markov Decision Process that describes how the system evolves.
SequenceIteratorSafe< Idx > beginActions()
Iteration over the variables of the simulated probleme.
void perform(Idx)
Sets the intial statefrom which we begun the simulation.
virtual const std::string & actionName(Idx actionId)
Iteration over the variables of the simulated probleme.
double reward()
Sets the intial statefrom which we begun the simulation.
virtual double transitionProbability_(const DiscreteVariable *var, const Instantiation &transit, Idx actionId)
~FMDPSimulator()
Default destructor.
const DiscreteVariable * primeVar(const DiscreteVariable *mainVar)
Iteration over the variables of the simulated probleme.
const bool _loaded_
Just to know if it should be deleted in the end.
Class for assigning/browsing values to tuples of discrete variables.
virtual GUM_SCALAR get(const Instantiation &i) const
Returns the value pointed by i.
Safe iterators for Sequence.
Definition sequence.h:1134
Size Idx
Type for indexes.
Definition types.h:79
gum is the global namespace for all aGrUM entities
Definition agrum.h:46