aGrUM 3.1.1
a C++ library for (probabilistic) graphical models
fmdpSimulator.h
Go to the documentation of this file.
1/****************************************************************************
2 * This file is part of the aGrUM/pyAgrum library. *
3 * *
4 * Copyright (c) 2005-2026 by *
5 * - Pierre-Henri WUILLEMIN(_at_LIP6) *
6 * - Christophe GONZALES(_at_AMU) *
7 * *
8 * The aGrUM/pyAgrum library is free software; you can redistribute it *
9 * and/or modify it under the terms of either : *
10 * *
11 * - the GNU Lesser General Public License as published by *
12 * the Free Software Foundation, either version 3 of the License, *
13 * or (at your option) any later version, *
14 * - the MIT license (MIT), *
15 * - or both in dual license, as here. *
16 * *
17 * (see https://agrum.gitlab.io/articles/dual-licenses-lgplv3mit.html) *
18 * *
19 * This aGrUM/pyAgrum library is distributed in the hope that it will be *
20 * useful, but WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, *
21 * INCLUDING BUT NOT LIMITED TO THE WARRANTIES MERCHANTABILITY or FITNESS *
22 * FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE *
23 * AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER *
24 * LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, *
25 * ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR *
26 * OTHER DEALINGS IN THE SOFTWARE. *
27 * *
28 * See LICENCES for more details. *
29 * *
30 * SPDX-FileCopyrightText: Copyright 2005-2026 *
31 * - Pierre-Henri WUILLEMIN(_at_LIP6) *
32 * - Christophe GONZALES(_at_AMU) *
33 * SPDX-License-Identifier: LGPL-3.0-or-later OR MIT *
34 * *
35 * Contact : info_at_agrum_dot_org *
36 * homepage : http://agrum.gitlab.io *
37 * gitlab : https://gitlab.com/agrumery/agrum *
38 * *
39 ****************************************************************************/
40
41
49#ifndef GUM_FMDP_SIMULATOR_H
50#define GUM_FMDP_SIMULATOR_H
51//======================================================================
52//======================================================================
54
55//======================================================================
56
57namespace gum {
68 public:
69 // ===========================================================================
71 // ===========================================================================
73
77 FMDPSimulator(const FMDP< double >* fmdp);
78 FMDPSimulator(std::string_view resource);
79
83 ~FMDPSimulator() override;
84
86
87 // ===========================================================================
89 // ===========================================================================
91
93 double reward() override;
94
95 void perform(Idx) override;
96
98
99 // ===========================================================================
101 // ===========================================================================
103
104 const DiscreteVariable* primeVar(const DiscreteVariable* mainVar) override;
105
108
110
112
113 // ===========================================================================
115 // ===========================================================================
117
118 const std::string& actionName(Idx actionId) override;
119
122
124
126
127 protected:
128 virtual double transitionProbability_(const DiscreteVariable* var,
129 const Instantiation& transit,
130 Idx actionId);
131
132 private:
136
138 const bool _loaded_;
139 };
140
141} /* namespace gum */
142
143#ifndef GUM_NO_INLINE
145#endif // GUM_NO_INLINE
146#endif // GUM_FMDP_SIMULATOR_H
Class for simulating a discrete time stochastic process.
AbstractSimulator()
Default constructor.
Base class for discrete random variable.
FMDPSimulator(const FMDP< double > *fmdp)
Default constructor.
const std::string & actionName(Idx actionId) override
Iteration over the variables of the simulated probleme.
FMDP< double > * _fmdp_
The Factored Markov Decision Process that describes how the system evolves.
SequenceIteratorSafe< const DiscreteVariable * > endVariables() override
Iteration over the variables of the simulated probleme.
SequenceIteratorSafe< Idx > beginActions() override
Iteration over the variables of the simulated probleme.
virtual double transitionProbability_(const DiscreteVariable *var, const Instantiation &transit, Idx actionId)
double reward() override
Sets the intial statefrom which we begun the simulation.
SequenceIteratorSafe< const DiscreteVariable * > beginVariables() override
Iteration over the variables of the simulated probleme.
const DiscreteVariable * primeVar(const DiscreteVariable *mainVar) override
Iteration over the variables of the simulated probleme.
void perform(Idx) override
Sets the intial statefrom which we begun the simulation.
SequenceIteratorSafe< Idx > endActions() override
Iteration over the variables of the simulated probleme.
const bool _loaded_
Just to know if it should be deleted in the end.
~FMDPSimulator() override
Default destructor.
Class for assigning/browsing values to tuples of discrete variables.
Safe iterators for Sequence.
Definition sequence.h:1148
Size Idx
Type for indexes.
Definition types.h:79
gum is the global namespace for all aGrUM entities
Definition agrum.h:46