aGrUM 3.1.1
a C++ library for (probabilistic) graphical models
fmdpSimulator_inl.h
Go to the documentation of this file.
1/****************************************************************************
2 * This file is part of the aGrUM/pyAgrum library. *
3 * *
4 * Copyright (c) 2005-2026 by *
5 * - Pierre-Henri WUILLEMIN(_at_LIP6) *
6 * - Christophe GONZALES(_at_AMU) *
7 * *
8 * The aGrUM/pyAgrum library is free software; you can redistribute it *
9 * and/or modify it under the terms of either : *
10 * *
11 * - the GNU Lesser General Public License as published by *
12 * the Free Software Foundation, either version 3 of the License, *
13 * or (at your option) any later version, *
14 * - the MIT license (MIT), *
15 * - or both in dual license, as here. *
16 * *
17 * (see https://agrum.gitlab.io/articles/dual-licenses-lgplv3mit.html) *
18 * *
19 * This aGrUM/pyAgrum library is distributed in the hope that it will be *
20 * useful, but WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, *
21 * INCLUDING BUT NOT LIMITED TO THE WARRANTIES MERCHANTABILITY or FITNESS *
22 * FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE *
23 * AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER *
24 * LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, *
25 * ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR *
26 * OTHER DEALINGS IN THE SOFTWARE. *
27 * *
28 * See LICENCES for more details. *
29 * *
30 * SPDX-FileCopyrightText: Copyright 2005-2026 *
31 * - Pierre-Henri WUILLEMIN(_at_LIP6) *
32 * - Christophe GONZALES(_at_AMU) *
33 * SPDX-License-Identifier: LGPL-3.0-or-later OR MIT *
34 * *
35 * Contact : info_at_agrum_dot_org *
36 * homepage : http://agrum.gitlab.io *
37 * gitlab : https://gitlab.com/agrumery/agrum *
38 * *
39 ****************************************************************************/
40
41#pragma once
42
44
45namespace gum {
46
47
48 INLINE double FMDPSimulator::reward() { return _fmdp_->reward()->get(this->currentState_); }
49
51 return _fmdp_->main2prime(mainVar);
52 }
53
57
61
62 INLINE const std::string& FMDPSimulator::actionName(Idx actionId) {
63 return _fmdp_->actionName(actionId);
64 }
65
67 return _fmdp_->beginActions();
68 }
69
71
73 const Instantiation& transit,
74 Idx actionId) {
75 return reinterpret_cast< const MultiDimFunctionGraph< double >* >(
76 _fmdp_->transition(actionId, var))
77 ->get(transit);
78 }
79
80} // namespace gum
Instantiation currentState_
Tha state in which the system currently is.
Base class for discrete random variable.
const std::string & actionName(Idx actionId) override
Iteration over the variables of the simulated probleme.
FMDP< double > * _fmdp_
The Factored Markov Decision Process that describes how the system evolves.
SequenceIteratorSafe< const DiscreteVariable * > endVariables() override
Iteration over the variables of the simulated probleme.
SequenceIteratorSafe< Idx > beginActions() override
Iteration over the variables of the simulated probleme.
virtual double transitionProbability_(const DiscreteVariable *var, const Instantiation &transit, Idx actionId)
double reward() override
Sets the intial statefrom which we begun the simulation.
SequenceIteratorSafe< const DiscreteVariable * > beginVariables() override
Iteration over the variables of the simulated probleme.
const DiscreteVariable * primeVar(const DiscreteVariable *mainVar) override
Iteration over the variables of the simulated probleme.
SequenceIteratorSafe< Idx > endActions() override
Iteration over the variables of the simulated probleme.
Class for assigning/browsing values to tuples of discrete variables.
GUM_ELEMENT get(const Instantiation &i) const override
Returns the value pointed by i.
Safe iterators for Sequence.
Definition sequence.h:1148
Class for simulating a markov decision process.
Size Idx
Type for indexes.
Definition types.h:79
gum is the global namespace for all aGrUM entities
Definition agrum.h:46