Infrastructure for Partially Observable Markov Decision Processes (POMDP)

---

Documentation for package ‘pomdp’ version 1.1.0

• DESCRIPTION file.
• User guides, package vignettes and other documentation.

Help Pages

pomdp-package	pomdp: Infrastructure for Partially Observable Markov Decision Processes (POMDP)
approx_MDP_policy_evaluation	Solve an MDP Problem
epoch_to_episode	Define a POMDP Problem
estimate_belief_for_nodes	Estimate the Belief for Policy Graph Nodes
is_converged_POMDP	Define a POMDP Problem
is_solved_MDP	Define an MDP Problem
is_solved_POMDP	Define a POMDP Problem
is_timedependent_POMDP	Define a POMDP Problem
Maze	Steward Russell's 4x3 Maze MDP
maze	Steward Russell's 4x3 Maze MDP
MDP	Define an MDP Problem
MDP2POMDP	Define an MDP Problem
normalize_MDP	Access to Parts of the POMDP Description
normalize_POMDP	Access to Parts of the POMDP Description
observation_matrix	Access to Parts of the POMDP Description
observation_val	Access to Parts of the POMDP Description
optimal_action	Optimal action for a belief
O_	Define a POMDP Problem
plot_belief_space	Plot a 2D or 3D Projection of the Belief Space
plot_policy_graph	POMDP Policy Graphs
plot_value_function	Plot the Value Function of a POMDP Solution
policy	Extract the Policy from a POMDP/MDP
policy_graph	POMDP Policy Graphs
POMDP	Define a POMDP Problem
POMDP_accessors	Access to Parts of the POMDP Description
projection	Defining a Belief Space Projection
q_values_MDP	Solve an MDP Problem
random_MDP_policy	Solve an MDP Problem
read_POMDP	Read and write a POMDP Model to a File in POMDP Format
reward	Calculate the Reward for a POMDP Solution
reward_matrix	Access to Parts of the POMDP Description
reward_node_action	Calculate the Reward for a POMDP Solution
reward_val	Access to Parts of the POMDP Description
round_stochastic	Round a stochastic vector or a row-stochastic matrix
R_	Define a POMDP Problem
sample_belief_space	Sample from the Belief Space
simulate_MDP	Simulate Trajectories in a MDP
simulate_POMDP	Simulate Trajectories in a POMDP
solve_MDP	Solve an MDP Problem
solve_POMDP	Solve a POMDP Problem using pomdp-solver
solve_POMDP_parameter	Solve a POMDP Problem using pomdp-solver
solve_SARSOP	Solve a POMDP Problem using SARSOP
start_vector	Access to Parts of the POMDP Description
Three_doors	Tiger Problem POMDP Specification
Tiger	Tiger Problem POMDP Specification
transition_matrix	Access to Parts of the POMDP Description
transition_val	Access to Parts of the POMDP Description
T_	Define a POMDP Problem
update_belief	Belief Update
write_POMDP	Read and write a POMDP Model to a File in POMDP Format