# Infrastructure for Partially Observable Markov Decision Processes (POMDP)

## Documentation for package ‘pomdp’ version 1.1.0

- DESCRIPTION file.
- User guides, package vignettes and other documentation.

## Help Pages

pomdp-package | pomdp: Infrastructure for Partially Observable Markov Decision Processes (POMDP)
approx_MDP_policy_evaluation | Solve an MDP Problem
epoch_to_episode | Define a POMDP Problem
estimate_belief_for_nodes | Estimate the Belief for Policy Graph Nodes
is_converged_POMDP | Define a POMDP Problem
is_solved_MDP | Define an MDP Problem
is_solved_POMDP | Define a POMDP Problem
is_timedependent_POMDP | Define a POMDP Problem
Maze | Steward Russell's 4x3 Maze MDP
maze | Steward Russell's 4x3 Maze MDP
MDP | Define an MDP Problem
MDP2POMDP | Define an MDP Problem
normalize_MDP | Access to Parts of the POMDP Description
normalize_POMDP | Access to Parts of the POMDP Description
observation_matrix | Access to Parts of the POMDP Description
observation_val | Access to Parts of the POMDP Description
optimal_action | Optimal action for a belief
O_ | Define a POMDP Problem
plot_belief_space | Plot a 2D or 3D Projection of the Belief Space
plot_policy_graph | POMDP Policy Graphs
plot_value_function | Plot the Value Function of a POMDP Solution
policy | Extract the Policy from a POMDP/MDP
policy_graph | POMDP Policy Graphs
POMDP | Define a POMDP Problem
POMDP_accessors | Access to Parts of the POMDP Description
projection | Defining a Belief Space Projection
q_values_MDP | Solve an MDP Problem
random_MDP_policy | Solve an MDP Problem
read_POMDP | Read and write a POMDP Model to a File in POMDP Format
reward | Calculate the Reward for a POMDP Solution
reward_matrix | Access to Parts of the POMDP Description
reward_node_action | Calculate the Reward for a POMDP Solution
reward_val | Access to Parts of the POMDP Description
round_stochastic | Round a stochastic vector or a row-stochastic matrix
R_ | Define a POMDP Problem
sample_belief_space | Sample from the Belief Space
simulate_MDP | Simulate Trajectories in a MDP
simulate_POMDP | Simulate Trajectories in a POMDP
solve_MDP | Solve an MDP Problem
solve_POMDP | Solve a POMDP Problem using pomdp-solver
solve_POMDP_parameter | Solve a POMDP Problem using pomdp-solver
solve_SARSOP | Solve a POMDP Problem using SARSOP
start_vector | Access to Parts of the POMDP Description
Three_doors | Tiger Problem POMDP Specification
Tiger | Tiger Problem POMDP Specification
transition_matrix | Access to Parts of the POMDP Description
transition_val | Access to Parts of the POMDP Description
T_ | Define a POMDP Problem
update_belief | Belief Update
write_POMDP | Read and write a POMDP Model to a File in POMDP Format