Valid Parameters for Predictive State Representations
 Citation data:

CONFERENCE: Proceedings of the Eleventh International Symposium on Artificial Intelligence and Mathematics
Proceedings of the Eleventh International Symposium on Artificial Intelligence and Mathematics
 Publication Year:
 2010

 Bepress 61
 Repository URL:
 https://opus.ipfw.edu/compsci_facpres/19
 Author(s):
 Publisher(s):
 Tags:
 Computer Sciences
lecture / presentation description
Predictive state representations (PSRs) represent the state of a dynamical system as a set of predictions about future events. The parameters of a PSR model consist of several matrices and vectors, but not all values for those parameters result in valid PSR models. Our work starts with a general definition of what it means to be a valid PSR model and derives necessary and sufficient constraints for the model parameters to constitute a valid PSR. These same constraints also define the set of valid state vectors for a given PSR model, which we prove to be a convex set. We also derive a set of simplified constraints on the PSR parameters, and we prove that any PSR model has an equivalent arameterization that satisfies those simplified constraints. lastly, we demonstrate one simple application of our constraints: preventing overflow or underflow of the PSR state as it changes over time.