A Framework for Dynamic Context-Centric Commander Decision Support

Abstract

This paper addresses the fundamental research question: “How can we determine the sequential decision- making process inside a decision maker’s mind?” We construct a dynamic Markov Decision Process using a Double Transition Model (DTM). The DTM is a cognitive model decomposing the decision-making process into episodic tasks that are extracted from a stream of incoming information. In a DTM, each state reflects a stage en route to a decision, and each action reflects a possible move from collecting data to hypothesizing and inferencing. The reward reflects how close a stage is to the final decision. We demonstrate this process through a proof-of-concept DTM using a hypothetical scenario for Typhoon Haiyan in the Philippines (2013). The DTM constructed from this scenario enables a Commander to reason about damaged areas, death tolls, and assistance methods while allowing his actions to be captured and used to explain why and how each decision is made.

References

Bellman

R. E.

(1957). A Markovian Decision Process. Ind. Univ. Math. J. 6(4), 679–684.

Blei

D. M.

A. Y.

Jordan

M. I.

(2003). Latent dirichlet allocation. The Journal of Machine Learning Research, 3, 993-1022.

Chuklin

Serdyukov

De Rijke

(2013). Using intent information to model user behavior in diversified search. In Proceedings of the 35th European conference on Advances in Information Retrieval (ECIR’13), Serdyukov

Pavel

Braslavski

Pavel

Kuznetsov

Sergei O.

Kamps

Jaap

Rüger

Stefan

(Eds.). Springer-Verlag, Berlin, Heidelberg, 1-13.

Drews

Siebeneck

Cova

(2015). Information Search and Decision Making in Computer-Based Wildfire Simulations. Journal of Cognitive Engineering and Decision Making. 9: 229-240.

Feinberg

E. A.

Shwartz

(Eds.). (2012). Handbook of Markov decision processes: methods and applications (40). Springer.

Meuleau

Hauskrecht

Kim

K. E.

Peshkin

Kaelbling

L. P.

Dean

T. L.

Boutilier

(1998). Solving very large weakly coupled Markov decision processes. In Proceedings of the fifteenth national/tenth conference on Artificial Intelligence/Innovative Applications of Artificial Intelligence (AAAI ’98/IAAI ’98) (pp. 165-172).

A. Y.

Russell

(2000). Algorithms for inverse reinforcement learning. In Proceedings of the Seventeenth International Conference on Machine Learning (ICML ’00), Langley

Pat

(Ed.). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 663-670. ).

Nguyen

Santos

Jr. (2013). Hybrid User Model for Capturing a User’s Information Seeking Intent. In Multimedia Services in Intelligent Environments. 24, pp 31-63.

Poore

J. C.

Forlines

C. L.

Miller

S. M.

Regan

J. R.

Irvine

J. M.

(2014). Personality, cognitive style, motivation, and aptitude predict systematic trends in analytic forecasting behavior. Journal of cognitive engineering and decision making, 8(4), 374-393.

10.

Santos

Jr. Nguyen

(2009). Modeling Users for Adaptive Information Retrieval by Capturing User Intent. In Collaborative and Social Information Retrieval and Access: Techniques for Improved User Modeling. IGI Global.

11.

Santos

Jr. Santos

E. S.

(1999). A framework for building knowledge- bases under uncertainty. Journal of Experimental & Theoretical Artificial Intelligence, 11(2), 265-286.

12.

Scribner

D. R.

(2015). Predictors of Shoot–Don’t Shoot Decision-Making Performance An Examination of Cognitive and Emotional Factors. Journal of Cognitive Engineering and Decision Making.

13.

Sutton

R. S.

Barto

A. G.

(1998). Reinforcement learning: An introduction. MIT press.

14.

Truong

H. M.

(2016) Integrating learning styles and adaptive e-learning system: Current developments, problems and opportunities, Computers in Human Behavior, Vol. 55, Part B, Pages 1185-1193, ISSN 0747-5632.

15.

Wang

Ruhe

(2007). The Cognitive Process of Decision Making. International Journal of Cognitive Informatics and Natural Intelligence (IJCINI), 1(2), 73-85.

16.

(2013). A Framework of Computational Opinions (Doctoral Dissertation), Dartmouth College, Hanover, NH.

17.

Santos

Jr. (2016). On Modeling the Interplay between Opinion Change and Formation, in Proceedings of the 29th International FLAIRS Conference, Key Largo, FL (pp. 140-145).