Human State Estimation in Complex Dynamic Environments via Multidimensional and Nonlinear Methods

 
Mary Jean Amon, Ph.D.
Director, Dynamics Social Computing (dysco) Laboratory
Assistant Professor, Department of Informatics
Indiana University Bloomington
 
Abstract
Sociotechnical systems composed of human and technologies are paradigmatic complex adaptive systems. Such systems consist of nested processes interacting within and between people and instruments to support valued individual and group outcomes. Multimodal, multichannel, and multiparty sensing (e.g., for speech, movement, physiology, or log files) provides unprecedented opportunities for measuring the time-evolving processes at the core of sociotechnical performance. These measures can be used in conjunction with concepts from nonlinear dynamical systems theory to describe the time-evolving, multimodal, and complex nature of many goal-directed tasks. First, this talk outlines the conceptual relationship between complex systems and nonlinear dynamic analyses. Second, the talk overviews example nonlinear dynamic analyses and the unique dynamics captured, along with example research applications. This approach demonstrates how large amounts of multidimensional data, recorded from multiple people and channels, can be effectively synthesized into meaningful measures of higher-order activities. Implications for theory and methods in behavior modeling and for operational practice in complex real-world settings are discussed.
 
Biosketch
Dr. Mary Jean Amon is an Assistant Professor in Indiana University Bloomington’s Department of Informatics. Her research focuses on human-computer interaction, especially nested dynamics of individual and distributed cognitive systems that drive valued outcomes. Her interdisciplinary research program leverages multimodal, multichannel, and multiparty sensing technologies to understand and improve dynamic decision-making and performance in the context of complex sociotechnological systems. This includes identifying near-real-time team coordinative patterns that enhance teaming performance. Her quality of work is recognized through diverse funding sources, publications in top venues, best paper awards, internal awards in research and teaching, and general dissemination through outlets like Forbes, New York Times, and Washington Post.