Publications

Publications

2022

• Timonen Tomi, Iso-Mustajärvi Matti, Linder Pia, Vrzakova Hana, Sinkkonen Saku T., Luukkainen Veera, Laitakari Jaakko, Elomaa Antti-Pekka, Dietz Aarno (September, 2022). The feasibility of virtual reality for anatomic training during temporal bone dissection course. Frontiers in Virtual Reality.
• Puustinen, S., Hyttinen, J., Hisuin, G., Vrzáková, H., Huotarinen, A., Fält, P., … & Elomaa, A. P. (2022, July). Towards Clinical Hyperspectral Imaging (HSI) Standards: Initial Design for a Microneurosurgical HSI Database. In 2022 IEEE 35th International Symposium on Computer-Based Medical Systems (CBMS) (pp. 394-399). IEEE.
• Booth, B. M., Vrzakova, H., Mattingly, S. M., Martinez, G. J., Faust, L., & D’Mello, S. K. (2022). Toward Robust Stress Prediction in the Age of Wearables: Modeling Perceived Stress in a Longitudinal Study with Information Workers. IEEE Transactions on Affective Computing.
• Lehtonen, S. J., Vrzáková, H., Paterno, J. J., Puustinen, S., Bednarik, R., Hauta-Kasari, M., … & Elomaa, A. P. (2022). Detection improvement of gliomas in hyperspectral imaging of protoporphyrin IX fluorescence–in vitro comparison of visual identification and machine thresholds. Cancer Treatment and Research Communications, 32, 100615.
• Dever DA, Amon MJ, Vrzáková H, Wiedbusch MD, Cloude EB, Azevedo R. Capturing Sequences of Learners’ Self-Regulatory Interactions With Instructional Material During Game-Based Learning Using Auto-Recurrence Quantification Analysis. Front Psychol. 2022
• Torkamani-Azar, M., Lee, A., and Bednarik, R., 2022. Methods and Measures for Mental Stress Assessment in Surgery: A Systematic Review of 20 Years of Literature. IEEE Journal of Biomedical and Health Informatics.
• Hannonen, S., Andberg, S., Kärkkäinen, V., Rusanen, M., Lehtola, J.M., Saari, T., Korhonen, V., Hokkanen, L., Hallikainen, M., Hänninen, T., Leinonen, V., Kaarniranta, K., Bednarik, R., and Koivisto, A.M., 2022. Shortening of Saccades as a Possible Easy-to-Use Biomarker to Detect Risk of Alzheimer’s Disease. Journal of Alzheimer’s Disease.
• Bednarik, R., Blandford, A., Feng, F., Huotarinen, A., Iso-Mustajärvi, M., Lee, A., Nicolosi, F., Opie, J., Yoo, S., and Zheng, B., 2022. Integration of Human Factors in Surgery: Interdisciplinary Collaboration in Design, Development, and Evaluation of Surgical Technologies. In CHI Conference on Human Factors in Computing Systems Extended Abstracts.
• Koskinen, J., Torkamani-Azar, M., Hussein, A., Huotarinen, A. and Bednarik, R., 2022. Automated tool detection with deep learning for monitoring kinematics and eye-hand coordination in microsurgery. Computers in Biology and Medicine 141, 105121.
• Tolvanen, O., Elomaa, A.-P. A.-P., Itkonen, M., Vrzakova, H., Bednarik, R., and Huotarinen, A., 2022. Eye-tracking indicators of workload in surgery—A systematic review. Journal of Investigative Surgery. 1-10.
• Feng, F., Bennett, D., Fan, Z.J., and Metatla, O., 2022. It’s Touching: Understanding Touch-Affect Association in Shape-Change with Kinematic Features. ACM CHI Conference on Human Factors in Computing Systems.
• Tyni, J., Tarkiainen, A., López-Pernas, S., Saqr, M., Kahila, J., Bednarik, R., & Tedre, M. (2022). Games and Rewards: A Scientometric Study of Rewards in Educational and Serious Games. IEEE Access, 10, 31578-31585.
• Koskinen, J., Huotarinen, A., Elomaa, A.P., Zheng, B. and Bednarik, R., 2022. Movement-level process modeling of microsurgical bimanual and unimanual tasks. International Journal of Computer Assisted Radiology and Surgery, 1-10.
• Shic, F., Kasneci, E., et al. 2022. ETRA’22: 2022 Symposium on Eye Tracking Research and Applications. ACM
• Tyni, J., Turunen, A., Kahila, J., Bednarik, R., & Tedre, M. (2022). Reward Types in Popular Recreational and Educational Mobile Games. IEEE Access.
• Lehtola, J. M., Kärkkäinen, V., Andberg, S., Hannonen, S., Rusanen, M., Saari, T., … & Koivisto, A. M. (2022). Computer-based Eye-tracking Analysis of King-Devick Test Differentiates Persons With Idiopathic Normal Pressure Hydrocephalus From Cognitively Unimpaired. Alzheimer Disease & Associated Disorders, 36(4), 340-346.
• Afkari, H., & Bednarik, R. (2022). Seize the moment: the role of scrub nurses’ proactivity in microsurgical operating-room collaborations. Behaviour & Information Technology, 1-18.

2021

• Torkamani-Azar, M., Liu, Y., Koskinen, J., Hussein, A., Vrzakova, H. and Bednarik, R., 2021. Image Synthesis with Generative Adversarial Networks to Augment Tool Detection in Microsurgery. Medical Imaging with Deep Learning (MIDL).
• Chainey, J., Zheng, B., Kim, M., Elomaa, A., Bednarik, R. and O’Kelly, C., 2021. C. 6 Action-Related Fixation in Microsuturing, a New Gaze Behavior Metric to Differentiate the Level of Expertise. Canadian Journal of Neurological Sciences 48 (s3), S19-S19.
• Chainey, J., Elomaa, A.P., O’Kelly, C.J., Kim, M.J., Bednarik, R. and Zheng, B., 2021. Eye-Hand Coordination of Neurosurgeons: Evidence of Action-Related Fixation in Microsuturing. World Neurosurgery 155, e196-e202.
• Ogawa-Ochiai, K., Kiyokawa, T., Kiyomitsu, K., Bednarik, R., Mitani, Y. and Tsumura, N., 2021. Comparison of noncontact camera-based methods for measuring pulse-rate of awake infants. Artificial Life and Robotics, 1-8.
• Zheng, B., Jiang, X., Bednarik, R. and Atkins, M.S., 2021. Action-related eye measures to assess surgical expertise. BJS Open 5 (5), zrab068.
• Chitalkina, N., Puurtinen, M., Gruber, H. and Bednarik, R., 2021. Handling of incongruences in music notation during singing or playing. International Journal of Music Education 39 (1), 18-38.
• Lang, J., Vrzakova, H., and Mehtatalo, L., 2021. Modelling Gaze Behaviour in Subtitle Processing: The Effect of Structural and Lexical Properties. Journal of Audiovisual Translation, 4(1).
• Sartipi, S., Torkamani-Azar, M. and Cetin, M., 2021. EEG Emotion Recognition via Graph-based Spatio-Temporal Attention Neural Networks. 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).
• Lee, A. and Bednarik, R., 2021. 3D Exoscopes in Microsurgery: How 3D Exoscopes Reconfigure the Workflow of Assistant Surgeons and Nurses in the Operating Room. Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing, 112-116.
• Kannan, S. S., Lee, A., and Min, B. C., 2021. External Human-Machine Interface on Delivery Robots: Expression of Navigation Intent of the Robot . In 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN) (pp. 1305-1312). IEEE.
• Bennett, D., Dix, A., Eslambolchilar, P., Feng, F., Froese, T., Kostakos, V., Lerique, S. and Van Berkel, N., 2021. Emergent interaction: complexity, dynamics, and enaction in HCI. Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (pp. 1-7).
• Vrzakova, H., Amon, M. J., Rees, M., Faber, M., and Mello, S. K. D., 2021. Looking for a Deal? Social Visual Attention during Negotiations via Mixed Media Videoconferencing. Proceedings of the ACM: Human Computer Interaction.
• Necaise, A., Williams, A., Vrzakova, H., and Amon, M. J., 2021. Regularity versus novelty of users’ multimodal comment patterns and dynamics as markers of social media radicalization. Proceedings of the 32nd ACM Conference on Hypertext and Social Media, 237–243.

2020

• Koskinen, J., Bednarik, R., Vrzakova, H. and Elomaa, A.P., 2020. Combined Gaze Metrics as Stress-Sensitive Indicators of Microsurgical Proficiency. Surgical Innovation 27 (6), 614-622.
• Bednarik, R., Vrzakova, H., Elomaa, A.P. and Skön, J.P., 2020. Experts in Medical Computing: Designing a continuous education program with clinical relevance and industrial applicability. 2020 IEEE Frontiers in Education Conference (FIE), 1-5.
• Bednarik, R., Busjahn, T., Gibaldi, A., Ahadi, A., Bielikova, M., Crosby, M., Essig, K., Fagerholm, F., Jbara, A., Lister, R. and Orlov, P., 2020. EMIP: The eye movements in programming dataset. Science of Computer Programming, 198, p.102520.
• Sharafi, Z., Sharif, B., Guéhéneuc, Y.G., Begel, A., Bednarik, R. and Crosby, M., 2020. A practical guide on conducting eye tracking studies in software engineering. Empirical Software Engineering 25 (5), 3128-3174.
• Puustinen, S., Alaoui, S., Bartczak, P., Bednarik, R., Koivisto, T., Dietz, A., von Und Zu Fraunberg, M., Iso-Mustajärvi, M. and Elomaa, A.P., 2020. Spectrally Tunable Neural Network-Assisted Segmentation of Microneurosurgical Anatomy. Frontiers in Neuroscience 14, 640.
• Vrzakova H., Begel, A., Mehtätalo, L. and Bednarik, R., 2020. Affect recognition in code review: An in-situ biometric study of reviewer’s affect. Journal of Systems and Software 159, 110434.
• Koskinen, J. and Bednarik, R., 2020. Gaze-grabber distance in expert and novice forest machine operators: the effects of automatic boom control. ACM Symposium on Eye Tracking Research and Applications, 1-7.
• Chitalkina, N., Bednarik, R., Puurtinen, M. and Gruber, H., 2020. When you ignore what you see: How to study proof-readers’ error in pseudocode reading. ACM Symposium on Eye Tracking Research and Applications, 1-5.
• Puustinen, S., Koskinen, J., Vrzakova, H., Bartczak, P., Hussein, A., Lehtonen, S., and Elomaa, A.-P., 2020. Optimal Spectral Bands for Instrument Detection in Microscope-Assisted Surgery. 2020 IEEE 33rd International Symposium on Computer-Based Medical Systems (CBMS), 327–331.
• Vrzakova, H., Amon, M. J., Stewart, A., Duran, N. D., and D’Mello, S. K., 2020. Focused or stuck together: Multimodal patterns reveal triads’ performance in collaborative problem solving. ACM International Conference Proceeding Series, 295–304.

2019

• Gil de Gómez Pérez, D. and Bednarik, R., 2019. POnline: An Online Pupil Annotation Tool Employing Crowd-sourcing and Engagement Mechanisms. Human Computation 6 (1), 176-191.
• Amon, M. J., Vrzakova, H., and D’Mello, S. K., 2019. Beyond Dyadic Coordination: Multimodal Behavioral Irregularity in Triads Predicts Facets of Collaborative Problem Solving. Cognitive Science, 43(10).
• Vrzakova, H., Amon, M. J., Stewart, A. E. B., and D’Mello, S. K., 2019. Dynamics of Visual Attention in Multiparty Collaborative Problem Solving Using Multidimensional Recurrence Quantification Analysis. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, 342:1–342:14.
• Stewart, A. E. B., Vrzakova, H., Sun, C., Yonehiro, J., Stone, C. A., Duran, N., D., Shute, V., and D’Mello, S. K., 2019. I Say, You Say, We Say: Using Spoken Language to Model Socio-Cognitive Processes during Computer-Supported Collaborative Problem Solving. Proceedings of the ACM: Human Computer Interaction, 3(November), 19–19.
• Chitalkina, N., Bednarik, R., Puurtinen, M. and Gruber, G., 2019. Prediction as a prerequisite of skilled reading: The cases of source-code and music notation. Proceedings of the 19th Koli Calling International Conference on Computing Education Research.

2018

• Bednarik, R., Koskinen, J., Vrzakova, H., Bartczak, P., Elomaa, A-P.: Blink-based estimation of suturing task workload and expertise in microsurgery. 2018 IEEE 31st International Symposium on Computer-Based Medical Systems.
• Bartczak, P., Iso-Mustajärvi, M., Vrzakova, H., Bednarik, R., Fraunberg, M., Elomaa, A-P.: Portable System for On-site Spectral Imaging: Pre-Clinical Development and Early Evaluation. 2018 IEEE 31st International Symposium on Computer-Based Medical Systems.
• Bartczak, P., Vrzakova, H., Bednarik, R., Iso-Mustajärvi, M., …, Elomaa, A-P.: Spectral Video in Image-guided Microsurgical Applications: Integrating Imaging Technology into the Clinical Environment and Ergonomic Considerations. 2018 IEEE 31st International Symposium on Computer-Based Medical Systems.
• Leppänen, T., Vrzakova, H., Bednarik, R., Kanervisto, A., Elomaa, A-P., et al.: Augmenting Microsurgical Training: Microsurgical Instrument Detection using Convolutional Neural Networks. 2018 IEEE 31st International Symposium on Computer-Based Medical Systems.
• Andrew Begel and Hana Vrzakova. 2018. Eye movements in code review . In  Proceedings of the Workshop on Eye Movements in Programming  (EMIP ’18). ACM, NY, USA, Article 5, 5 pages. DOI:  https://doi.org/10.1145/3216723.3216727
• Bednarik R., Bartczak P., Vrzakova H., Koskinen J., Elomaa A.-P., Huotarinen A., Gil de Gómez Pérez D., and von und zu Fraunberg M .. 2018. Pupil size as an indicator of visual-motor workload and expertise in microsurgical training tasks . In  Proceedings of the 2018 ACM Symposium on Eye Tracking Research & Applications  (ETRA ’18). ACM, NY, USA, Article 60, 5 pages. DOI: https://doi.org/10.1145/3204493.3204577
• Gil de Gómez Pérez D., Suokas M., and Bednarik R.. 2018. Crowdsourcing pupil annotation datasets: boundary vs. center, what performs better?. In Proceedings of the 7th Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interaction (PETMEI ’18). ACM, New York, NY, USA, Article 3, 7 pages. DOI: https://doi.org/10.1145/3208031.3208036
• Seonwook Park, Christoph Gebhardt, Roman Rädle, Anna Maria Feit, Hana Vrzakova, Niraj Ramesh Dayama, Hui-Shyong Yeo, Clemens N. Klokmose, Aaron Quigley, Antti Oulasvirta, and Otmar Hilliges. 2018. AdaM: Adapting Multi-User Interfaces for Collaborative Environments in Real-Time. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI ’18). ACM, New York, NY, USA, Paper 184, 14 pages. DOI: https://doi.org/10.1145/3173574.3173758
• Afkari H., Gil de Gómez Pérez, D. and Bednarik, R. 2018. Command Selection in Gaze-based See-through Virtual Image-Guided Environments. In Proceedings of the 9th Augmented Human International Conference (AH ’18). ACM, New York, NY, USA, Article 8, 8 pages. DOI: https://doi.org/10.1145/3174910.3174940

2017

• Gil de Gómez Pérez, D. and Bednarik, R. Crowdpupil: A crowdsourced, pupil-center annotated image dataset. Communication by Gaze Interaction (COGAIN) 2017 symposium inside the European Conference on Eye Movements (ECEM) 2017.
• Orlov, P.A. and Bednarik, R., 2017. The Role of Extrafoveal Vision in Source Code Comprehension. Perception, 46(5), pp.541-565.
• Eivazi, S., Hafez, A., Fuhl, W., Afkari, H., Kasneci, E., Lehecka, M. and Bednarik, R., 2017. Optimal eye movement strategies: a comparison of neurosurgeons gaze patterns when using a surgical microscope. Acta Neurochirurgica, 159(6), pp.959-966.
• Eivazi, S., Slupina, M., Fuhl, W., Afkari, H., Hafez, A., and Kasneci, E.. 2017. Towards Automatic Skill Evaluation in Microsurgery. In Proceedings of the 22nd International Conference on Intelligent User Interfaces Companion (IUI ’17 Companion). ACM, New York, NY, USA, 73-76. DOI: https://doi.org/10.1145/3030024.3040985

2016

• Bâce M., Leppänen T., Gil de Gómez Pérez D., and Ramírez Gómez, A.. 2016. ubiGaze: ubiquitous augmented reality messaging using gaze gestures. In SIGGRAPH ASIA 2016 Mobile Graphics and Interactive Applications (SA ’16). ACM, New York, NY, USA, Article 11, 5 pages. DOI: https://doi.org/10.1145/2999508.2999530
• Duc Nguyen, Hana Vrzakova, and Roman Bednarik. 2016. WTP: web-tracking plugin for real-time automatic AOI annotations. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp ’16). ACM, New York, NY, USA, 1696-1705. DOI: https://doi.org/10.1145/2968219.2968338
• Hana Vrzakova, Roman Bednarik, Yukiko I. Nakano, and Fumio Nihei. 2016. Speakers’ head and gaze dynamics weakly correlate in group conversation. In Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications (ETRA ’16). ACM, New York, NY, USA, 77-84. DOI: https://doi.org/10.1145/2857491.2857522
• Afkari, H., Bednarik, R., Mäkelä, S. and Eivazi, S., 2016. Mechanisms for maintaining situation awareness in the micro-neurosurgical operating room. International Journal of Human-Computer Studies, 95, pp.1-14.

2015

• Orlov, P.A., Apraksin N. The Effectiveness of Gaze-Contingent Control in Computer Games Perception bibtex pdf
• Orlov, P.A. Primary investigation of applying Hidden Markov Models for eye movements in source code reading. Eye Movements in Programming Education II: Analyzing the Novice’s Gazebibtexpdf
• Orlov, P.A.; Bednarik, R. ScreenMasker: An Open-source Gaze-contingent Screen Masking Environment Behavior Research Methodsbibtexpdf
• Jiang, X; Zheng, B.; Bednarik, R.; Atkins, M.S. Pupil responses to continuous aiming movements International Journal of Human-Computer Studies 83, 1-11
• Eivazi,S.; Afkari, H.; Bednarik, R.; Leinonen, V.; Tukiainen, M.; Jääskeläinen, J.E. Analysis of disruptive events and precarious situations caused by interaction with neurosurgical microscope Acta neurochirurgica, 1-8
• Bednarik, R.; Krohns, J. User-centred design practice and adoption in smaller ICT companies in Eastern Finland: an interview study Int. J. Business Information Systems 18 (3), 285-298
• Mäkelä, S. Value of mobile phones for Tanzanian university students International Journal of Information Communication Technologies and Human Development, 7(2), 57-70.
• Hana Vrzakova and Roman Bednarik. Quiet Eye Affects Action Detection from Gaze more than Context Length In Proceedings of User Modeling, Adaptation and Personalization (UMAP). Springer, 2015

2014

• Dao, TC., Bednarik, R., Vrzakova, H. Heatmap rendering from large-scale distributed datasets using cloud computing Proceedings of the Symposium on Eye Tracking Research and Applications, 215-218bibtexpdf
• Bulling, A., Bednarik, R. Introduction to the PETMEI special issue Journal of Eye Movement Research, 3(1)3, 1-10.bibtexpdf DOI: https://doi.org/10.1145/2578153.2578187
• Busjahn, T., Bednarik, R., Schulte, C. What influences dwell time during source code reading?: analysis of element type and frequency as factors Proceedings of the Symposium on Eye Tracking Research and Applications, 335-338
• Jiang, X., MS Atkins, G Tien, B Zheng, R Bednarik Pupil dilations during target-pointing respect Fitts’ law Proceedings of the Symposium on Eye Tracking Research and Applications, 175-182
• Tien, G., MS Atkins, X Jiang, B Zheng, R Bednarik Verbal gaze instruction matches visual gaze guidance in laparoscopic skills training Proceedings of the Symposium on Eye Tracking Research and Applications, 331-334
• Vellonen, V.; Makela, S. Pre-service special education teachers’ views on ICT in education Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications 2014, 1950-1955
• Jiang, X.; Atkins, M. S.; Tien, G.; Bednarik, R.; Zheng, B. Pupil Responses during Discrete Goal-directed Movements Proceedings of the 32nd annual ACM conference on Human factors in computing systems (CHI ’14)pdf
• Bednarik, R.; Busjahn, T.; Schulte, C. Eye Movements in Programming Education: Analyzing the Expert’s Gaze Publications of the University of Eastern Finland. Reports and Studies in Forestry and Natural Sciences, no 18, ISBN: 978-952-61-1539-9pdf
• Mäkelä, S. Three viewpoints on designing bodily interaction for serious applications Proceedings of NordiCHI’14 workshop: Human-technology choreographies: re-thinking body, movement and space in interaction design, 1-4.pdf
• Jormanainen, I.; Pietinen, S.; Tukiainen, M.; Innanen, T.; Ojala, E. Developing Mobile Services to Support Informal Learning through Automatic Content Delivery in Religious Contexts: A Design Research Approach. Advanced Learning Technologies (ICALT)bibtexpdf
• Afkari, H.; Eivazi, S.; Bednarik, R.; Mäkelä, S. The Potentials for Hands-free Interaction in Micro-neurosurgery 8th Nordic Conference on Human-Computer Interactionpdf
• Orlov, P.; Bednarik, R. Low-cost Latency Measurement System for Eye-mouse Software 8th Nordic Conference on Human-Computer Interactionpdf
• Vrzakova, H.; Bednarik, R.; Nihei, F.; Nakano, Y. Influential statements and gaze for persuasion modeling 8th Nordic Conference on Human-Computer Interactionpdf
• Busjahn, T., Schulte, C., Sharif, B., Begel, A., Hansen, M., Bednarik, R., … & Antropova, M. Eye tracking in computing education Proceedings of the tenth annual conference on International computing education research (pp. 3-10)pdf
• Malmi, L., Sheard, J., Bednarik, R., Helminen, J., Kinnunen, P., Korhonen, A., … & Taherkhani, A. Theoretical underpinnings of computing education research: what is the evidence?. In Proceedings of the tenth annual conference on International computing education research (pp. 27-34). ACM.

2013

• Erkut, C., & Hacihabiboglu, H. Rhythm-Action Games: The Sonic Interaction Perspective Proc. 49th Intl. Conf. Audio Eng. Soc, London, UK, February 6-8
• Erkut, C., Jylhä, A., & Rocchesso, D. Heigh Ho: Rhythmicity in sonic interaction S. Serafin & K. Franinovic (Eds.), Sonic Interaction Design: Fresh Perspectives, Chapter 17, Cambridge, MA: MIT Press.pdf
• Bednarik, R. , Eivazi, S., and Vrzakova, H. A Computational Approach for Prediction of Problem-Solving Behavior Using Support Vector Machines and Eye-Tracking Data Eye Gaze in Intelligent User Interfacesbibtexpdf
• Vrzakova H. Computational approaches to visual attention for interaction inference Proceedings of the companion publication of the 2013 international conference on Intelligent user interfaces companion (IUI ’13 Companion)bibtexpdf
• Vrzakova H. Inferential methods in interaction, usability and user experience CHI ’13 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’13).bibtexpdf
• Vrzakova, H., and Bednarik, R. That’s not norma(n/l): a detailed analysis of midas touch in gaze-based problem-solving CHI ’13 Extended Abstracts on Human Factors in Computing Systems (CHI EA ’13)bibtexpdf
• Vrzakova, H.; Bednarik, R. EyeCloud: Cloud Computing for Pervasive Eye-Tracking PETMEI 2013, 3rd International Workshop on Pervasive Eye Tracking and Mobile Eye-Based Interactionpdf
• Mäkelä, S.; Bednarik, R.; Tukiainen, M. Evaluating user experience of autistic children through video observation CHI ’13 Extended Abstracts on Human Factors in Computing Systems, 463-468.
• Vrzakova, H. and Bednarik, R. Fast and Comprehensive Extension to Intention Prediction from Gaze ACM IUI 2013 Workshop on Interacting with Smart Objectspdf
• Mäkisalo, J., LÃ¥ng, J., Gowases, T., & Pietinen, S. Using Eye Tracking to Study the Effect of Badly Synchronized Subtitles on the Gaze Paths of Television Viewers New Voices in Translation Studies 10pdf
• Bednarik, R., Gowases, T., Tukiainen, M. Gaze-augmented interaction improves problem-solving: new evidence from verbal protocols. Behaviour & Information Technology 32(8)pdf
• Erkut, C.; Bednarik, R.; Mäkelä, S.; Kleimola, J. Apps for Me, Too: Gaze and Natural Interaction Applications for Varying Cognitive Strengths on a MultitouchTable Network CHI 2013 Workshop on “Gaze Interaction in the Post-WIMP World”, April 27, 2013, Paris, France.

2012

• Bednarik, R., Vrzakova, H., Hradis, M. What you want to do next: A novel approach for intent prediction in gaze-based interaction. In proceedings of ETRA’12, pp. 83-90.pdf
• Kamppuri, M. Because deep down, we are not the same: values in cross-cultural design. Interactions 19, 2 (March 2012), 65-68.
• Patrick Jermann, Darren Gergle, Roman Bednarik, and Susan Brennan. Duet 2012: dual eye tracking in CSCW. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work Companion (CSCW ’12). ACM, New York, NY, USA, 23-24.pdf
• Roman Bednarik. Expertise-dependent visual attention strategies develop over time during debugging with multiple code representations. International Journal of Human-Computer Studies 70, 2 (February 2012), 143-155.pdf
• Bednarik, R., Shipilov, A. Usability of gaze-transfer in collaborative programming: How and when could it work, and some implications for research agenda. In proceedings of DUET 2012.pdf
• Hradis, M., Eivazi, S., Bednarik, R. Voice activity detection in video mediated communication from gaze. In proceedings of ETRA’12, pp. 329-332.pdf
• Eivazi, S., Bednarik, R., Tukiainen, M., von und zu Fraunberg, M., Leinonen, V., Jääskeläinen J. Gaze Behaviour of Expert and Novice Microneurosurgeons Differs During Observations of Tumor Removal Recordings. In proceedings of 2012 ACM ETRA’12, pp. 377-380.pdf
• Vrzakova, H. and Bednarik, R. Hard lessons learned: mobile eye-tracking in cockpits roceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction (Gaze-In ’12)bibtexpdf
• Wang, P., Bednarik, R., Moreno, A. During automatic program animation, explanations after animations have greater impact than before animations. Proceedings of the 12th Koli Calling International Conference on Computing Education Research, Tahko, Finland, November 15-18, 2012, pp. 100-109pdf

2011

• Kamppuri, M. Theoretical and methodological challenges of cross-cultural interaction design (PhD thesis) Publications of the University of Eastern Finland. Dissertations in Forestry and Natural Sciences, no. 29.pdf
• Bednarik, R., Shipilov, A. and Pietinen, S. Bidirectional Gaze in Remote Computer Mediated Collaboration: Setup and Initial Results from Pair-Programming. CSCW’11 Proceedings of the ACM 2011 Conference on Computer Supported Cooperative Work.
• Tedre, M., Hansson, H., Mozelius, P. & Lind, S. Crucial Considerations in One-to-One Computing in Developing Countries. IST-Africa 2011 Conference Proceedings.
• Eivazi, S. and Bednarik, R. Predicting Problem-Solving Behavior and Performance Levels from Visual Attention Data. Proceedings of the 2nd Workshop on Eye Gaze in Intelligent Human Machine Interaction in Conjunction with IUI 2011 (International Conference on Intelligent User Interfaces), 9-16.
• Gowases, T., Bednarik, R. and Tukiainen, M. Text Highlighting Improves User Experience for Reading with Magnified Displays. CHI EA’11 Proceedings of the 2011 Annual Conference Extended Abstracts on Human Factors in Computing Systems.

2010

• Pietinen, S. Eye-tracking Setups for Diverse Collaborative Environments. Tietojenkäsittelytieteen päivät 2010, The Computer Science Days 2010, 16-18.
• Naumanen, M. and Tukiainen, M. Practices in Old Age ICT Education Three Contexts Considered: Clubs, Courses and Home Teaching. Learning and Instruction in the Digital Age, 273-288.
• Malmi, L., Sheard, J.S., Bednarik, R., Helminen, J., Korhonen, A., Myller, N., Sorva, J and Taherkhani, A. Characterizing Research in Computing Education: A preliminary analysis of the literature. Proceedings of the International Computing Education Research Workshop, ICER’10, 3-11.
• Naumanen, M. and Tukiainen, M. Discretionary use of computers and Internet among senior-clubbers-communication, writing and information search. World Conference on Educational Multimedia, Hypermedia and Telecommunications (EDMEDIA) 2010, 100-108.
• Pietinen, S., Bednarik, R. and Tukiainen, M. Eye-tracking in Collaborative settings: Setup and Descriptive analysis. The 5th Scandinavian Workshop on Applied Eye-Tracking, SWAET 2010, 38.
• Eivazi, S. and Bednarik, R. Inferring Problem Solving Strategies Using Eye-Tracking: System Description and Evaluation. Koli Calling’10 Proceedings of the 10th Koli Calling International Conference on Computing Education Research.
• Pietinen, S., Bednarik, R. and Tukiainen, M. Shared Visual Attention in Collaborative Programming: A Descriptive Analysis. ACM/IEEE 32nd International Conference on Software Engineering, ICSE 2010, Cooperative and Human Aspects of Software Engineering, CHASE 2010, Workshop at the ICSE 2010.
• Islas Sedano, C., Pawlowski, J., Sutinen, E., Naumanen, M., Vinni, M. and Laine, T.H. Involvement of non-technical individuals in the design of successful digital games. IEE Multidisciplinary Engineering Education Magazine, 3(5), 10-18.

2009

• Bednarik, R., Gowases, T., and Tukiainen, M. Gaze interaction enhances problem solving: Effects of dwell-time based, gaze-augmented, and mouse interaction on problem-solving strategies and user experience. Journal of Eye Movement Research, 3(1), June 2009, pp. 1-10. pdf
• Duveskog, M., Bednarik, R., Sutinen, R., Kemppainen, K. Designing a Story-Based Platform for HIV/AIDS Counseling with Tanzanian Children. In Proceedings of the 8th ACM International Conference on Interaction Design and Children, pp. 27-35, 2009. pdf
• Myller, N., Bednarik, R., Sutinen, E. and Ben-Ari, M. Extending the Engagement Taxonomy: Software Visualization and Collaborative Learning. ACM Transactions on Computing Education (TOCE), 9(1), March 2009. pdf
• Naumanen, M. and Tukiainen, M. Practices in old age ICT-education, Three contexts considered: clubs, courses & home teaching. In J.M. Spector, D. Ifenthaler, Pl. Isaïas, Kinshuk & D. Sampson (Eds.). Learning and Instruction in the Digital Age. Springer Verlag, Chp 17 (forthcoming).
• Naumanen, M. and Tukiainen, M. Guided participation in ICT-education for seniors: motivation and social support. Frontiers in Education 2009 conference, San Antonio, USA, October 18-21, 2009. pdf
• Pietinen, S., Bednarik, R. and Tukiainen, M. An Exploration of Shared Visual Attention in Collaborative Programming. 21st Annual Psychology of Programming Interest Group Conference, PPIG 2009, Limerick, Ireland, 24th – 26th, June 2009. pdf
• Pietinen, S., Tenhunen, V., and Tukiainen, M. Productivity and eye movements in collaborative work: Case pair programming. Proceedings of the 9th International SPICE Conference on Process Assessment and Improvement (SPICE 2009), Turku, Finland, June 2-4, 2009.
• Rogers, P.C., Sutinen, E., Gowases, T. (2009). ICT Education in context: Towards a shared ICT4D Curriculum. Proceedings of the International Conference on IST Africa, 6th-8th May, 2009, Kampala, Uganda.
• Tedre, M. and Kamppuri, M. Students Perspectives on Challenges of IT Education in Rural Tanzania. Proceedings of IST-Africa 2009 conference, Kampala, Uganda, May 6th-8th 2009.
• Randolph, J., Rogers, P., Myller, N. and Bednarik, R. Emerging Technologies for Educational Evaluation. Educational Evaluation: 21st Century Issues and Challenges, 417-442.
• Duveskog, M., Kemppainen, K., Bednarik, R. and Sutinen, E. Designing a Story-Based Platform for HIV and AIDS Counseling with Tanzanian Children. ACM Proceedings of the 8th International Conference on Interaction Design and Children, IDC 2009, 27-35.
• Naumanen, M. and Tukiainen, M. Guided Participation in ICT-Education for Seniors: Motivation and Social Support. 39th Annual ASEE/IEEE Frontiers in Education Conference, Imagining and Engineering Future CSET Education, FIE 2009.
• Naumanen, M. and Tukiainen M. K-60 – Access to ICT granted but not taken for granted. Proceedings of E-Learn 2008 world conference on E-Learning in corporate, government, healthcare, & higher education, E-Learn’08 AACE, Las Vegas, NV, USA, November 17-21, 2241-2250.
• Myller, N., Bednarik, R., Sutinen, E. and Ben-Ari, M. Extending the Engagement Taxonomy: Software Visualization and Collaborative Learning. ACM Transactions on Computer Education (TOCE), 1(9), 1-27.
• Bond, M., & Beale, R. What makes a good game? Using reviews to inform design. Proceedings of the 23rd British HCI Group Annual Conference on People and Computers Celebrating People and Technology (pp. 418-422). British Computer Society.pdf

2008

• Bednarik, R., Randolph, J. Studying Cognitive Processes in Computer Program Comprehension. In Hammoud, R. I. (Ed): Passive Eye Monitoring: Algorithms, Applications and Experiments, Springer, ISBN 9783540754114, pp. 373-386, 2008.
• Bednarik, R., Tukiainen, M. Temporal Eye-Tracking Data: Evolution of Debugging Strategies with Multiple Representations. In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications (Savannah, Georgia, March 26 – 28, 2008). ETRA ’08. ACM, New York, NY, pp. 99-102. pdf
• Gowases, T., Bednarik, R., and Tukiainen, M. Gaze vs. Mouse in Games: The Effects on User Experience. Proceedings of the 16th International Conference on Computers in Education (ICCE 2008), Taipei, Taiwan, October 27-31, 2008, pp. 773-778. pdf
• Kamppuri, M., Bednarik, R, and Juntunen, A. Haasteena käytettävyys: Kotihoitoa tukevat etäpalvelut-hankkeen käytettävyystutkimus. Kajaanin ammattikorkeakoulun julkaisusarja B, Raportteja ja selvityksiä 11, 2008, ss. 39, ISBN 978-952-9853-6, ISSN 1458-915X.
• Naumanen, M. and Tukiainen, M. Practises in Old Age ICT-Education. IADIS International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2008), Freiburg, Germany, 13-15 October, 2008, ISBN 978-972-8924-69-0. pdf
• Naumanen, M. and Tukiainen, M. K-60 – Access to ICT granted but not taken for granted. Proceedings of E-Learn 2008 world conference on E-Learning in corporate, government, healthcare, & higher education, E-Learn’08 AACE, Las Vegas, NV, USA, November 17-21, 2008, pp. 2241-2250. pdf
• Pietinen, S., Bednarik, R., Glotova, T., Tenhunen, V., Tukiainen, M. A Method to Study Visual Attention Aspects of Collaboration: Eye-Tracking Pair Programmers Simultaneously. In Proceedings of the 2008 Symposium on Eye Tracking Research & Applications (Savannah, Georgia, March 26 – 28, 2008). ETRA ’08. ACM, New York, NY, pp. 39-42. pdf
• Pietinen, S., Tenhunen, V., and Tukiainen, M. Productivity of pair programming in a distributed environment – Results from two controlled case studies. In Proceedings of the European Systems & Software Process Improvement and Innovation (EuroSPI’08), Dublin,Ireland, September 3-5, 2008, pp. 47-58.

2007

• Bednarik, R., Tukiainen, M. Validating the Restricted Focus Viewer: A Study Using Eye-Movement Tracking. Behavior Research Methods, 39(2), 2007, pp. 274-282. pdf
• Bednarik, R., Tukiainen, M. Analysing and Interpreting Quantitative Eye-Tracking Data in Studies of Programming: Phases of Debugging with Multiple Representations. In Proceedings of the 19th Annual Workshop of the Psychology of Programming Interest Group (PPIG’07), Joensuu, Finland, July 2-6, 2007, pp. 158-172. pdf
• Bednarik, R., Jansen, A. Eye-tracking and its applications in studies of programming. In Proceedings of the 19th Annual Workshop of the Psychology of Programming Interest Group (PPIG’07), Joensuu, Finland, July 2-6, 2007, pp. 255.
• Bednarik, R., Kamppuri, M., Tedre, M., and Vesisenaho, M. Alternative to Technology-Driven Development: An Approach Based on Authentic Needs. The CHI 2007 Workshop on User-Centered Design and International Development, San Jose, California, April 28th, 2007. pdf
• Bednarik, R. Methods to Analyze Visual Attention Strategies: Applications in the Studies of Programming. University of Joensuu, Computer Science, Dissertations 21, 2007. pdf
• Gowases, T. Gaze vs. Mouse: An evaluation of user experience and planning in problem solving games. University of Joensuu, Department of Computer Science and Statistics, Masters Thesis, 2007. pdf
• Naumanen, M. & Tukiainen, M. (2007a). Seniors’ Club – Learning and Blogging Together . In Web Based Communities (WBC 2007). February 18-20, Salamanca, Spain,  pp. 312-316. pdf
• Naumanen, M. & Tukiainen, M. (2007b). Guiding the elderly into the use of computers and Internet – Lessons taught and learnt . Cognition and Exploratory Learning in Digital Age (CELDA 2007), 2007, IADIS,  December 7-9, Algarve, Portugal,  pp. 19-27. pdf
• J. Sajaniemi, M. Tukiainen, R. Bednarik, S. Nevalainen (eds.) (2007). Proceedings of the 19th Annual Workshop of the Psychology of Programming Interest Group (PPIG07), Joensuu, Finland, July, 2007. International Proceedings Series 7, University of Joensuu, Department of Computer Science and Statistics.
• Savioja, E and Tukiainen, M. Measurement Practices in Financial Software Industry. Software Process: Improvement and Practice, Vol. 12, Issue 6, pp. 585 — 595, 2007, ISSN 1077-4866. pdf
• Soini, J., Makela, T., Tenhunen, V. Managing and Processing Knowledge Sharing between Software Organizations: A Case Study. PICMET ’07 Conference, Portland, Oregon, USA, 5.-9.8.2007. pdf
• Soini, J., Varkoi, T., Tenhunen, V. and Tukiainen, M. Empirical Case Study of Software Metrics using the SPICE Framework. Proceedings the 7th International SPICE Conference on Process Assessment and Improvement (SPICE 2007), Seoul, Korea, May 9-11, 2007, pp. 22-28, ISBN 978-89-7641-609-4.
• Tenhunen, V., Soini, J., Tukiainen, M. Software Metrics and Evaluation of Their Usefulness in Finnish Software Companies. IWSM-Mensura 2007 Conference, Palma de Mallorca, Spain, 5.-7.11.2007.

2006

• Markku Tukiainen, Richard Messnarz, Risto Nevalainen, Sonja Koinig eds. (2006). EuroSPI 2006 Industrial Proceedings. EuroSPI 2006, October 11-13, 2006, Joensuu, Finland. University of Joensuu, Deparment of Computer Science, International Proceedings Series 6. pp. 350. ISBN: 952-458-864-1.
• Eronen, P., Keränen, J., Sutinen, E. and Tukiainen, M. Work in Progress: Seniors Club – Technology Club and Research Laboratory. Proceedings of the 36th ASEE/IEEE Frontiers in Education Conference, San Diego, California, October 28-31, 2006, pp. S3H-7-S3H-8, ISBN 1-4244-0257-3. pdf
• Heinänen, J. and Tukiainen, M. Improving Requirements Reuse: Case Abloy. EuroSPI 2006 Industrial Proceedings, Joensuu, Finland, October 11-13, 2006, University of Joensuu, Deparment of Computer Science, International Proceedings Series 6. pp. 3.21-3.30, ISBN: 952-458-864-1.
• Savioja, E. and Tukiainen, M. Measurement Practices in Fidenta. EuroSPI 2006 Industrial Proceedings, Joensuu, Finland, October 11-13, 2006, University of Joensuu, Deparment of Computer Science, International Proceedings Series 6. pp. 2.23-2.34, ISBN: 952-458-864-1.
• Soini, J., Tenhunen, V. and Tukiainen, M. Current Practices of Measuring Quality in Finnish Software Engineering Industry. In Software Process Improvement: Ita Richardson; Per Runeson & Richard Messnarz (Eds.), Proceedings of the 13th European Conference, EuroSPI 2006, Joensuu, Finland, October 11-13, Springer .Verlag, Lecture Notes in Computer Science 4257, pp. 100-110, ISSN: 0302-9743.
• Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M. Analyzing Individual Differences in Program Comprehension. Technology, Instruction, Cognition and Learning (TICL), 3 (3-4), special issue on modeling and simulation, 2006, pp. 205-232.
• Kamppuri, M., Tedre, M., Tukiainen, M. Towards the Sixth Level in Interface Design: Understanding Culture In Proceedings of the 5th ACM Conference on Human Computer Interaction in Southern Africa (Cape Town, South Africa, January 25-27). CHI-SA 2006. pp. 69-74. pdf
• Tedre, M., Kamppuri, M., Kommers, P. An Approach to Global Netiquette Research In Proceedings of International Conference Web Based Communities (San Sebastian, Spain, February 26-28, 2006). IADIS 2006. pp. 367-370. pdf
• Kamppuri, M., Bednarik, R., Tukiainen, M. The Expanding Focus of Design: Case Culture. In proceedings of NordiCHI 2006, The Fourth Nordic Conference on Human-Computer Interaction. Oslo, Norway, 2006, ACM Press, pp. 405-408. pdf
• Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M. Program Visualisation: Comparing Eye-tracking Patterns with Comprehension Summaries and Performance. In proceedings of the 18th Annual Workshop of the Psychology of Programming Interest Group (PPIG’06), Brighton, UK, September 7-8, 2006, pp. 68-82. pdf
• Bednarik, R., Tukiainen, M. An Eye-tracking Methodology for Characterizing Program Comprehension. In Proceedings the 2006 Symposium on Eye Tracking Research and Applications, ETRA 2006, March 27-29, San Diego, CA, USA, ACM Press, pp. 125 – 132. pdf

2005

• Kamppuri, M., Tedre, M., Tukiainen M. A Cultural Approach to Interface Design In Proceedings of the 5th Koli Calling Conference on Computer Science Education (Koli, Finland, November 17-18, 2005). Koli Calling 2005. TUCS Publication No 41, pp. 149-152. pdf
• Naumanen, M., Nikula, S. & Sutinen, E. (2005). Group Awareness: Where, What and with Whom – in Search of Taxonomy for Cooperative Visualization Tools. Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications (ED-MEDIA2005), Montreal, Canada, pp. 4029-4036. pdf
• Bednarik, R., Myller, N., Sutinen, E., Tukiainen, M. Effects of Experience on Gaze Behaviour during Program Animation. In proceedings of the 17th Annual Psychology of Programming Interest Group Workshop (PPIG’05), Brighton, UK, June 28 – July 1, 2005, pp. 49-61. pdf
• Bednarik, R., Tukiainen, M. Effects of Display Blurring on the Behavior of Novices and Experts during Program Debugging. In CHI ’05 extended abstracts on Human factors in computing systems, CHI 2005, Portland, Oregon, USA, April 2-7, 2005, ACM Press, pp. 1204-1207. pdf
• Bednarik, R. Potentials of Eye-Movement Tracking in Adaptive Systems. In the Proceedings of the Fourth Workshop on the Evaluation of Adaptive Systems, held in conjunction with the 10th International Conference on User Modeling (UM’05), Edinburgh, UK, July 24th to 30th, 2005, pp. 1-8. pdf
• Mäkinen T., Varkoi T. and Tukiainen, M. Towards Managed Software Process Using Lean Principles. SWDC-REK 2005, Software Development – Proceedings of the International Conference on Software Development, University of Iceland, Reykjavik, Iceland, May 27 – June 1 2005, pp. 208-213.

2004

• Haavikko, M., Johansson, M., Mäkinen, T., Nevalainen, R., Saastamoinen, I., Tukiainen, M. and Varkoi, T. (2004). GNOSIS – An Approach for SPI Knowledge Management. Proceedings of the 4th International SPICE Conference on Process Assessment and Improvement (SPICE 2004), April 27-29, 2004, Lisbon, Portugal, pp. 91-99.
• Saastamoinen, I., Tukiainen, M., Mäkinen, T. and Varkoi, T. (2004). Evaluation of a Software Tool for Knowledge Management in Software Process Improvement. Proceedings of the Portland International Conference on Management of Engineering and Technology (PICMET’04), CD-ROM., August 1-4, 2004, Seoul, Korea.
• Bednarik, R., Tukiainen, M. Visual Attention Tracking During Program Debugging. In Proceedings of NordiCHI 2004, The Third Nordic Conference on Human-Computer Interaction, October 23-27, 2004, Tampere, Finland, ACM Press, pp. 331-334. pdf
• Bednarik, R., Gerdt, P., Miraftabi, R., Tukiainen, M.: Development of the TUP Model – Evaluating Educational Software. In Proceedings of the 4th IEEE International Conference on Advanced Learning Technologies (ICALT 2004), Joensuu, Finland, August 30 – September 1, 2004, IEEE Computer Society, pp. 699-701. pdf
• Kamppuri, M. & Tukiainen, M. Culture in Human-Computer Interaction Studies: A Survey of Ideas and Definitions. Accepted to the Fourth International Conference on Cultural Attitudes towards Technology and Communication (CATaC’04), Karlstad, Sweden, June 2004.
• Bednarik, R. and Tukiainen, M. Visual Attention and Representation Switching in Java Program Debugging: A Study Using Eye Movement Tracking. Proceedings of 16th Annual Workshop of the Psychology of Programming Interest Group (PPIG’04), pp. 159-169, April 2004. pdf
• Saastamoinen, I. & Tukiainen, M. (2004). i Software Process Improvement in Small and Medium Sized Software Enterprises in Eastern Finland: A State-of-the-Practice Study. Proceedings of 11th European Conference on Software Process Improvement (EuroSPI 2004), Ed. T. Dingsoyr, Springer Verlag, LNCS 3281, 2004, pp. 69-78. pdf
• Saastamoinen, I., Tukiainen, M., Mäkinen, T. and Varkoi, T. User Expectations for an SPI Knowledge Management System. Industrial Proceedings of the 11th European Software Process Improvement Conference (EuroSPI 2004), Trondheim, Norway, pp. l2-B. 1-6.

2003

• Kamppuri, M. and Tukiainen, M. Improving Cultural Usability of Educational Software. Proceedings of the Second International Conference on Educational Technology in Cultural Context, pp. 97-109, 2003.
• Naumanen, M. (2003). A Narrative perspective to students experiences in problem-based learning in theory of computation – New deals with learning . Proceedings of Koli Calling 2003, Koli, Lieksa, Finland, pp. 59-67. pdf

2002

• Tenhunen, V., Sajaniemi, J. An Evaluation of Inspection Automation Tools. Software Quality – ECSQ 2002: 7th International Conference, Helsinki, Finland, June 9-13, 2002. bibtex pdf