research-article
Authors: Shunichi Kasahara, Kazuma Takada
ACM Transactions on Applied Perception (TAP), Volume 18, Issue 4
Article No.: 23, Pages 1 - 17
Published: 28 October 2021 Publication History
Metrics
Total Citations2Total Downloads534Last 12 Months120
Last 6 weeks5
New Citation Alert added!
This alert has been successfully added and will be sent to:
You will be notified whenever a record that you have chosen has been cited.
To manage your alert preferences, click on the button below.
Manage my Alerts
New Citation Alert!
Please log in to your account
Get Access
- Get Access
- References
- Media
- Tables
- Share
Abstract
We present an approach for covert visual updates by leveraging change blindness with computationally generated morphed images. To clarify the design parameters for intentionally suppressing change detection with morphing visuals, we investigated the visual change detection in three temporal behaviors: visual blank, eye-blink, and step-sequential changes. The results showed a robust trend of change blindness with a blank of more than 33.3 ms and with eye blink. Our sequential change study revealed that participants did not recognize changes until an average of 57% morphing toward another face in small change steps. In addition, changes went unnoticed until the end of morphing in more than 10% of all trials. Our findings should contribute to the design of covert visual updates without consuming users’ attention by leveraging change blindness with computational visual morphing.
References
[1]
Piotr D. Adamczyk and Brian P. Bailey. 2004. If not now, when? The effects of interruption at different moments within task execution. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI’04). Association for Computing Machinery, New York, NY, 271–278. https://doi.org/10.1145/985692.985727
Digital Library
[2]
Nora Andermane, Jenny M. Bosten, Anil K. Seth, and Jamie Ward. 2019. Individual differences in change blindness are predicted by the strength and stability of visual representations. Neurosci. Conscious. 2019, 1 (Jan. 2019), niy010.
[3]
M. W. Becker, H. Pashler, and S. M. Anstis. 2000. The role of iconic memory in change-detection tasks. Perception 29, 3 (2000), 273–286.
[4]
Benjamin Bolte and Markus Lappe. 2015. Subliminal reorientation and repositioning in immersive virtual environments using saccadic suppression. IEEE Trans. Vis. Comput. Graph. 21, 4 (Apr. 2015), 545–552.
Digital Library
[5]
Andrew Brock, Jeff Donahue, and Karen Simonyan. 2018. Large scale GAN training for high fidelity natural image synthesis. Retrieved from https://arxiv.org/abs/1809.11096.
[6]
Michael Brock, Aaron Quigley, and Per Ola Kristensson. 2018. Change blindness in proximity-aware mobile interfaces. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI’18). ACM Press, New York, New York, 1–7.
Digital Library
[7]
J. Cech and T. Soukupova. 2016. Real-time eye blink detection using facial landmarks. In Proceedings of the 21st Computer Vision Winter Workshop.
[8]
Thomas Davies and Ashweeni Beeharee. 2012. The case of the missed icon: Change blindness on mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’12). Association for Computing Machinery, New York, NY, 1451–1460.
Digital Library
[9]
J. Deng, W. Dong, R. Socher, L. Li, Kai Li, and Li Fei-Fei. 2009. ImageNet: A large-scale hierarchical image database. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 248–255.
[10]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. BERT: Pre-training of deep bidirectional transformers for language understanding. Retrieved from arxiv:1810.04805.
[11]
Joseph DiVita, Richard Obermayer, William Nugent, and James M. Linville. 2004. Verification of the change blindness phenomenon while managing critical events on a combat information display. Hum. Factors 46, 2 (2004), 205–218.
[12]
Paula J. Durlach. 2004. Change blindness and its implications for complex monitoring and control systems design and operator training. Human–Computer Interaction 19, 4 (Dec. 2004), 423–451.
Digital Library
[13]
Erin Goddard and Colin W. G. Clifford. 2013. A new type of change blindness: Smooth, isoluminant color changes are monitored on a coarse spatial scale. J. Vis. 13, 5 (Apr. 2013), 20.
[14]
John Grimes. 1996. On the failure to detect changes in scenes across saccades. Perception 339 (1996), 89–110.
[15]
Andrew Hollingworth and John M. Henderson. 2000. Semantic informativeness mediates the detection of changes in natural scenes. Vis. Cogn. 7, 1–3 (Jan. 2000), 213–235.
[16]
Tero Karras, Samuli Laine, and Timo Aila. 2020. A style-based generator architecture for generative adversarial networks. IEEE Trans. Pattern Anal. Mach. Intell. PP (January 2020). https://doi.org/10.1109/TPAMI.2020.2970919
[17]
Tero Karras, Samuli Laine, Miika Aittala, Janne Hellsten, Jaakko Lehtinen, and Timo Aila. 2019. Analyzing and improving the image quality of StyleGAN. Retrieved from https://arxiv.org/abs/1912.04958.
[18]
J. Kevin O’Regan, Heiner Deubel, James J. Clark, and Ronald A. Rensink. 2000. Picture changes during blinks: Looking without seeing and seeing without looking. Vis. Cogn. 7, 1–3 (Jan. 2000), 191–211.
[19]
Kyung-Ah Kwon, Rebecca J. Shipley, Mohan Edirisinghe, Daniel G. Ezra, Geoff Rose, Serena M. Best, and Ruth E. Cameron. 2013. High-speed camera characterization of voluntary eye blinking kinematics. J. R. Soc. Interface 10, 85 (Aug. 2013), 20130227.
[20]
Cédric Laloyaux, Christel Devue, Stéphane Doyen, Elodie David, and Axel Cleeremans. 2008. Undetected changes in visible stimuli influence subsequent decisions. Conscious. Cogn. 17, 3 (Sept. 2008), 646–656.
[21]
Eike Langbehn, Frank Steinicke, Markus Lappe, Gregory F. Welch, and Gerd Bruder. 2018. In the blink of an eye: Leveraging blink-induced suppression for imperceptible position and orientation redirection in virtual reality. ACM Trans. Graph. 37, 4 (Aug. 2018), 1–11.
Digital Library
[22]
Li-Qian Ma, Kun Xu, Tien-Tsin Wong, Bi-Ye Jiang, and Shi-Min Hu. 2013. Change blindness images. IEEE Trans. Vis. Comput. Graph. 19, 11 (Nov. 2013), 1808–1819.
Digital Library
[23]
Gabriela Mancero, William Wong, and Paola Amaldi. 2007. Looking but not seeing: Implications for HCI. In Proceedings of the 14th European Conference on Cognitive Ergonomics Invent! Explore! (ECCE’07). ACM Press, New York, New York, 167.
Digital Library
[24]
Sebastian Marwecki, Andrew D. Wilson, Eyal Ofek, Mar Gonzalez Franco, and Christian Holz. 2019. Mise-unseen: Using eye tracking to hide virtual reality scene changes in plain sight. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST’19). Association for Computing Machinery, New York, NY, 777–789.
Digital Library
[25]
Yoshiko Nakamura, Jumpei Matsuda, Kazutaka Suzuki, Haruyoshi Toyoda, Naotoshi Hakamata, Takasumi Shimamoto, and Shigeru Kinosh*ta. 2008. [Measurement of spontaneous blinks with a high-speed blink analyzing system]. Nihon Ganka Gakkai Zasshi 112, 12 (Dec. 2008), 1059–1067.
[26]
J. K. O’Regan, R. A. Rensink, and J. J. Clark. 1999. Change-blindness as a result of “mudsplashes.” Nature 398, 6722 (March 1999), 34.
[27]
Tabitha C. Peck, Laura E. Sockol, and Sarah M. Hanco*ck. 2020. Mind the gap: The underrepresentation of female participants and authors in virtual reality research. IEEE Trans. Visual. Comput. Graph. 26, 5 (2020), 1945–1954. https://doi.org/10.1109/TVCG.2020.2973498
[28]
Christian H. Poth, Rebecca M. Foerster, Christian Behler, Ulrich Schwanecke, Werner X. Schneider, and Mario Botsch. 2018. Ultrahigh temporal resolution of visual presentation using gaming monitors and G-Sync. Behav. Res. Methods 50, 1 (Feb. 2018), 26–38.
[29]
Ronald A. Rensink. 2002. Change detection. Annu. Rev. Psychol. 53 (2002), 245–277.
[30]
Ronald A. Rensink. 2005. Change blindness. In Neurobiology of Attention, Laurent Itti, Geraint Rees, and John K. Tsotsos (Eds.). Academic Press, Burlington, 76–81.
[31]
Ronald A. Rensink, J. Kevin O’Regan, and James J. Clark. 2000. On the failure to detect changes in scenes across brief interruptions. Vis. Cogn. 7, 1–3 (Jan. 2000), 127–145.
[32]
Ronald A. Rensink, J. Kevin O’Regan, and James J. Clark. 1997. To see or not to see: The need for attention to perceive changes in scenes. Psychol. Sci. 8, 5 (Sept. 1997), 368–373.
[33]
W. H. Ridder, 3rd and A. Tomlinson. 1997. A comparison of saccadic and blink suppression in normal observers. Vision Res. 37, 22 (Nov. 1997), 3171–3179.
[34]
Harvey Richard Schiffman. 1990. Sensation and Perception: An Integrated Approach, 3rd ed. Wiley, 555.
[35]
D. J. Simons and C. F. Chabris. 1999. Gorillas in our midst: Sustained inattentional blindness for dynamic events. Perception 28, 9 (1999), 1059–1074.
[36]
D. J. Simons, S. L. Franconeri, and R. L. Reimer. 2000. Change blindness in the absence of a visual disruption. Perception 29, 10 (2000), 1143–1154.
[37]
E. A. Suma, S. Clark, D. Krum, S. Finkelstein, M. Bolas, and Z. Warte. 2011. Leveraging change blindness for redirection in virtual environments. In Proceedings of the IEEE Virtual Reality Conference. 159–166.
Digital Library
[38]
James W. Tanaka, Markus Kiefer, and Cindy M. Bukach. 2004. A holistic account of the own-race effect in face recognition: Evidence from a cross-cultural study. Cognition 93, 1 (Aug. 2004), B1–9.
[39]
D. Alexander Varakin, Daniel T. Levin, and Roger Fidler. 2008. Unseen and unaware: Implications of recent research on failures of visual awareness for human-computer interface design. Hum.-Comput. Interact. 19, 4 (Dec. 2008), 389–422.
Digital Library
[40]
F. C. Volkmann. 1986. Human visual suppression. Vision Res. 26, 9 (1986), 1401–1416.
[41]
F. C. Volkmann, L. A. Riggs, and R. K. Moore. 1980. Eyeblinks and visual suppression. Science 207, 4433 (Feb. 1980), 900–902.
[42]
Andrew D. Wilson and Shane Williams. 2018. Autopager: Exploiting change blindness for gaze-assisted reading. In Proceedings of the ACM Symposium on Eye Tracking Research and Applications, Vol. 2. ACM, New York, NY, 1–5.
Digital Library
Cited By
View all
- Tao YWang R(2024)Artistic Image Enhancement Based on Iterative Contrastive Learning2024 3rd International Conference on Sentiment Analysis and Deep Learning (ICSADL)10.1109/ICSADL61749.2024.00069(386-392)Online publication date: 13-Mar-2024
- Shimizu KIenaga NTakada KSugimoto MKasahara S(2022)Human Latent Metrics: Perceptual and Cognitive Response Correlates to Distance in GAN Latent Space for Facial ImagesACM Symposium on Applied Perception 202210.1145/3548814.3551460(1-10)Online publication date: 22-Sep-2022
https://dl.acm.org/doi/10.1145/3548814.3551460
Index Terms
Stealth Updates of Visual Information by Leveraging Change Blindness and Computational Visual Morphing
Human-centered computing
Human computer interaction (HCI)
Interaction devices
Displays and imagers
Recommendations
- Human Visual Scanpath Prediction Based on RGB-D Saliency
ICIGP '18: Proceedings of the 2018 International Conference on Image and Graphics Processing
Human visual perception is considered as a dynamic process of information acquisition, while the visual scanpath can clearly reflect the shift of our eye fixations. In the previous study of visual attention, researchers generally do the saliency ...
Read More
- Varying rendering fidelity by exploiting human change blindness
GRAPHITE '03: Proceedings of the 1st international conference on Computer graphics and interactive techniques in Australasia and South East Asia
The complexity of most virtual environments prevents them being rendered in real time even on modern graphics hardware. Knowledge of the visual system of the user viewing the environment may be used to significantly reduce image computation times. In ...
Read More
- Pupil vs. Eyelid: Evaluating the Accuracy of Blink Detection in Pupil-based Eye Tracking Devices
Abstract
Spontaneous eye blinks as a means to tap into human cognitive and affective processes have been demonstrated to offer valuable insight in various fields of application, such as human-computer-interaction and driver drowsiness detection. ...
Read More
Comments
Information & Contributors
Information
Published In
ACM Transactions on Applied Perception Volume 18, Issue 4
October 2021
74 pages
ISSN:1544-3558
EISSN:1544-3965
DOI:10.1145/3492443
- Editor:
- Bobby Bodenheimer
Vanderbilt University USA
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [emailprotected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 28 October 2021
Accepted: 01 August 2021
Received: 01 August 2021
Published inTAPVolume 18, Issue 4
Permissions
Request permissions for this article.
Check for updates
Author Tags
- Change blindness
- eye tracking
- blink detection
- morphing
- generative adversarial network
Qualifiers
- Research-article
- Refereed
Funding Sources
- JST Moonshot R&D Program
Contributors
Other Metrics
View Article Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations
2
Total Citations
534
Total Downloads
- Downloads (Last 12 months)120
- Downloads (Last 6 weeks)5
Reflects downloads up to 01 Aug 2024
Other Metrics
View Author Metrics
Citations
Cited By
View all
- Tao YWang R(2024)Artistic Image Enhancement Based on Iterative Contrastive Learning2024 3rd International Conference on Sentiment Analysis and Deep Learning (ICSADL)10.1109/ICSADL61749.2024.00069(386-392)Online publication date: 13-Mar-2024
- Shimizu KIenaga NTakada KSugimoto MKasahara S(2022)Human Latent Metrics: Perceptual and Cognitive Response Correlates to Distance in GAN Latent Space for Facial ImagesACM Symposium on Applied Perception 202210.1145/3548814.3551460(1-10)Online publication date: 22-Sep-2022
https://dl.acm.org/doi/10.1145/3548814.3551460
View Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in
Full Access
Get this Article
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML FormatMedia
Figures
Other
Tables
