NTT Communication Science Laboratories Human Information Science Laboratory
English Japanese
NTT Communication Science Laboratories
Media Information Laboratory
Innovative Communication Laboratory
Human Information Science Laboratory
Perception and Emotion Research Group
Perception and Emotion Research Group
Sensory and Motor Research Group
Ueda Research Laboratory
Machine Learning and Data Science Center
Sports Brain Science Project
Moriya Research Laboratory
NTT Science and Core Technology Laboratory Group

Human Information Science Laboratory

  Human Information Science Laboratory uses approches such as information science, psychophyics, and neuroscience to investigate mechanisms underlying our perception, emotion, and motion, for understanding how environmental and social information is processed in human body and brain. The research findings are expected to serve as fundamentals of future information technologies that are conceptually novel and user-friendly.




Sensory Integration

Sensory Integration
Name Research area
Executive Director
Naoki SAIJO           Motor Sensory Integration

Research Groups

感覚運動研究グループ 感覚表現研究グループ

Selected Publications

  • 2017
  • 2016
  • 2015
  • 2014
  • 2013


  1. Lin, I.-F., Shirama, A., Kato, N., & Kashino, M. (2017). The singular nature of auditory and visual scene analysis in autism. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 372 (1714). pii: 20160115. Epub 2017 Jan 2.
  2. Kondo, H, M.. van Loon, A. M., Kawahara, J., Moore, B., (2017). Auditory and visual scene analysis: An overview. Philosophical Transactions of the Royal Society of London B: Biological Sciences, 372 (1714). pii: 20160099. Epub 2017 Jan 2.
  3. Watanabe, K., Ooishi, Y., & Kashino, M. (2017). Heart rate responses induced by acoustic tempo and its interaction with basal heart rate. Scientific Reports, 7:43856.
  4. Sakamoto, M., & Watanabe, J. (2017). Exploring tactile perceptual dimensions using materials associated with sensory vocabulary. Frontier in Psychology, 8:569.
  5. Sawayama, M., Nishida, S., & Shinya, M. (2017). Human perception of subresolution fineness of dense textures based on image intensity statistics. Journal of Vision, 17(4):8.
  6. Sawayama, M., Adelson, E. H., & Nishida, S. (2017). Visual wetness perception based on image color statistics. Journal of Vision, 17(5):7, 1-24.
  7. Kawabe, T., & Kogovšek, R. (2017). Image deformation as a cue to material category judgment. Scientific Reports, 7:44274.
  8. Yamagishi, S., Otsuka, S., Furukawa, S., & Kashino, M. (2017). Comparison of perceptual properties of auditory streaming between spectral and amplitude modulation domains. Hearing Research, 350, 244-250.
  9. Hayashi, R., Watanabe, O., Yokoyama, H., & Nishida, S. (2017). A new analytical method for characterizing nonlinear visual processes with stimuli of arbitrary distribution: Theory and applications. Journal of Vision, 17(6), 14-20.
  10. Kawabe, T. (2017). Perceiving animacy from deformation and translation. i-Perception, 8(3):2041669517707767.
  11. Kuroki, S., Watanabe, J., & Nishida, S. (2017). Integration of vibrotactile frequency information beyond the mechanoreceptor channel and somatotopy. Scientific Report, 7:2758.
  12. Yokosaka, T., Kuroki, S., Watanabe, J., & Nishida, S. (2017). Linkage between free exploratory movements and subjective tactile ratings. (2017). IEEE Transactions on Haptics, 10(2), 217-225.
  13. Klimova, M., Nishida, S., & Roseboom, W. (in press). Grouping by feature of cross-modal flankers in temporal ventriloquism. Scientific Reports.
  14. Altmann, C. F.*, Ueda, R., Furukawa, S., Kashino, M., Mima, T., Fukuyama, H. (in press). Auditory mismatch negativity in response to changes of counter-balanced interaural time and level differences. Frontiers in Neuroscience.


  1. Rider, A. T., Nishida, S., & Johnston, A. (2016). Multiple-stage ambiguity in motion perception reveals global computation of local motion directions. Journal of Vision, 16 (15): 7.
  2. Kuroki, S., Hagura, N., Nishida, S., Haggard, P., & Watanabe, J. (2016). Sanshool on the fingertip interferes with vibration detection in a rapidly-adapting (RA) tactile channel. PLoS One, 11 (12): e0165842.
  3. Kitagawa, N., Kato, M., & Kashino, M. (2016). Auditory-somatosensory temporal sensitivity improves when the somatosensory event is caused by voluntary body movement. Frontiers in Integrative Neuroscience, 10: 42.
  4. Yokosaka, T., Kuroki, S., Watanabe, J., Nishida, S. (in press). Linkage between free exploratory movements and subjective tactile ratings. IEEE Transactions on Haptics.
  5. Kawabe, T., Sasaki, K., Ihaya, K., & Yamada. Y., (in press). When categorization-based stranger avoidance explains the uncanny valley. A comment on MacDorman & Chattopadhyay (2016). Cognition.
  6. Takeuchi, T., Yoshimoto, S., Shimada, Y., Kochiyama, T., & Kondo, H. M. (in press). Individual differences in visual motion perception and neurotransmitter concentrations in the human brain. Philosophical Transactions of the Royal Society of London B: Biological Sciences.
  7. Tajadura-Jimenez, A., Marquardt, T., Swapp, D., Kitagawa, N., & Bianchi-Berthouze, N. (2016). Action sounds modulate arm reaching movements. Frontiers in Psychology, 7: 1391.
  8. Kumano, S., Otsuka, K., Ishii, R., & Yamato, J. (in press). Collective first-person vision for automatic gaze analysis in multiparty conversations. IEEE Trans. Multimedia
  9. Otsuka, S., Furukawa, S., Yamagishi, S., Hirota, K., & Kashino, M. (in press). Relation between cochlear mechanics and performance of temporal fine structure-based tasks. Journal of the Association for Research in Otolaryngology.
  10. Petsas, T., Harrison, J., Kashino, M., Furukawa, S., & Chait, M. (2016). The effect of distraction on change detection in crowded acoustic scenes. Hearing Research, 341, 179-189.
  11. Yamagishi, S., Otsuka, S., Furukawa, S., Kashino, M. (2016). Subcortical correlates of auditory perceptual organization in humans. Hearing Research, 339, 104-111.
  12. Sato, T., Watanabe, J., Moriya, T. (in press). Presenting changes in acoustic features synchronously to respiration alters the affective evaluation of sound. International Journal of Psychophysiology.
  13. Amano, K., Lang, Q., Terada, Y., Nishida, S. (in press). Neural correlates of the time marker for the perception of event timing, eNeuro.
  14. Amemiya, T., Hirota, K., Ikei, Y. (in press). Tactile apparent motion on the torso modulates perceived forward self-motion velocity. IEEE Transactions on Haptics.
  15. Amemiya, T., Gomi, H. (in press). Active manual movement improves directional perception of illusory force. IEEE Transactions on Haptics.
  16. Kondo, H, M., Farkas, D., Denham, S., Asai, T., Winkler, I. (in press). Auditory multistability and neurotransmitter concentrations in the human brain. Philosophical Transactions of the Royal Society B: Biological Sciences.
  17. Hisakata, R., Nishida, S., Johnston, A. (2016). An adaptable metric shapes perceptual space. Current Biology, 26(14), 1911-1915.
  18. Ho, H.-N., Sato, K., Kuroki, S., Watanabe, J., Maeno, T., & Nishida, S. (in press). Physical-Perceptual correspondence for dynamic thermal stimulation. IEEE Transactions on Haptics.
  19. Asai, T., Kanayama. N., Imaizumi, S., Koyama, S., & Kaganoi, S. (2016). Development of embodied sense of self scale (ESSS): Exploring everyday experiences induced by anomalous self-representation. Frontiers in Psychology, 7:1005. doi: 10.3389/fpsyg.2016.01005
  20. Lin, I.-F., Agus, T. R., Suied, C., Pressnitzer, D., Yamada, T., Komine, Y., Kato, N., & Kashino, M. (2016). Fast response to human voices in autism. Scientific Reports, 6:26336. doi: 10.1038/srep26336.
  21. Mitani, K., & Kashino, M. (2016). Self-produced time intervals are perceived as more variable and/or shorter depending on temporal context in subsecond and suprasecond ranges. Frontiers in Integrative Neuroscience, 10:19. doi: 10.3389/fnint.2016.00019.
  22. Shirama, A., Kanai, C., Kato, N., & Kashino, M. (2016). Ocular fixation abnormality in patients with autism spectrum disorder. Journal of Autism and Developmental Disorders, 46(5), 1613-1622. doi: 10.1007/s10803-015-2688-y.
  23. Farkas, D., Denham, S., Bendixen, A., Tóth, D., Kondo, H.M., & Winkler, I. (2016). Auditory multi-stability: Idiosyncratic perceptual switching patterns, executive functions and personality traits. PLOS ONE, 11:e0154810. doi: 10.1371/journal.pone.0154810
  24. Liao, H.-I., Kidani, S., Yoneya, M., Kashino, M., & Furukawa, S. (2016). Correspondences among pupillary dilation response, subjective salience of sounds, and loudness. Psychonomic Bulletin & Review, 23(2), 412-425.
  25. Ochi, A., Yamasoba, T., & Furukawa, S. (2016). Contributions of coding efficiency of temporal-structure and level information to lateralization performance in young and early-elderly listeners. Advances in Experimental Medicine and Biology, 894, 19-28. doi: 10.1007/978-3-319-25474-6_3.
  26. Kuroki, S., Watanabe, J. and Nishida, S. (2016). "Neural timing signal for precise tactile timing judgments." Journal of Neurophysiology 115(3): 1620-1629.
  27. Izawa, J., Asai, T. and Imamizu, H. (2016). "Computational motor control as a window to understanding schizophrenia." Neuroscience Research 104: 44-51.
  28. Liao, H. I., Yoneya, M., Kidani, S., Kashino, M. and Furukawa, S. (2016). "Human pupillary dilation response to deviant auditory stimuli: Effects of stimulus properties and voluntary attention." frontiers in Neuroscience 10.
  29. Otsuka, S., Tsuzaki, M., Sonoda, J., Tanaka, S. and Furukawa, S. (2016). "A role of medial olivocochlear reflex as a protection mechanism from noise-induced hearing loss revealed in short-practicing violinists." PLoS ONE 11(1): e0146751.
  30. Iida, N., Kuroki, S. and Watanabe, J. (2016). "Effects of somatotopic distance on tactile temporal numerosity judgements." Perception 45: 99-113.


  1. Asai, T. (2015). "Feedback control of one's own action: self-other sensory attribution in motor control." Consciousness and Cognition 38: 118-129.
  2. Oohashi, H., Hiroya, S. and Mochida, T. (2015). "Real-time robust formant estimation system using a phase equalization-based autoregressive exogenous model." Acoustical Science and Technology 36(6): 478-488.
  3. Ho, H.-N., Iwai, D., Yoshikawa, Y., Watanabe, J. and Nishida, S. (2015). "Impact of hand and object colors on object temperature perception." Temperature 2(3): 344-345.
  4. Watanabe, K., Ooishi, Y. and Kashino, M. (2015). "Sympathetic Tone Induced by High Acoustic Tempo Requires Fast Respiration." PloS One 10(8): e0135589.
  5. Ujiie, Y., Asai, T., Tanaka, A. and Wakabayashi, A. (2015). "The McGurk effect and autistic traits; an analogue perspective." Letters on Evolutionary Behavioral Science 6(2): 9-12.
  6. Kihara, K., Takeuchi, T., Yoshimoto, S., Kondo, H. M. and Kawahara, J. I. (2015). "Pupillometric evidence for the locus coeruleus-noradrenaline system facilitating attentional processing of action-triggered visual stimuli. ." Frontiers in Psychology 6(827).
  7. I-Fan, L., Yamada, T., Komine, Y., Kato, N., Kato, M. and Kashino, M. (2015). "Vocal identity recognition in autism spectrum disorder." PLOS ONE.
  8. Ujiie, Y., Asai, T. and Wakabayashi, A. (2015). "The relationship between level of autistic traits and local bias in the context of the McGurk effect." Frontiers in Psychology 6:891.
  9. Ukezono, M., Nakashima, S. F., Sudo, R., Yamazaki, A. and Takano, Y. (2015). "The combination of perception of other individuals and exogenous manipulation of arousal enhances social facilitation: re-examination of Zajonc’s drive theory." Frontiers in Psychology.
  10. Kondo, H. M., Nomura, M. and Kashino, M. (2015). "Different roles of the COMT and HTR2A genotypes in working memory subprocesses." PLOS ONE 10(5): e0126511.
  11. Nakashima, S. F., Ukezono, M., Nishida, H., Sudo, R. and Takano, Y. (2015). "Receiving of emotional signal of pain from conspecifics in laboratory rats." Royal Society Open Science.
  12. Yokosaka, T., Kuroki, S., Nishida, S. and Watanabe, J. (2015). "Apparent time interval of visual stimuli is compressed during fast hand movement." PLOS ONE 10(4): e0124901.
  13. Sawayama, M. and Kimura, E. (2015). "Stain on texture: Perception of a dark spot having a blurred edge on textured backgrounds." Vision research 109: 209-220.
  14. Kawabe, T., Maruya, K., Fleming, R. W. and Nishida, S. (2015). "Seeing liquids from visual motion." Vision Research 109(Part B): 125-138.
  15. Fleming, R. W., Gegenfurtner, K. R. and Nishida, S. (2015). "Visual perception of materials: The science of stuff." Vision Research 109(Part B): 123-124.
  16. Kumano, S., Otsuka, K., Mikami, D., Matsuda, M. and Yamato, J. (2015). "Analyzing Interpersonal Empathy via Collective Impressions." IEEE Transactions on Affective Computing(TAFFC) 6(4): 324-336.
  17. Abekawa, N. and Gomi, H. (2015). "Online gain update for manual following response accompanied by gaze shift during arm reaching." Journal of Neurophysiology 113(4): 1206-1216
  18. Yamada, Y., Kawabe, T. and Miyazaki, M. (2015). "Awareness shaping or shaped by prediction and postdiction: Editorial." Frontiers in Psychology 6(166).
  19. Kato, M. and Mugitani, R. (2015). "Pareidolia in Infants." PLoS ONE 10(2): e0118539.
  20. Kanaya, S., Fujisaki, W., Nishida, S., Furukawa, S. and Yokosawa, K. (2015). "Effects of frequency separation and diotic/dichotic presentations on the alternation frequency limits in audition derived from a temporal phase discrimination task." Perception 44(2): 198-214.
  21. Yang, J., Watanabe, J., Kanazawa, S., Nishida, S. and Yamaguchi, K. M. (2015). "Infants' visual system non-retinotopically integrates color signals along motion trajectory." Journal of Vision 15(1)(25): 1-10.
  22. Kuehn, E., De Havas, J., Silkoset, E., Gomi, H. and Haggard, P. (2015). "On the bimanual integration of proprioceptive information." Experimental Brain Research 233: 1273-1288.


  1. Bergman, P., Ho, H.-N., Koizumi, A., Tajadura-Jimenez, A. and Kitagawa, N. (2014). "The pleasant heat? Evidence for thermal-emotional implicit associations occurring with semantic and physical thermal stimulation." Cognitive Neuroscience 6(1): 24-30.
  2. Masuda, A., Watanabe, J., Terao, M., Yagi, A. and Maruya, K. (2014). "A temporal window for estimating surface brightness in the Craik-O'Brien-Cornsweet effect." Frontiers in Human Neuroscience: 1-11.
  3. Sugimori, E. and Asai, T. (2014). "Attribution of movement: Potential links between subjective reports of agency and output monitoring." The Quarterly Journal of Experimental Psychology 68(5): 900-916.
  4. Asai, T. (2014). "Illusory body-ownership entails automatic compensative movement: for the unified representation between body and action." Experimental Brain Research 233(3): 777-785.
  5. Nakashima, S. F., Morimoto, Y., Takano, Y., Yoshikawa, S. and Hugenberg, K. (2014). "Faces in the dark: interactive effects of darkness and anxiety on the memory for threatening faces." Frontiers in Psychology.(Front. Psychol.) 5(1091).
  6. Takano, Y. and Ukezono, M. (2014). "An experimental task to examine the mirror system in rats." Scientific Reports 4(6652).
  7. Kumano, S., Otsuka, K., Matsuda, M. and Yamato, J. (2014). "Analyzing Perceived Empathy based on Reaction Time in Behavioral Mimicry." IEICE Trans. E97-D(8): TBA.
  8. Ho, H.-N., Iwai, D., Yoshikawa, Y., Watanabe, J. and Nishida, S. (2014). "Combining colour and temperature: A blue object is more likely to be judged as warm than a red object." Scientific Reports 4: 5527.
  9. Imaizumi, S., Asai, T., Kanayama, N., Kawamura, M. and Koyama, S. (2014). "Agency over a phantom limb and electromyographic activity on the stump depend on visuomotor synchrony: a case study." Frontiers in Human Neuroscience 8(545).
  10. Kondo, H. M., Toshima, I., Pressnizer, D. and Kashino, M. (2014). "Probing the time course of head-motion cues integration during auditory scene analysis." Frontiers in Neuroscience 8(170): 1-7.
  11. ruga, R., Saito, H., Ando, H. and Watanabe, J. (2014). "Two-dimensional grouping affects perisaccadic perception of depth and synchrony." Perception 43(6): 589-594.
  12. Altmann, C. F., Terada, S., Kashino, M., Goto, K., Mima, T., Fukuyama, H. and Furukawa, S. (2014). "Independent or integrated processing of interaural time and level differences in human auditory cortex?" Hearing Research 312: 121-127.
  13. Abekawa, N., Inui, T. and Gomi, H. (2014). "Eye-hand coordination in on-line visuomotor adjustments." Neuroreport 25(7): 441-445.
  14. Fujisaki, W., Goda, N., Motoyoshi, I., Komatsu, H. and Nishida, S. (2014). "Audio-visual integration in the human perception of materials." Journal of Vision 14((4):12): 1-20.
  15. Otsuka, S., Furukawa, S., Yamagishi, S., Hirota, K. and Kashino, M. (2014). "Inter-individual variation of sensitivity to frequency modulation: Its relation with click-evoked and distortion-product otoacoustic emissions." Journal of Association for Research in Otolaryngology 15(2): 175-186.
  16. Ho, H.-N., Van Doorn, G. H., Kawabe, T., Watanabe, J. and Spence, C. (2014). "Colour-temperature correspondences: When reactions to thermal stimuli are influenced by colour." PLoS One 9(3): e91854.
  17. Ochi, A., Yamasoba, T. and Furukawa, S. (2014). "Factors that account for inter-individual variability of lateralization performance revealed by correlations of performance among multiple psychoacoustical tasks." Front. Neurosci. 8(27).


  1. Roseboom, W., Kawabe, T. and Nishida, S. (2013). "The cross-modal double flash illusion depends on featural similarity between cross-modal inducers." Scientific Reports 3: 3437.
  2. Linares, D. and Nishida, S. (2013). "A synchronous surround increases the motion strength gain of motion." Journal of Vision 13((13):12): 1-15.
  3. Yamada, Y., Kawabe, T. and Miyazaki, M. (2013). "Pattern randomness aftereffect." Scientific Reports 3: 2906.
  4. Hiroya, S. (2013). "Non-negative temporal decomposition of speech parameters by multiplicative update rules." IEEE Trans. Audio, Speech and Language Processing. 21(10): 2108-2117.
  5. Kawabe, T. (2013). "Side effect of acting on the world: Acquisition of action-outcome statistic relation alters visual interpretation of action outcome." Frontiers in Human Neuroscience 7: 610.
  6. Kuroki, S., Watanabe, J. and Nishida, S. (2013). "Contribution of within- and cross-channel information to vibrotactile frequency discrimination." Brain Research(1529): 46-55.
  7. Mochida, T., Kimura, T., Hiroya, S., Kitagawa, N., Gomi, H. and Kondo, T. (2013). "Speech misperception: speaking and seeing interfere differently with hearing." PLOS ONE 8(7): e68619.
  8. Liao, H. I., Wu, D. A., Halelamien, N. and Shimojo, S. (2013). "Cortical stimulation consolidates and reactivates visual experience: Neural plasticity from magnetic entrainment of visual activity." Scientific Reports 3: 2228.
  9. Ishii, R., Nakano, Y. and Nishida, T. (2013). "Gaze Awareness in Conversational Agents: Estimating User's Conversational Engagement using Eye-gaze." The ACM Transactions on Interactive Intelligent System, Special issue on interaction with smart objects, Special section on eye gaze and conversation archive 3(2)(11).
  10. Amemiya, T. and Gomi, H. (2013). "Directional Torque Perception with Brief, Asymmetric Net Rotation of a Flywheel." IEEE Transactions on Haptics 6(3): 370-375.
  11. Kawabe, T., Roseboom, W. and Nishida, S. (2013). "The sense of agency is action-effect causality perception based on cross-modal grouping." Proceedings of the Royal Society B: Biological Sciences(Proc. R. Soc. B) 280(1763): 20130991.
  12. Kawabe, T. (2013). "Inferring sense of agency from the quantitative aspect of action outcome." Consciousness and Cognition. 22(2): 407-412.
  13. Liao, H. I., Shimojo, S. and Yeh, S. L. (2013). "Happy Faces Are Preferred Regardless of Familiarity - Sad Faces Are Preferred Only when Familiar." Emotion,American Psychological Association 13(3): 391-396.
  14. Roseboom, W., Kawabe, T. and Nishida, S. (2013). "Audio-visual temporal recalibration can be constrained by content cues regardless of spatial overlap." Frontiers in Psychology.(Front. Psychol.) 4(189).
  15. Koizumi, A., Kitagawa, N., Kondo, H. M., Kitamura, M. S., Sato, T. and Kashino, M. (2013). "Serotonin transporter gene-linked polymorphism affects detection of facial expressions." PLOS ONE 8: e59074.
  16. Maruya, K., Holcombe, A. O. and Nishida, S. (2013). "Rapid encoding of relationships between spatially remote motion signals." Journal of Vision 13(2)(4): 1-20.
  17. Kato, M. and Konishi, U. (2013). "Where and how infants look: The development of fixations and scan paths in face perception." Infant Behavior and Development: An International and Interdisciplinary Journal 36(1): 32-41.
  18. Seno, T., Kawabe, T., Ito, H. and Sunaga, S. (2013). "Vection modulates emotional valence of autobiographical episodic memories. ." Cognition 126: 115-120.
  19. Liao, H. I., Shimojo, S. and Yeh, S. L. (2013). "Happy faces are preferred regardless of familiarity ? Sad faces are preferred only when familiar." Emotion 13(3): 391-396.
  20. Yamada, Y. and Kawabe, T. (2013). "Localizing non-retinotopically moving objects." PLoS One 8(1).
  21. Roseboom, W., Kawabe, T. and Nishida, S. (2013). "Direction of visual apparent motion driven by perceptual organisation in cross-modality signals." Journal of Vision 13(1)(6): 1-13.
  22. Hosokawa, K., Maruya, K. and Sato, T. (2013). "Temporal characteristics of depth perception from motion parallax." Journal of Vision 13(1)(16): 1-8.
  23. Edwards, M., Cassnello, R. C., Badcock, D. R. and Nishida, S. (2013). "Effect of form cues on 1D and 2D motion pooling." Vision Research 76: 94-104.
  24. Watanabe, J. (2013). "Pseudo-haptic Sensation Elicited by Background Visual Motion " ITE Tran. on Media Technology and Applications 1(2): 199-202.
  25. Watanabe, J. (2013). "Aesthetic Aspects of Technology-mediated Self-awareness Experiences." Proc. in Information and Communications Technology 6: 148-153.
  26. Furukawa, S., Washizawa, S., Ochi, A. and Kashino, M. (2013). "How independent are the pitch and the interaural-time-difference mechanisms that rely on temporal fine structure information?" Basic Aspects of Hearing:Advances in Experimental Medicine and Biology 787: 91-99.

Inquiry & Accsess