Last update: 2024/5/13

Tomoyasu HORIKAWA's page

Tomoyasu Horikawa

RESEARCH INTERESTS

My research interests are primarily in the areas of neuroscience, and psychology. Specifically, I am interested in how the brain activity generates and represents contents of our subjective experiences. Currently, I use the brain decoding technique and computational models in computer vision to explore the neural substrates of our visual experiences, including perception, imagery, and dreaming. Through developing decoding techniques, I seek to better understand how the human brain represents and utilizes multiple levels of visual information to construct our subjective experiences.

Key words

fMRI, decoding, consciousness, imagery, deep neural networks, aphantasia

CONTACTS

NTT Communication Science Laboratories

3-1 Wakamiya, Morinosato, Atsugi, Kanagawa 243-0198, Japan

E-mail: horikawa.t[at]gmail.com

Researchmap

Google Scholar

LIST OF PUBLICATIONS

Journal papers

  1. Cheng, F.L., Horikawa, T., Majima. K., Tanaka, M., Abdelhack, M., Aoki, S.C., Hirano, J., Kamitani, Y. "Reconstructing visual illusory experiences from human brain activity." Sci. Adv. 9, 46 (2023). https://doi.org/10.1126/sciadv.adj3906 [web/preprint]
  2. Takahashi, J., Saito, G., Omura, K., Yasunaga, D., Sugimura, S., Sakamoto, S., Horikawa, T., Gyoba, J. "Diversity of aphantasia revealed by multiple assessments of visual imagery, multisensory imagery, and cognitive style." Front. Psychol. 14:1174873 (2023). https://doi.org/10.3389/fpsyg.2023.1174873 [web]
  3. Ho, J.K., Horikawa, T., Majima, K., Cheng, F., Kamitani, Y. "Inter-individual deep image reconstruction via hierarchical neural code conversion." Neuroimage 271, 120007 (2023). https://doi.org/10.1016/j.neuroimage.2023.120007 [web]
  4. Horikawa, T., Kamitani, Y. "Attention modulates neural representation to render reconstructions according to subjective appearance." Commun Biol 5, 34 (2022). https://doi.org/10.1038/s42003-021-02975-5 [web/preprint/code1/code2/raw data/preprocessed data]
  5. Alcaide, S., Sitt, J., Horikawa, T., Romano, A., Maldonado, A.C., Ibanez, A., Sigman, M., Kamitani, Y., & Barttfeld, P. "fMRI lag structure during waking up from early sleep stages" Cortex 142, 94-103 (2021). [web]
  6. Horikawa, T., Cowen, A.S., Keltner, D., & Kamitani, Y. "The neural representation of visually evoked emotion is high-dimensional, categorical, and distributed across transmodal brain regions" iScience 23, 101060. doi: https://doi.org/10.1016/j.isci.2020.101060 (2020) [web/preprint/code/raw data/preprocessed data]
  7. Hagihara H., Horikawa T., Irino Y., Nakamura H.K., Umemori J., Shoji H., Yoshida M., Kamitani Y., & Miyakawa T."Peripheral blood metabolome predicts mood change-related activity in mouse model of bipolar disorder" Molecular brain 12, 107 (2019) [web]
  8. Shen, G., Kshitij, D., Majima, K., Horikawa, T., & Kamitani, Y. "End-to-end deep image reconstruction from human brain activity" Front. Comput. Neurosci. 15, e1006633 (2019) [web/preprint/data]
  9. Horikawa, T., Aoki, S.C., Tsukamoto, M., & Kamitani, Y. "Characterization of deep neural network features by decodability from human brain activity" Scientific Data 6 (2019) [web/preprint/preprint/data]
  10. Shen, G., Horikawa, T., Majima, K., & Kamitani, Y. "Deep image reconstruction from human brain activity" Plos Comput. Biol. 15, e1006633 (2019) [web/preprint/code/data/video]
  11. Horikawa, T. & Kamitani, Y. "Generic decoding of seen and imagined objects using hierarchical visual features," Nat. Commun. 8, 15037 (2017). doi: 10.1038/ncomms15037 [web/code/data]
  12. Majima, K., Sukhanov, P., Horikawa, T. & Kamitani, Y. "Position Information Encoded by Population Activity in Hierarchical Visual Areas," Eneuro ENEURO.0268–16.2017 (2017). doi:10.1523/ENEURO.0268-16. 2017[web]
  13. Horikawa, T. & Kamitani, Y. "Hierarchical Neural Representation of Dreamed Objects Revealed by Brain Decoding with Deep Neural Network Features," Front. Comput. Neurosci. (2017). doi: 10.3389/fncom.2017.00004 [web]
  14. Hagihara, H., Horikawa, T., Nakamura, H.K., Umemori, J., Shoji, H., Kamitani, Y., & Miyakawa, T. "Circadian Gene Circuitry Predicts Hyperactive Behavior in a Mood Disorder Mouse Model," Cell Reports 14, 2784-2796 (2016)[web/pdf]
  15. Horikawa, T., Tamaki, M., Miyawaki, Y., & Kamitani, Y. "Neural decoding of visual imagery during sleep," Science 340, 639-642 (2013)[web/experiment movie/results movie]

Review papers

  1. Horikawa, T. & Kamitani, Y. "Brain decoding of dream contents: Toward the understanding of dream functions" Experimental Medicine. Yodosha, 33 (13), pp2077-2082, 2015 [in Japanese]
  2. Horikawa, T. & Majima, K. "Brain decoding," Cell technology. 34 (7), pp638-643, 2015 [in Japanese]
  3. Horikawa, T. "A naive question in neuroscience: Can we really read out dream contents?," Clinical neuroscience. 33 (1), pp117, 2015 [in Japanese]
  4. Horikawa, T. & Kamitani, Y. "Exploring dream contents by neuroimaging," Brain Nerve. 66 (4), pp461-469, 2014 [in Japanese]
  5. Horikawa, T., Miyawaki, Y. & Kamitani, Y. "Visualizing Mind from Human Brain Activity," Optical Review. The Optical Society of Japan, 43 (3), pp104-110, 2014 [in Japanese]
  6. Horikawa, T. & Kamitani, Y. "Recording and reading the information of brain: Non-invasive brain activity measurement and neural decoding," SOGO Rehabilitation. Igaku-Shoin, 38 (11), pp1025-1030, 2010 [in Japanese]

Preprint

  1. Horikawa, T. "Mind captioning: Evolving descriptive text of mental content from human brain activity" bioRxiv doi: 10.1101/2024.04.23.590673 (2024) [preprint]
  2. Takahashi, J., Saito, G., Omura, K., Yasunaga, D., Sugimura, S., Sakamoto, S., Horikawa, T. & Gyoba, J "Diversity of aphantasia revealed by multiple assessments of the capability for multi-sensory imagery" PsyArXiv doi: 10.31234/osf.io/pucsm (2022) [preprint]
  3. Ho, J.K., Horikawa, T., Majima, K. & Kamitani, Y. "Inter-individual deep image reconstruction" bioRxiv 474501 doi: https://doi.org/10.1101/2021.12.31.474501 (2022) [preprint/code]
  4. Horikawa, T. & Kamitani, Y. "Attentionally modulated subjective images reconstructed from brain activity" bioRxiv 424510 doi: https://doi.org/10.1101/2020.12.27.424510 (2020) [preprint/raw data]
  5. Horikawa, T., Cowen, A.S., Keltner, D., & Kamitani, Y. "The neural representation of emotion is high-dimensional, categorical, and distributed across transmodal brain regions" bioRxiv 872192 doi: https://doi.org/10.1101/872192 (2019) [preprint/code/raw data/preprocessed data]
  6. Horikawa, T., Aoki, S.C., Tsukamoto, M., & Kamitani, Y. "Characterization of deep neural network features by decodability from human brain activity" bioRxiv 424168 doi: https://doi.org/10.1101/424168 (2018) [web/data]
  7. Shen, G., Dwivedi, K., Majima, K., Horikawa, T., & Kamitani, Y. "End-to-end deep image reconstruction from human brain activity" bioRxiv 272518 doi: https://doi.org/10.1101272518 (2018)[web]
  8. Shen, G., Horikawa, T., Majima, K., & Kamitani, Y. "Deep image reconstruction from human brain activity" bioRxiv 240317 doi: https://doi.org/10.1101/240317 (2017)[web/code/data]
  9. Horikawa, T., & Kamitani, Y. "Hierarchical neural representation of dream contents revealed by brain decoding with deep neural network features" arXiv:1611.09520 (2016)[web]
  10. Majima, K., Sukhanov, P., Horikawa, T., & Kamitani, Y. "Preserved position information in high-level visual cortex with large receptive fields," bioRxiv 073940; doi: http://dx.doi.org/10.1101/073940 (2016)[web]
  11. Horikawa, T., & Kamitani, Y. "Generic decoding of seen and imagined objects using hierarchical visual features," arXiv:1510.06479 (2015) [web/code]

Conference

  1. Horikawa, T. "Mind captioning: evolving descriptive text of seen and imagined content from human brain activity" SfN2023, Washington D.C., USA (November, 2023)
  2. Cheng, F., Horikawa, T., Majima, K., & Kamitani, Y. "Reconstruction of line illusion from human brain activity" CCN2022, San Francisco, USA (August, 2022)
  3. Ho, J.K., Horikawa, T., Majima, K., & Kamitani, Y. "Inter-individual deep image reconstruction" Neuromatch conference, (December, 2021)
  4. Horikawa, T., & Kamitani, Y. "Attention biases neural representations of hierarchical visual features" CCN2019, Berlin, German (September, 2019)
  5. Horikawa, T., & Kamitani, Y. "Inter-individual deep image reconstruction" APCV2019, Osaka, Japan (July, 2019)
  6. Park, J.Y., Horikawa, T., Majima, K., & Kamitani, Y. "Brain decoding of sound-induced cortical activity with deep neural network features" KSCS 2018, Seoul Korea (June, 2018)
  7. Shen, G., Horikawa, T., Majima, K., & Kamitani, Y. "Deep image reconstruction from human brain activity" CCN2017, New York, USA (September, 2017)
  8. Horikawa, T., & Kamitani, Y. "Generic decoding of seen and imagined objects using features of deep neural networks," VSS2016, Florida, USA (May, 2016)
  9. Horikawa, T., & Kamitani, Y. "Generic decoding of seen and imagined objects using hierarchical visual features," Society for Neuroscience, Chicago, USA (October, 2015)
  10. Horikawa T, Hosokawa Y, & Kamitani Y. "Common brain activity patterns during perception, imagery, and dreaming," Society for Neuroscience, Washington D.C., USA (November, 2014)
  11. Hagihara H., Horikawa T, Nakamura H.K., Hirotaka S. Kamitani Y., & Miyakawa T. "Retrospective prediction of behavioral state by hippocampal transcriptomes," 29th CINP World Congress of Neuropsychoparmacology, Vancouver, Canada (June, 2014)
  12. Hosokawa Y., Horikawa T., & Kamitani Y. "Common brain activity patterns during perception, imagery, and dreaming," The 14th Winter Workshop on Mechanism of Brain and Mind, Hokkaido, Japan (January, 2014)
  13. Horikawa, T., Tamaki, M. Miyawaki, Y. & Kamitani, Y. "Neural decoding of visual dream contents," Neuro2013, Kyoto, Japan (June, 2013) [pdf]
  14. Umemori, J., Hagihara, H., Nakamura, H. K., Horikawa, T., Shoji, H., Toyama, K., Irino, Y., Yoshida, M., Kamitani, Y. & Miyakawa, T. "Behavioral state of model mice of bipolar disorder can be retrospectively predicted by gene expression in dentate gyrus and plasma metabolites," Society for Neuroscience, New Orleans, USA (October, 2012)
  15. Horikawa, T., Tamaki, M., Miyawaki, Y. & Kamitani, Y. "Decoding visual dream contents from the human brain," Society for Neuroscience, New Orleans, USA (October, 2012)
  16. Umemori, J., Hagihara, H., Nakamura, H. K., Horikawa, T., Shoji, H., Toyama, K., Irino, Y., Yoshida, M., Kamitani, Y. & Miyakawa, T. "Behavioral state of model mice of bipolar disorder can be retrospectively predicted by gene expression and metabolome patterns," Neuroscience2012, Aichi, Japan (September, 2012)
  17. Miyakawa, T., Nakamura, H. K., Horikawa, T., Shoji, H., Toyama, K., Hagihara, H.& Kamitani, Y. "Retrospective prediction of behavioral state by transcriptome pattern in the dentate gyrus," 10th Annual MCCS meeting, Washington, D.C., USA (November, 2011)
  18. Horikawa, T. & Kamitani, Y. "Decoding motion aftereffects from activity patterns in human visual cortex," Neuro2010, Tokyo, Japan (September, 2010)[web]

Invited talk

  1. Horikawa, T. "Neural representations of visually evoked emotional experiences" Qualia Structure Talk, Online (May, 2022).
  2. Horikawa, T. "Neural basis of the human mind deciphered by the artificial brain" 29th Brain Century Promotion Conference, Online (September, 2021).
  3. Horikawa, T. "Neural representations of visually evoked emotional experience" The symposium of 'Revealing relationships among cognitive functions, among emotions, and among concepts using neuroscience-based approaches', Japan (December, 2020).
  4. Horikawa, T. "Neural mechanisms underlying mental imagery: Brain decoding of mental images during imagery, dreaming, and attention" The 21st annual meeting of the Japanese Imagery Association, Japan (November, 2020)
  5. Horikawa, T. "Brain decoding of mental contents via deep neural network features" The 43th annual meeting of the Japan Neuroscience Society, Japan (July, 2020)
  6. Horikawa, T. “Neural representation of emotion”, Young Scientists Society for Brain Science, Seminar by Kansai Section, Japan (July, 2020)
  7. Horikawa, T. "Decoding of What’s Not There from Human Brain Activity" What's Not There. A Workshop of Hallucinations, Dreams, Imaginations, and Virtual Reality., Toronto, Canada (June 2019)
  8. Horikawa, T. "Decoding of seen and imagined contents from the human brain via deep neural network representation" JNNS2018, Okinawa, Japan (October 2018)
  9. Horikawa, T. "Mind reading via deep neural networks" SPM training course in Natioinal Institute for Physiological Science, Aichi, Japan (August, 2018)
  10. Horikawa, T. "Shared hierarchical neural representation for perception, imagery, and dreaming" NSF-NICT Collaborative Workshop on Computational Neuroscience, Osaka, Japan (January, 2017)
  11. Horikawa, T. "Brain decoding via deep neural network feature representation" Neuro2016, Chiba, Japan (July, 2016)
  12. Horikawa, T. "Brain decoding of visual dream contents," The 18th Congress of Japan Human Brain Mapping Society, Kyoto, Japan (January, 2016)
  13. Horikawa, T. "Brain decoding of visual dream contents," The 16th Winter workshop on Mechanism of Brain and Mind, Hokkaido, Japan (January, 2016)
  14. Horikawa, T. "Neural Decoding of Visual Dream Contents," 5th "Brain wear" workshop, Miyagi, Japan (December 2014)
  15. Horikawa, T. "Neural Information Decoding from Human Brain Activity," International Science Cafe "Brain-based technologies for the future", Osaka, Japan (November 2013)

Book

  1. Horikawa, T. & Kamitani, Y. "Visuzalization of dream contents," Chapter 14, in "SUIMIN KAGAKU". Ed. by Mishima, K. DOJIN BIOSCIENCE SERIES. (2016) Kagaku Dojin. [web]

Teaching experiences

  1. “Brain Inspired Artificial Intelligence”, Kyusyu Institute of Technology, Fukuoka, Japan (2020-).

Awards

  1. Distinguished poster award in the 4th CREST meeting. (2019)
  2. Best presentation award of Korean Society of Cognitive Science (2018)
  3. Tele-communication system technique awards 2017 (2018)
  4. Best paper award of Japanese Neural Network Society (2014)
  5. JNS-SfN Exchange Travel Award (2014)
  6. ATR encouragement award (2014)

Misc

  1. Horikawa, T. & Kamitani, Y. "Decoding visual dream contents from the human brain pattern," FIRST AUTHOR'S, 2013 [in Japanese]

BIOGRAPHY

Research Experience

2008-2013 Intern, Department of Neuroinfromatics (DNI), Computational Neuroscience laboratory, Advanced Telecommunications Research Institute International (ATR), Kyoto, Japan

2010-2013 Research assistant, Computational Neuroscience laboratory & Mathematical Informatics laboratory, Graduate school of information science, Nara Institute of Science and Technology (NAIST), Nara, Japan

2014-2016 Researcher Department of Neuroinfromatics (DNI), Computational Neuroscience laboratory, Advanced Telecommunications Research Institute International (ATR), Kyoto, Japan

2016- Senior Researcher Department of Neuroinfromatics (DNI), Computational Neuroscience laboratory, Advanced Telecommunications Research Institute International (ATR), Kyoto, Japan

Education

2004-2008 Toyoda-laboratory, School of Letters, Arts and Sciences I, Waseda University, Tokyo, Japan

2008-2013 Computational Neuroscience laboratory & Mathematical Informatics laboratory, Graduate school of information science, Nara Institute of Science and Technology (NAIST), Nara, Japan

Thesis & dissertation

2008 Bachelor of Art in Psychology

Thesis: "Comparison of various discriminant analyses for car auction data"; School of Letters, Arts and Sciences I, Waseda University; Supervisor: Prof. Hideki Toyoda

2010 Master of Science

Thesis: "Decoding perceptions of motion aftereffect by brain activity pattern analysis in the human visual cortex"; Graduate school of information science, NARA Institute of Science and Technology; Supervisor: Yukiyasu Kamitani

2013 Doctor of Science

Thesis: "Neural Decoding of Visual Dream Contents"; Graduate school of information science, NARA Institute of Science and Technology; Supervisor: Yukiyasu Kamitani

RESEARCH FUNDS

FY2021 - FY2023

Grant-in-Aid for Scientific Research (B)

Ministry of Education, Culture, Sports, Science and Technology (MEXT)

Principal Investigator: Junichi Takahashi

FY2020 - FY2023

Grant-in-Aid for Scientific Research (B)

Ministry of Education, Culture, Sports, Science and Technology (MEXT)

Principal Investigator: Tomoyasu Horikawa

FY2019

Tateishi grant A

Tateishi

Principal Investigator: Tomoyasu Horikawa

FY2018 - FY2022

Sakigake

JST

Principal Investigator: Tomoyasu Horikawa

FY2017 - FY2019

Grant-in-Aid for Young Scientists (B)

Ministry of Education, Culture, Sports, Science and Technology (MEXT)

Principal Investigator: Tomoyasu Horikawa

FY2014 - FY2016

Grant-in-Aid for Young Scientists (B)

Ministry of Education, Culture, Sports, Science and Technology (MEXT)

Principal Investigator: Tomoyasu Horikawa

MEMBERSHIP OF ACADEMIC SOCIETY

The Japan Neuroscience Society

Society for Neuroscience