Kenta Niwa (Ph.D)

Learning and Intelligent Systems Research Group
Innovative Communication Laboratory
NTT Communication Science Laboratories


Contact Information:
kenta.niwa.bk (at) hco.ntt.co.jp
2-4 Hikaridai, Seika, Souraku,
Kyoto 619-0237, JAPAN

Research Interests

  • Genral machine learning topics
  • Optimization algorithms on asynchronous decentralized networks
  • Media signal processsing (e.g., acoustic microphone array)

Publication

Book

  1. Rohith Mars, Vaninirappuputhenpurayil Gopalan Reju, Andy W. H. Khong, Yusuke Hioka, Kenta Niwa, Beamforming Techniques Using Microphone Arrays, In Academic Press Library in Signal Processing, Academic Press, Volume 7, Chapter 12, pp. 585-612, 2018.
  2. Takanori Nishino, Motoki Ogasawara, Kenta Niwa, Kazuya Takeda, Selective Listening Point Audio Based on Blind Signal Separation and 3D Audio Effect, Principles And Applications Of Spatial Hearing, pp. 277-291, 2011

Journal Paper

  1. Ryotaro Sato, Kenta Niwa, and Kazunori Kobayashi, Ambisonic Signal Processing DNNs Guaranteeing Rotation, Scale and Time Translation Equivariance, IEEE/ACM Transactions on Audio, Speech, and Language Processing, 29, pp. 1449-1462, 2021.
  2. Kenta Niwa, Hironobu Chiba, Noboru Harada, Guoqiang Zhang, and W. Bastiaan Kleijn, Microphone Array Wiener Post Filtering Using Monotone Operator Splitting, IEEE/ACM Transactions on Audio, Speech, and Language Processing, 28, pp. 2036-2046, 2020.
  3. Kenta Niwa, Yusuke Hioka, and Kazunori Kobayashi, Microphone Array Source Enhancement Using Subtractive PSD Estimation Model, Applied Acoustics, 143, pp. 239-249, 2019.
  4. Takanori Nishino, Kento Imamura, Taishi Nakagiri, and Kenta Niwa, Development of A Cylindrical Omni-binaural Recording System for 360-degree Videos, Acoustical Science and Technology 39, 4, pp. 308-311, 2018.
  5. Yuma Koizumi, Kenta Niwa, Yusuke Hioka, Kazunori Kobayashi, and Yoichi Haneda, DNN-based Source Enhancement to Increase Objective Sound Quality Assessment Score, IEEE/ACM Transactions on Audio, Speech, and Language Processing, 26, 10, pp. 1780-1792, 2018.
  6. Kenta Niwa, Yusuke Hioka, and Hisashi Uematsu, Efficient Audio Rendering Using Angular Region-Wise Source Enhancement for 360° Video, IEEE Transactions on Multimedia, 20, 11, pp. 2871-2881, 2018.
  7. Kento Ohtani, Kenta Niwa, Takanori Nishino, and Kazuya Takeda, Music Source Enhancement Using a Convolutional Denoising Autoencoder and Log-frequency Scale Spectral Features, The Institute of Electronics, Information and Communication Engineer (IEICE) Transaction, J101-D, 10, pp. 615-627, 2018 (in Japanese).
  8. Kento Ohtani, Kenta Niwa, and Kazuya Takeda, A Single-Dimensional Interface for Arranging Multiple Audio Sources in Three-Dimensional Space, The Institute of Electronics, Information and Communication Engineer (IEICE) Transaction, E100-D, 10, pp. 2635-2643, 2017.
  9. Yusuke Hioka, Kenta Niwa, Estimating Power Spectral Density for Spatial Audio Signal Separation: An Effective Approach for Practical Applications, Acoustical Science and Technology, 38, 4, pp. 175-184, 2017.
  10. Tomoko Kawase, Kenta Niwa, Masakiyo Fujimoto, Kazunori Kobayashi, Shoko Araki and Tomohiro Nakatani, Integration of Spatial Cue-based Noise Reduction and Speech Model-based Source Restoration for Real Time Speech Enhancement, IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 100, 5, pp. 1127-1136, 2017.
  11. Tomoko Kawase, Kenta Niwa, Yusuke Hioka, Kazunori Kobayashi, Automatic Parameter Switching of Noise Reduction for Speech Recognition, Journal of Signal Processing, 21, 2, pp. 63-71, 2017.
  12. Yuma Koizumi, Kenta Niwa, Yusuke Hioka, Kazunori Kobayashi, and Hitoshi Ohmuro, Informative acoustic feature selection to maximize mutual information for collecting target sources. IEEE/ACM Transactions on Audio, Speech, and Language Processing, 25, 4, pp. 768-779, 2017.
  13. Kenta Niwa, Huge Microphone Array to Maximize Mutual Information Between Many Microphones and Sound Sources, The Journal of the Acoustical Society of America, 140, 4, pp. 3007-3007, 2016.
  14. Kenta Niwa, Yusuke Hioka, and Kazunori Kobayashi, Optimal Microphone Array Observation for Clear Recording of Distant Sound Sources, IEEE/ACM Transactions on Audio, Speech, and Language Processing, 24, 10, pp. 1785-1795, 2016.
  15. Yoichi Haneda, Ken'ichi Furuya, Shoichi Koyama, and Kenta Niwa, Close-talking Microphone Arrays Based on Spherical Harmonic Expansion, The Institute of Electronics, Information and Communication Engineer (IEICE) Transaction, J97-A, 4, pp. 263-273, 2014 (in Japanese).
  16. Kenta Niwa, Satoshi Esaki, Yusuke Hioka, Takanori Nishino, and Kazuya Takeda, An Estimation Method of Distance between Each Sound Source and Microphone Array Utilizing Eigenvalue Distribution of Spatial Correlation Matrix, The Institute of Electronics, Information and Communication Engineer (IEICE) Transaction on Fundamentals of Electronics, Communications and Computer Sciences, J97-A, 2, pp. 68-76, 2014 (in Japanese).
  17. Yoichi Haneda, ken'ichi Furuya, Shoichi Koyama, Kenta Niwa, and Kazunori Kobayashi, Sound Field Simulation for Circular Array Based on Spatial Circular Convolution, Acoustical Science and Technology, 35, 2, pp. 99-107, 2014.
  18. Kenta Niwa, Yusuke Hioka, Sumitaka Sakauchi, Ken'ichi Furuya, Yoichi Haneda, An Estimation Method of Sound Source Orientation Using Eigenspace Variation of Spatial Correlation Matrix, The Institute of Electronics, Information and Communication Engineers (IEICE) Transactions on Fundamentals of Electronics, Communications and Computer Sciences, 96, 9, pp. 1831-1839, 2013 (in Japanese).
  19. Kenta Niwa, Yusuke Hioka, Ken'ichi Furuya, and Yoichi Haneda, Diffused Sensing for Sharp Directive Beamforming, IEEE Transactions on Audio, Speech, and Language Processing, 21, 11, pp. 2346-2355, 2013.
  20. Kenta Niwa, Yusuke Hioka, Sumitaka Sakauchi, Ken'ichi Furuya, and Yoichi Haneda, Sharp Directive Beamforming Using Microphone Array and Planar Reflector, Acoustical Science and Technology, 34, 4, pp. 253-262, 2013.
  21. Yusuke Hioka, Ken'ichi Furuya, Kazunori Kobayashi, Kenta Niwa, and Yoichi Haneda, Underdetermined Sound Source Separation Using Power Spectrum Density Estimated by Combination of Directivity Gain, IEEE Transactions on Audio, Speech, and Language Processing, 21, 6, pp. 1240-1250, 2013.
  22. Yusuke Hioka, Kenta Niwa, Sumitaka Sakauchi, Ken'ichi Furuya, and Yoichi Haneda, Estimating Direct-to-reverberant Energy Ratio Using D/R Spatial Correlation Matrix Model, IEEE Transactions on Audio, Speech, and Language Processing, 19, 8, pp. 2374-2384, 2011.
  23. Kenta Niwa, Takanori Nishino, and Kazuya Takeda, Selective Listening Point Audio Based on Blind Signal Separation and Stereophonic Technology, The Institute of Electronics, Information and Communication Engineers (IEICE) Transactions on Information and Systems, 92, 3, pp. 469-476, 2009.
  24. Norishige Fukushima, Kenta Niwa, Tomohiro Yendo, Toshiaki Fujii, Masayuki Tanimoto, Takanori Nishino, and Kazuya Takeda, Free Viewpoint and Listening-Point Video Generation by Using Multi Viewpoint and Multi Listening-Point Data Capturing, The Institute of Electronics, Information and Communication Engineers (IEICE) Transactions on Information and Systems, 91, 8, pp. 2039-2041, 2008 (in Japanese).

Conference Paper

  1. Kenta Niwa, Guoqiang Zhang, W. Bastiaan Kleijn, Noboru Harada, Hiroshi Sawada, and Akinori Fujino, Asynchronous Decentralized Optimization with Implicit Stochastic Variance Reduction, In Proceedings of International Conference on Machine Learning (ICML 2021), pp. 8195-8204, 2021.
  2. Shoichiro Takeda, Kenta Niwa, and Shinya Shimizu, Asynchronous Decentralized Optimization with Implicit Stochastic Variance Reduction, In Proceedings of 28th European Signal Processing Conference (EUSIPCO 2020), pp. 296-300, 2021.
  3. Kenta Niwa, Noboru Harada, Guoqiang Zhang, and W. Bastiaan Kleijn, Edge-consensus Learning: Deep Learning on P2P Networks with Nonhomogeneous Data, In Proceedings of ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD 2020), pp. 668-678, 2020.
  4. Guoqiang Zhang, Kenta Niwa, and W. Bastiaan Kleijn, Projected Weight Regularization to Improve Neural Network Generalization, In Proceefing of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2020), pp. 4242-4246, 2020.
  5. Yusuke Hioka, Kei Kobayashi, and Kenta Niwa, Improving speech intelligibility using microphones on behind the ear hearing aids, In Proceeding of IEEE International Workshop on Multimedia Signal Processing (MMSP 2019) pp. 1-4, 2019.
  6. Kenta Niwa and Noboru Harada, Non-negative Matrix Factorization Using Bregman Monotone Operator Splitting, In Proceeding of International Conference on Acoustics, Speech and Signal Processing (ICASSP 2019), pp. 5531-5535, 2019.
  7. Ryotaro Sato, Kenta Niwa, and Noboru Harada, Function Designable Beamformer Based on Probabilistic Assumptions on Filter and Its Auxiliary Variables, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2019). pp. 780-784, 2019.
  8. Kenta Niwa, Guoqiang Zhang, and W. Bastiaan Kleijn, Fast Edge-consensus Computing Based on Bregman Monotone Operator Splitting, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2019), pp. 4609-4613, 2019.
  9. Kenta Niwa, Guoqiang Zhang, and W. Bastiaan Kleijn, Edge Consensus Computing for Heterogeneous Data Sets, In Proceeding of IEEE Statistical Signal Processing Workshop (SSP 2018), pp. 80-84, 2018.
  10. Manabu Tsukada, Keiko Ogawa, Masahiro Ikeda, Takuro Sone, Kenta Niwa, Shoichiro Saito, Takashi Kasuya, Hideki Sunahara, and Hiroshi Esaki, Software defined media: Virtualization of audio-visual services, In Proceeding of IEEE International Conference on Communications (ICC 2017), pp. 1-7. 2017.
  11. Kenta Niwa, Yuma Koizumi, Tomoko Kawase, Kazunori Kobayashi, and Yusuke Hioka, Supervised Source Enhancement Composed of Nonnegative Auto-encoders and Complementarity Subtraction, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2017), pp. 266-270, 2017.
  12. Yuma Koizumi, Kenta Niwa, Yusuke Hioka, Kazunori Kobayashi, and Yoichi Haneda, DNN-based source enhancement self-optimized by reinforcement learning using sound quality measurements, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2017), pp. 81-85, 2017.
  13. Kenta Niwa, Daisuke Ochi, Akio Kameda, Yutaka Kamamoto, Takehiro Moriya, Smartphone-Based 360° Video Streaming/Viewing System Including Acoustic Immersion, In Audio Engineering Society (AES) Convention 141, 2016.
  14. Masahiro Ikeda, Takuro Sone, Kenta Niwa, Shoichiro Saito, Manabu Tsukada, and Hiroshi Esaki, New recording application for software defined media, In Audio Engineering Society (AES) Convention 141, 2016.
  15. Tomoko Kawase, Kenta Niwa, Kazunori Kobayashi, and Yusuke Hioka, Application of Neural Network to Source PSD Estimation for Wiener Filter Based Array Sound Source Enhancement, In Proceeding of IEEE International Workshop on Acoustic Signal Enhancement (IWAENC 2016), pp. 1-5,. 2016.
  16. Kenta Niwa, Tomoko Kawase, Kauznori Kobayashi, and Yusuke Hioka, PSD estimation in Beamspace Using Property of M-matrix, In Proceeding of IEEE International Workshop on Acoustic Signal Enhancement (IWAENC 2016), pp. 1-5, 2016
  17. Tomoko Kawase, Kenta Niwa, Masakiyo Fujimoto, Noriyoshi Kamado, Kazunori Kobayashi, Shoko Araki, Tomohiro Nakatani, Real-time Integration of Statistical Model-based Speech Enhancement with Unsupervised Noise PSD Estimation Using Microphone Array, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2016), pp. 604-608, 2016.
  18. Kenta Niwa, Yuma Koizumi, Kazunori Kobayashi, and Hisashi Uematsu, Binaural Sound Generation Corresponding to Omnidirectional Video View Using Angular Region-Wise Source Enhancement, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2016), pp. 2852-2856, 2016.
  19. Kenta Niwa, Yuma Koizumi, Tomoko Kawase, Kazunori Kobayashi, and Yusuke Hioka, Pinpoint Extraction of Distant Sound Source Based on DNN Mapping From Multiple Beamforming Outputs to Prior SNR, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2016), pp. 435-439, 2016.
  20. Yuma Koizumi, Kenta Niwa, Yusuke Hioka, Kazunori Kobayashi, and Hitoshi Ohmuro, Integrated Approach of Feature Extraction and Sound Source Enhancement Based on Maximization of Mutual Information, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2016), pp. 186-190, 2016.
  21. Yusuke Hioka and Kenta Niwa, Estimating Direct-to-reverberant Ratio Mapped From Power Spectral Density Using Deep Neural Network, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2016), pp. 26-30, 2016.
  22. Tomoko Kawase, Kenta Niwa, Yusuke Hioka, and Kazunori Kobayashi, Selection of Optimal Array Noise Reduction Parameter Set for Accurate Speech Recognition in Various Noisy Environments, In Proceeding of Western Pacific Acoustics Conference, 2015.
  23. Tatsuya Kako, Kenta Niwa, Kazunori Kobayashi, and Hitoshi Ohmuro, Wiener Filter Design by Estimating Sensitivities Between Distributed Asynchronous Microphones and Sound Sources. In Proceeding of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA 2015), pp. 1-5, 2015.
  24. Yuma Koizumi, Kenta Niwa, Yusuke Hioka, Kazunori Kobayashi, and Hitoshi Ohmuro, Informative Acoustic Feature Selection on Microphone Array Wiener Filtering for Collecting Target Source on Sports Ground, In Proceeding of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA 2015), pp. 1-5, 2015.
  25. Daisuke Ochi, Kenta Niwa, Akio Kameda, Yutaka Kunita, and Akira Kojima, Dive Into Remote Events: Omnidirectional Video Streaming with Acoustic Immersion, In Proceedings of ACM International Conference on Multimedia, pp. 737-738, 2015.
  26. Kenta Niwa, Tatsuya Kako, and Kazunori Kobayashi, Microphone Array for Increasing Mutual Information Between Sound Sources and Observation Signals, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2015), pp. 534-538, 2015.
  27. Kenta Niwa, Yusuke Hioka, and Kazunori Kobayashi, Post-filter Design for Speech Enhancement in Various Noisy Environments, In Proceeding of International Workshop on Acoustic Signal Enhancement (IWAENC 2014), pp. 35-39, 2014.
  28. Yusuke Hioka and Kenta Niwa, PSD Estimation in Beamspace for Source Separation in A Diffuse Noise Field, In Proceeding of International Workshop on Acoustic Signal Enhancement (IWAENC 2014), pp. 85-88, 2014.
  29. Yoischi Haneda, Ken'ichi Furuya, Shoichi Koyama, and Kenta Niwa, Close-talking Spherical Microphone Array Using Sound Pressure Interpolation Based on Spherical Harmonic Expansion, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2014), pp. 604-608, 2014.
  30. Kenta Niwa, Yusuke Hioka, and Kazunori Kobayashi, Wave Intensity Estimation Over Broad Wavelengths Based on Diffused Sensing. In Proceeding of International Conference on Sensing Technology (ICST), pp. 256-261, 2013.
  31. Kenta Niwa, Yoichi Hioka, Kazunori Kobayashi, Ken'ichi Furuya, Yoichi Haneda, Evaluation of Microphone Array Based on Diffused Sensing with Various Filter Design Methods, In Proceeding of European Signal Processing Conference (EUSIPCO 2013), pp. 1-5, 2013.
  32. Yusuke Hioka, Ken'ichi Furuya, Kenta Niwa, and Yoichi Haneda, Estimation of Direct-to-reverberation Energy Ratio Based on Isotropic and Homogeneous Propagation Model, In Proceeding of International Workshop on Acoustic Signal Enhancement (IWAENC 2012), pp. 1-4, 2012.
  33. Kenta Niwa, Yusuke Hioka, Sumitaka Sakauchi, Ken'ichi Furuya, and Yoichi Haneda, Telescopic Microphone Array Using Reflector for Segregating Target Source From Noises in Same Direction, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2012), pp. 5457-5460, 2012.
  34. Kenta Niwa, Sumitaka Sakauchi, Ken'ichi Furuya, Manabu Okamoto, and Yoichi Haneda, Diffused Sensing for Sharp Directivity Microphone Array, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2012), pp. 225-228, 2012.
  35. Kenta Niwa, Sumitaka Sakauchi, Ken'ichi Furuya, Manabu Okamoto, and Yoichi Haneda, Superdirective Beamforming Using Microphone Array and Single Reflector, In Proceeding of IEEE International Conference on Consumer Electronics (ICCE 2012), pp. 17-18, 2012.
  36. Kenta Niwa, Yusuke Hioka, Sumitaka Sakauchi, Ken'ichi Furuya, and Yoichi Haneda, Estimation of Sound Source Orientation Using Eigenspace of Spatial Correlation Matrix, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2010), pp. 129-132, 2010.
  37. Yusuke Hioka, Kenta Niwa, Sumitaka Sakauchi, Ken'ichi Furuya, and Yoichi Haneda, Estimating Direct-to-reverberant Energy Ratio Based on Spatial Correlation Model Segregating Direct Sound and Reverberation, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2010), pp. 149-152, 2010.
  38. Mehrdad Panahpour Tehrani, Kenta Niwa, Norishige Fukushima, Yasushi Hirano, Toshiaki Fujii, Masayuki Tanimoto, Kazuya Takeda, Kenji Mase, Akio Ishikawa, Shigeyuki Sakazawa, and Atsushi Koike, 3DAV Integrated System Featuring Arbitrary Listening-point and Viewpoint Generation, In Proceeding of IEEE Workshop on Multimedia Signal Processing (MMSP 2008), pp. 855-860, 2008.
  39. Kenta Niwa, Takanori Nishino, and Kazuya Takeda, Encoding Large Array Signals Into A 3D Sound Field Representation for Selective Listening Point Audio Based on Blind Source Separation, In Proceeding of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2008), pp. 181-184, 2008.