Exhibition Program 14
Science of Communication and Computation
Sharing enthusiasm between remote sites
Applause coding for bi-lateral immersive sharing
Live performances are increasingly appreciated using popular commercial audiovisual transmission systems, such as live viewing systems. We developed a reality enhancement method for the live viewing system that transmits applause sound which occurred at the viewing site to the live venue. We named it APRICOT (APplause for Realistic-Immersive COntents Transmission) system. This presentation shows an applause sounds detection, transmission, and generation system. At actual live viewing, the devised system successfully detected applause sounds by using real-time signal processing approach. Then, the sound level is converted into the meta-data, which is transmitted to live venue. At the live venue, natural applause sound is generated by using recorded hand-clapping sound seeds. This applause synthesizer is based on the hand-clapping model. The subjective experiments show that APRICOT system achieves more realistic live viewing services.
-  K. Kawahara, A. Fujimori, Y. Kamamoto, A. Omoto, T. Moriya, “Implementation and demonstration of applause and hand-clapping feedback system for live viewing,” in Proc. 141st Audio Engineering Society (AES) Convention, 2016.
 M. Nishikawa, K. Kawahara, Y. Kamamoto, A. Fujimori, A. Omoto, T. Moriya, “Extraction of applause from a sound field for ambient transmission in a live viewing system,” in Proc. IEEE Global Conference on Consumer Electronics (GCCE), 2017.