A variety of sounds are constantly emitted from the human body as a result of life activities. By listening to and analyzing those sounds, we can obtain useful information about the function and condition of the body, which is called auscultation. In this research, we are focusing on heart sounds to estimate the function and condition of the heart and blood vessels based on the observation of acoustic signals. In our system, multiple microphones are attached to several places, such as the chest, to detect heart activity. Based on the captured sound, it estimates the degree of normality as a score and generates an explanatory statement as a sentence. We have confirmed that the normality estimation and description generation with a specified degree of detail work effectively for test data. We aim to realize an "AI stethoscope" that contributes to the prevention and early detection of diseases in many people, as skilled doctors can accurately understand and explain the condition through auscultation.
/ Media Information Laboratory and Biomedical Informatics Research Center