Understanding multimedia content without seeing it

Spontaneous user behavior as regards handling, browsing and sharing multimedia content is closely related to the meaning of the content. For example, users of content curation services such as Pinterest manually collect image content from other users, and organize their own groups so that they can easily and quickly find the images they want. Therefore, most images in a group share the same meaning that the user has in mind. In this process, popular images are distributed from group to group, which constitutes a diffusion network. This implies that two groups sharing many images often share some specific meaning. Our method makes full use of this insight, thus enabling us to discover, describe and retrieve various kinds of meanings engraved in every multimedia content.

Please click the thumbnail image to open the full-size PDF file.