论文标题

带有潜在语义组件的深度无监督的散列

Deep Unsupervised Hashing with Latent Semantic Components

论文作者

Lin, Qinghong, Chen, Xiaojun, Zhang, Qin, Cai, Shaotian, Zhao, Wenzhe, Wang, Hongfa

论文摘要

在图像检索方面,对无监督的哈希(Hashhing)表示赞赏。但是,大多数先前的艺术未能检测到图像背后的语义成分及其关系,这使它们缺乏歧视力。为了弥补缺陷,我们提出了一种新颖的深层语义成分哈希(DSCH),涉及一种常识,即图像通常包含一堆具有同源性和共存在关系的语义成分。基于此之前,DSCH将语义组件视为在预期最大化框架下的潜在变量,并设计了两步迭代算法,目的是最大程度地训练数据。首先,DSCH通过发现具有高斯混合模式的图像的细颗粒语义成分(GMM)来构建语义组件结构,其中图像表示为多个组件的混合物,并利用语义共同出现。此外,通过考虑细粒组件之间的同源关系,然后构建了层次结构组织,从而发现了粗粒的语义组件。其次,DSCH使图像在细粒度和粗粒层的水平上都靠近其语义组件中心,还使图像相互共享相似的语义成分。在三个基准数据集上进行的广泛实验表明,所提出的分层语义成分确实促进了哈希模型以实现出色的性能。

Deep unsupervised hashing has been appreciated in the regime of image retrieval. However, most prior arts failed to detect the semantic components and their relationships behind the images, which makes them lack discriminative power. To make up the defect, we propose a novel Deep Semantic Components Hashing (DSCH), which involves a common sense that an image normally contains a bunch of semantic components with homology and co-occurrence relationships. Based on this prior, DSCH regards the semantic components as latent variables under the Expectation-Maximization framework and designs a two-step iterative algorithm with the objective of maximum likelihood of training data. Firstly, DSCH constructs a semantic component structure by uncovering the fine-grained semantics components of images with a Gaussian Mixture Modal~(GMM), where an image is represented as a mixture of multiple components, and the semantics co-occurrence are exploited. Besides, coarse-grained semantics components, are discovered by considering the homology relationships between fine-grained components, and the hierarchy organization is then constructed. Secondly, DSCH makes the images close to their semantic component centers at both fine-grained and coarse-grained levels, and also makes the images share similar semantic components close to each other. Extensive experiments on three benchmark datasets demonstrate that the proposed hierarchical semantic components indeed facilitate the hashing model to achieve superior performance.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源