论文标题

图像中有什么?可探索的压缩图像解码

What's in the Image? Explorable Decoding of Compressed Images

论文作者

Bahat, Yuval, Michaeli, Tomer

论文摘要

每天捕获的视觉内容不断增长,需要使用有损压缩方法,以节省存储空间和传输带宽。尽管广泛的研究工作致力于改善压缩技术,但每种方法都不可避免地会丢弃信息。尤其是在低比特速率下,此信息通常对应于语义上有意义的视觉提示,因此减压涉及明显的歧义。尽管如此,现有的解压缩算法通常仅产生一个输出,并且不允许观众探索将映射到给定压缩代码的图像集。在这项工作中,我们提出了第一种图像解压缩方法,以促进可能引起压缩输入代码的各种自然图像集的用户探索,从而使用户能够确定原始场景中可以和什么能够出现的内容。具体来说,我们为无处不在的JPEG标准开发了一种基于深网的新型解码器体系结构,该架构允许穿越与压缩JPEG文件一致的一组解压缩图像。为了允许简单的用户交互,我们开发了一个图形用户界面,其中包括几种直观的探索工具,包括用于检查特定感兴趣解决方案的自动工具。我们展示了我们在图形,医学和法医用例上的框架,展示了其广泛的潜在应用。

The ever-growing amounts of visual contents captured on a daily basis necessitate the use of lossy compression methods in order to save storage space and transmission bandwidth. While extensive research efforts are devoted to improving compression techniques, every method inevitably discards information. Especially at low bit rates, this information often corresponds to semantically meaningful visual cues, so that decompression involves significant ambiguity. In spite of this fact, existing decompression algorithms typically produce only a single output, and do not allow the viewer to explore the set of images that map to the given compressed code. In this work we propose the first image decompression method to facilitate user-exploration of the diverse set of natural images that could have given rise to the compressed input code, thus granting users the ability to determine what could and what could not have been there in the original scene. Specifically, we develop a novel deep-network based decoder architecture for the ubiquitous JPEG standard, which allows traversing the set of decompressed images that are consistent with the compressed JPEG file. To allow for simple user interaction, we develop a graphical user interface comprising several intuitive exploration tools, including an automatic tool for examining specific solutions of interest. We exemplify our framework on graphical, medical and forensic use cases, demonstrating its wide range of potential applications.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源