Colorful Image Colorization with Classification and Asymmetric Feature Fusion

doi:10.3390/s22208010

CIOMP OpenIR

	Colorful Image Colorization with Classification and Asymmetric Feature Fusion
	Z. Y. Wang; Y. Yu; D. Q. Li; Y. Y. Wan and M. Y. Li
	2022
发表期刊	Sensors
卷号	22 期号:20 页码:16
摘要	An automatic colorization algorithm can convert a grayscale image to a colorful image using regression loss functions or classification loss functions. However, the regression loss function leads to brown results, while the classification loss function leads to the problem of color overflow and the computation of the color categories and balance weights of the ground truth required for the weighted classification loss is too large. In this paper, we propose a new method to compute color categories and balance the weights of color images. In this paper, we propose a new method to compute color categories and balance weights of color images. Furthermore, we propose a U-Net-based colorization network. First, we propose a category conversion module and a category balance module to obtain the color categories and to balance weights, which dramatically reduces the training time. Second, we construct a classification subnetwork to constrain the colorization network with category loss, which improves the colorization accuracy and saturation. Finally, we introduce an asymmetric feature fusion (AFF) module to fuse the multiscale features, which effectively prevents color overflow and improves the colorization effect. The experiments show that our colorization network has peak signal-to-noise ratio (PSNR) and structure similarity index measure (SSIM) metrics of 25.8803 and 0.9368, respectively, for the ImageNet dataset. As compared with existing algorithms, our algorithm produces colorful images with vivid colors, no significant color overflow, and higher saturation.
DOI	10.3390/s22208010
URL	查看原文
收录类别	sci ; ei
语种	英语
引用统计
文献类型	期刊论文
条目标识符	http://ir.ciomp.ac.cn/handle/181722/66471
专题	中国科学院长春光学精密机械与物理研究所
推荐引用方式 GB/T 7714	Z. Y. Wang,Y. Yu,D. Q. Li,et al. Colorful Image Colorization with Classification and Asymmetric Feature Fusion[J]. Sensors,2022,22(20):16.
APA	Z. Y. Wang,Y. Yu,D. Q. Li,&Y. Y. Wan and M. Y. Li.(2022).Colorful Image Colorization with Classification and Asymmetric Feature Fusion.Sensors,22(20),16.
MLA	Z. Y. Wang,et al."Colorful Image Colorization with Classification and Asymmetric Feature Fusion".Sensors 22.20(2022):16.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
Colorful Image Color（21230KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览下载