Express Wavenet: A lower parameter optical neural network with random shift wavelet pattern

doi:10.1016/j.optcom.2020.126709

CIOMP OpenIR

	Express Wavenet: A lower parameter optical neural network with random shift wavelet pattern
	Y. Chen; N. Feng; B. Hong; M. S. Tong; G. P. Wang and Z. Liang
	2021
发表期刊	Optics Communications
ISSN	304018
卷号	485
摘要	Compared with other optical diffractive neural networks, the express wavenet (ExWave) is an improved and efficient network which adopts much fewer parameters. For advantages of the ExWave, firstly, the wavelet-like pattern is used to modulate the phase of optical waves; secondly, the number of parameters can be reduced from O(n2) to O(n), for the input image with n2 pixels; thirdly, the accuracy can be still high with only 1% of total parameters of the famous D2 NN. Besides, in the modified national institute of standards and technology (MNIST) dataset, 93.5% accuracy can be achieved with only 2457 parameters, nevertheless, 250880 parameters are required to meet a similar accuracy for the standard optical network. Moreover, the random shift wavelets exhibit characteristics of optical network vividly, especially for the vanishing gradient phenomenon in the training process. We present the modified expressway structure for solving this problem. Afterward, simulation have been carried out to validate effects of both random shift wavelet and expressway structure. Finally, it can be shown that the optical diffractive network in this work utilizes much fewer parameters than other neural networks. The detailed source code can be available in the following link: https://github.com/closest-git/ONNet. 2020 Elsevier B.V.
DOI	10.1016/j.optcom.2020.126709
URL	查看原文
收录类别	SCI ; EI
引用统计
文献类型	期刊论文
条目标识符	http://ir.ciomp.ac.cn/handle/181722/65236
专题	中国科学院长春光学精密机械与物理研究所
推荐引用方式 GB/T 7714	Y. Chen,N. Feng,B. Hong,et al. Express Wavenet: A lower parameter optical neural network with random shift wavelet pattern[J]. Optics Communications,2021,485.
APA	Y. Chen,N. Feng,B. Hong,M. S. Tong,&G. P. Wang and Z. Liang.(2021).Express Wavenet: A lower parameter optical neural network with random shift wavelet pattern.Optics Communications,485.
MLA	Y. Chen,et al."Express Wavenet: A lower parameter optical neural network with random shift wavelet pattern".Optics Communications 485(2021).

条目包含的文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
Express Wavenet_ A l（1589KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览请求全文