|
|
|
A small microring array that performs large complex-valued matrix-vector multiplication |
Junwei Cheng1, Yuhe Zhao1, Wenkai Zhang1, Hailong Zhou1,2,3, Dongmei Huang3,4, Qing Zhu5, Yuhao Guo5, Bo Xu5, Jianji Dong1( ), Xinliang Zhang1 |
1. Wuhan National Laboratory for Optoelectronics, School of Optical and Electronic Information, Huazhong University of Science and Technology, Wuhan 430074, China
2. Photonics Research Centre, Department of Electronic and Information Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China
3. The Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen 518057, China
4. Photonics Research Centre, Department of Electrical Engineering, The Hong Kong Polytechnic University, Hong Kong 999077, China
5. Institute of Strategic Research, Huawei Technologies, Shenzhen 518129, China |
|
|
|
|
Abstract As an important computing operation, photonic matrix–vector multiplication is widely used in photonic neutral networks and signal processing. However, conventional incoherent matrix–vector multiplication focuses on real-valued operations, which cannot work well in complex-valued neural networks and discrete Fourier transform. In this paper, we propose a systematic solution to extend the matrix computation of microring arrays from the real-valued field to the complex-valued field, and from small-scale (i.e., 4 × 4) to large-scale matrix computation (i.e., 16 × 16). Combining matrix decomposition and matrix partition, our photonic complex matrix–vector multiplier chip can support arbitrary large-scale and complex-valued matrix computation. We further demonstrate Walsh-Hardmard transform, discrete cosine transform, discrete Fourier transform, and image convolutional processing. Our scheme provides a path towards breaking the limits of complex-valued computing accelerator in conventional incoherent optical architecture. More importantly, our results reveal that an integrated photonic platform is of huge potential for large-scale, complex-valued, artificial intelligence computing and signal processing.
|
| Keywords
Photonic matrix–vector multiplication
Complex-valued computing
Microring array
Signal/image processing
|
|
Corresponding Author(s):
Jianji Dong
|
|
Issue Date: 16 May 2022
|
|
| 1 |
W. Shi, , J. Caballero, , F. Huszar, , J. Totz, , A.P. Aitken, , R. Bishop, , D. Rueckert, , Z. Wang, : Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. Proc. CVPR 1874- 1883 (2016)
|
| 2 |
X. Li, , G. Zhang, , H.H. Huang, , Z. Wang, , W. Zheng, : Performance analysis of GPU-based convolutional neural networks. Proc. ICPP 67- 76 (2016)
|
| 3 |
H. Li, , Z. Lin, , X. Shen, , J. Brandt, , G. Hua, : A convolutional neural network cascade for face detection. Proc. CVPR 5325- 5334 (2015)
|
| 4 |
K.I. Kitayama, , M. Notomi, , M. Naruse, , K. Inoue, , S. Kawakami, , A. Uchida, : Novel frontier of photonics for data processing— photonic accelerator. APL Photonics 4 (9), 090901 (2019)
|
| 5 |
A. Krizhevsky, , I. Sutskever, , G.E. Hinton, : ImageNet classification with deep convolutional neural networks. Commun. ACM 60 (6), 84- 90 (2017)
|
| 6 |
Y. LeCun, , Y. Bengio, , G. Hinton, : Deep learning. Nature 521 (7553), 436- 444 (2015)
|
| 7 |
X. Xu, , M. Tan, , B. Corcoran, , J. Wu, , A. Boes, , T.G. Nguyen, , S.T. Chu, , B.E. Little, , D.G. Hicks, , R. Morandotti, , A. Mitchell, , D.J. Moss, : 11 TOPS photonic convolutional accelerator for optical neural networks. Nature 589 (7840), 44- 51 (2021)
|
| 8 |
C. Wu, , H. Yu, , S. Lee, , R. Peng, , I. Takeuchi, , M. Li, : Programmable phase-change metasurfaces on waveguides for multimode photonic convolutional neural network. Nat. Commun. 12 (1), 96 (2021)
|
| 9 |
J. Feldmann, , N. Youngblood, , M. Karpov, , H. Gehring, , X. Li, , M. Stappers, , M. Le Gallo, , X. Fu, , A. Lukashchuk, , A.S. Raja, , J. Liu, , C.D. Wright, , A. Sebastian, , T.J. Kippenberg, , W.H.P. Pernice, , H. Bhaskaran, : Parallel convolutional processing using an integrated photonic tensor core. Nature 589 (7840), 52- 58 (2021)
|
| 10 |
C. Ríos, , N. Youngblood, , Z. Cheng, , M. Le Gallo, , W.H.P. Pernice, , C.D. Wright, , A. Sebastian, , H. Bhaskaran, : In-memory computing on a photonic platform. Sci. Adv. 5 (2), 5759 (2019)
|
| 11 |
J. Feldmann, , N. Youngblood, , C.D. Wright, , H. Bhaskaran, , W.H.P. Pernice, : All-optical spiking neurosynaptic networks with self-learning capabilities. Nature 569 (7755), 208- 214 (2019)
|
| 12 |
X. Lin, , Y. Rivenson, , N.T. Yardimci, , M. Veli, , Y. Luo, , M. Jarrahi, , A. Ozcan, : All-optical machine learning using diffractive deep neural networks. Science 361 (6406), 1004- 1008 (2018)
|
| 13 |
T. Zhou, , X. Lin, , J. Wu, , Y. Chen, , H. Xie, , Y. Li, , J. Fan, , H. Wu, , L. Fang, , Q. Dai, : Large-scale neuromorphic optoelectronic computing with a reconfigurable diffractive processing unit. Nat. Photonics 15 (5), 367- 373 (2021)
|
| 14 |
W. Zhu, , L. Zhang, , Y. Lu, , P. Zhou, , L. Yang, : Design and experimental verification for optical module of optical vector-matrix multiplier. Appl. Opt. 52 (18), 4412- 4418 (2013)
|
| 15 |
S.F. Habiby, , S.A. Collins Jr, : Implementation of a fast digital optical matrix-vector multiplier using a holographic look-up table and residue arithmetic. Appl. Opt. 26 (21), 4639- 4652 (1987)
|
| 16 |
R.P. Bocker, , S.R. Clayton, , K. Bromley, : Electrooptical matrix multiplication using the twos complement arithmetic for improved accuracy. Appl. Opt. 22 (13), 2019 (1983)
|
| 17 |
J.W. Goodman, , A.R. Dias, , L.M. Woody, : Fully parallel, highspeed incoherent optical method for performing discrete Fourier transforms. Opt. Lett. 2 (1), 1- 3 (1978)
|
| 18 |
J. Hong, , P. Yeh, : Photorefractive parallel matrix-matrix multiplier. Opt. Lett. 16 (17), 1343- 1345 (1991)
|
| 19 |
S. Cartwright, : New optical matrix-vector multiplier. Appl. Opt. 23 (11), 1683- 1684 (1984)
|
| 20 |
R.A. Athale, , W.C. Collins, : Optical matrix-matrix multiplier based on outer product decomposition. Appl. Opt. 21 (12), 2089- 2090 (1982)
|
| 21 |
S. Mukhopadhyay, , D.N. Das, , P.P. Das, , P. Ghosh, : Implementation of all-optical digital matrix multiplication scheme with nonlinear material. Opt. Eng. (Redondo Beach, Calif.) 40 (9), 1998- 2002 (2001)
|
| 22 |
B. Liu, , L.R. Liu, , L. Shao, , H.Q. Chen, : Matrix-vector multiplication in a photorefractive crystal. Opt. Commun. 146 (1-6), 34- 38 (1998)
|
| 23 |
C. Gu, , S. Campbell, , P. Yeh, : Matrix-matrix multiplication by using grating degeneracy in photorefractive media. Opt. Lett. 18 (2), 146- 148 (1993)
|
| 24 |
T. Nitta, : Orthogonality of decision boundaries in complexvalued neural networks. Neural Comput. 16 (1), 73- 97 (2004)
|
| 25 |
H. Zhou, , Y. Zhao, , G. Xu, , X. Wang, , Z. Tan, , J. Dong, , X. Zhang, : Chip-scale optical matrix computation for pagerank algorithm. IEEE J. Sel. Top. Quantum Electron. 26 (2), 1- 10 (2020)
|
| 26 |
W. Bogaerts, , D. Pérez, , J. Capmany, , D.A.B. Miller, , J. Poon, , D. Englund, , F. Morichetti, , A. Melloni, : Programmable photonic circuits. Nature 586 (7828), 207- 216 (2020)
|
| 27 |
W.R. Clements, , P.C. Humphreys, , B.J. Metcalf, , W.S. Kolthammer, , I.A. Walsmley, : Optimal design for universal multiport interferometers. Optica 3 (12), 1460- 1465 (2016)
|
| 28 |
D.A.B. Miller, : Self-configuring universal linear optical component. Photonics Res. 1 (1), 1- 15 (2013)
|
| 29 |
P.L. Mennea, , W.R. Clements, , D.H. Smith, , J.C. Gates, , B.J. Metcalf, , R.H.S. Bannerman, , R. Burgwal, , J.J. Renema, , W.S. Kolthammer, , I.A. Walmsley, , P.G.R. Smith, : Modular linear optical circuits. Optica 5 (9), 1087- 1090 (2018)
|
| 30 |
J. Carolan, , C. Harrold, , C. Sparrow, , E. Martín-López, , N.J. Russell, , J.W. Silverstone, , P.J. Shadbolt, , N. Matsuda, , M. Oguma, , M. Itoh, , G.D. Marshall, , M.G. Thompson, , J.C.F. Matthews, , T. Hashimoto, , J.L. O’Brien, , A. Laing, : Universal linear optics. Science 349 (6249), 711- 716 (2015)
|
| 31 |
H. Zhou, , Y. Zhao, , X. Wang, , D. Gao, , J. Dong, , X. Zhang, : Self-configuring and reconfigurable silicon photonic signal processor. ACS Photonics 7 (3), 792- 799 (2020)
|
| 32 |
A. Annoni, , E. Guglielmi, , M. Carminati, , G. Ferrari, , M. Sampietro, , D.A.B. Miller, , A. Melloni, , F. Morichetti, : Unscrambling light-automatically undoing strong mixing between modes. Light Sci Appl. 6 (12), e17110 (2017)
|
| 33 |
H. Zhou, , Y. Zhao, , Y. Wei, , F. Li, , J. Dong, , X. Zhang, : Allin-one silicon photonic polarization processor. Nanophotonics 8 (12), 2257- 2267 (2019)
|
| 34 |
Y. Shen, , N.C. Harris, , S. Skirlo, , M. Prabhu, , T. Baehr-Jones, , M. Hochberg, , X. Sun, , S. Zhao, , H. Larochelle, , D. Englund, , M. Soljačić, : Deep learning with coherent nanophotonic circuits. Nat. Photonics 11 (7), 441- 446 (2017)
|
| 35 |
A.N. Tait, , T.F. de Lima, , E. Zhou, , A.X. Wu, , M.A. Nahmias, , B.J. Shastri, , P.R. Prucnal, : Neuromorphic photonic networks using silicon photonic weight banks. Sci. Rep. 7 (1), 7430 (2017)
|
| 36 |
L. Yang, , L. Zhang, , R. Ji, : On-chip optical matrix-vector multiplier. Optics and Photonics for Information Processing Vii (2013)
|
| 37 |
M. Miscuglio, , V.J. Sorger, : Photonic tensor cores for machine learning. Appl. Phys. Rev. 7 (3), 031404 (2020)
|
| 38 |
Y. Zhao, , X. Wang, , D. Gao, , J. Dong, , X. Zhang, : On-chip programmable pulse processor employing cascaded MZI-MRR structure. Front. Optoelectron. 12 (2), 148- 156 (2019)
|
| 39 |
A.B. Roy, , D. Dey, , B. Mohanty, , D. Banerjee, : Comparison of FFT, DCT, DWT, WHT compression techniques on electrocardiogram and photoplethysmography signals. IJCA Special Issue on International Conference on Computing, Communication and Sensor Network CCSN, 2012. 6- 11
|
| 40 |
S. Rahardja, , W. Ser, , Z.N. Lin, : UCHT-based complex sequences for asynchronous CDMA system. IEEE Trans. Commun. 51 (4), 618- 626 (2003)
|
| 41 |
A.D. Andrushia, , R. Thangarjan, : Saliency-based image compression using walsh-hadamard transform (WHT), pp. 21-42. Springer, Biologically rationalized computing techniques for image processing applications (2018)
|
| 42 |
G. Strang, : The discrete cosine transform. SIAM Rev. 41 (1), 135- 147 (1999)
|
| 43 |
A.V. Oppenheim , R. W. Schafer, , J. R. Buck, : Discrete-TimeSignal Processing. Norwood: Pearson Education India (1999)
|
|
Viewed |
|
|
|
Full text
|
|
|
|
|
Abstract
|
|
|
|
|
Cited |
|
|
|
|
| |
Shared |
|
|
|
|
| |
Discussed |
|
|
|
|
