Retinal projection head-mounted display

doi:10.1007/s12200-016-0662-8

Front. Optoelectron.

2017, Vol. 10

Issue (1) : 1-8 https://doi.org/10.1007/s12200-016-0662-8

REVIEW ARTICLE

Retinal projection head-mounted display

Junguo LIN, Dewen CHENG(

), Cheng YAO, Yongtian WANG

Beijing Engineering Research Center of Mixed Reality and Advanced Display, School of Optoelectronics, Beijing Institute of Technology, Beijing 100081, China

Download: PDF(2013 KB) HTML
Export: BibTeX | EndNote | Reference Manager | ProCite | RefWorks

Abstract

Retinal projection displays (RPDs) are an important development direction for head-mounted displays (HMDs). This paper reviews the literature on optical engineering aspects based on the data on advanced technology in RPD design and development. The review includes the principles and applications of four theories, e.g., the Maxwellian view and its modified modality and the monocular and binocular depth cues of stereoscopic objects in the physiology of the human visual system. To support the Maxwellian view and achieve retinal projection systems with depth cues, results of previous design works were summarized using different methods and their advantages and disadvantages are analyzed. With an extremely long focal depth, a prototype of a full-color stereoscopic see-through RPD system was discussed. Finally, a brief outlook of the future development trends and applications of the RPDs was presented

Keywords retinal projection display (RPD) Maxwellian view depth cues stereoscopic see-through

Corresponding Author(s): Dewen CHENG

Just Accepted Date: 14 November 2016 Online First Date: 29 November 2016 Issue Date: 17 March 2017

Cite this article:

Junguo LIN,Dewen CHENG,Cheng YAO, et al. Retinal projection head-mounted display[J]. Front. Optoelectron., 2017, 10(1): 1-8.

URL:

https://academic.hep.com.cn/foe/EN/10.1007/s12200-016-0662-8
https://academic.hep.com.cn/foe/EN/Y2017/V10/I1/1

Fig.1 Principle of the Maxwellian view

Fig.2 Normal viewing of HMD

Fig.3 (a) Dissociation between real and virtual objects [23]; (b) integration of real and virtual objects

Fig.4 Principle of the modified Maxwellian view. (a) Side view; (b) top view [23]

Fig.5 Process of obtaining thin light beams. (a) Pinhole image; (b) laser image [16]

Fig.6 Optical path of the RPD using a half-mirror [25]

Fig.7 Specification of the HOE [27]

Fig.8 Compact optics of the RPD constituted by a free-surface reflection mirror [16]

Fig.9 Schematic of accommodation [22]

Fig.10 (a) Structure of the HOE; (b) schematic of the multi-view system [29]

Fig.11 Schematic of the binocular parallax [22]

Fig.12 Stereogram of the side-by-side format

Fig.13 Universal design optical structure of the RPD

Fig.14 Schematic of the binocular stereoscopic RPD

Fig.15 Experimental symmetric prototype

Fig.16 Image by the Maxwellian view. Focuses on (a) nearby and (b) distant

1	P A Rauschnabel, A Brem, Y Ro. Augmented reality smart glasses: definition, conceptual insights, and managerial importance. Working paper, The University of Michigan-Dearborn, 2015
2	B Kress. The segmentation of the HMD market: optics for smart glasses, smart eyewear, AR and VR headsets. In: Proceedings of SPIE-The International Society for Optical Engineering, 2014, 9202: 92020D-1–92020D-14
3	B T Schowengerdt, E J Seibel, T A Furness. Binocular retinal scanning laser display with integrated focus cues for ocular accommodation. In: Proceedings of SPIE-The International Society for Optical Engineering, 2003, 5006: 1–9
4	O Cakmakci, J Rolland. Head-worn displays: a review. Journal of Display Technology, 2006, 2(3): 199–216 https://doi.org/10.1109/JDT.2006.879846
5	G C D Wit. A retinal scanning display for virtual reality. Dissertation for the Doctoral Degree. TU Delft: Delft University of Technology, 1997
6	U Hakan. Optical advantages of retinal scanning displays. In: Proceedings of SPIE-The International Society for Optical Engineering, 2000, 4021: 20–26
7	R H Webb, G W Hughes, O Pomerantzeff. Flying spot TV ophthalmoscope. Applied Optics, 1980, 19(17): 2991–2997 https://doi.org/10.1364/AO.19.002991 pmid: 20234539
8	R H Webb, G W Hughes, F C Delori. Confocal scanning laser ophthalmoscope. Applied Optics, 1987, 26(8): 1492–1499 https://doi.org/10.1364/AO.26.001492 pmid: 20454349
9	A Ellingford. The Rodenstock scanning laser ophthalmoscope in clinical practice. Journal of Audiovisual Media in Medicine, 1994, 17(2): 67–70 https://doi.org/10.3109/17453059409063659 pmid: 8034907
10	M Varano, C Scassa. Scanning laser ophthalmoscope microperimetry. Seminars in Ophthalmology, 1998, 13(4): 203–209 https://doi.org/10.3109/08820539809056054 pmid: 9878671
11	K Yoshinaka. Display Device, Japanese Patent: 61198892. 1986–09–03
12	X Hu, Y Liu, J Wang, B Liu. Current progress in head-mounted display based on retinal scanning. Hongwai Yu Jiguang Gongcheng, 2014, 43(3): 871–878 (in Chinese)
13	R J Jacobs, I L Bailey, M A Bullimore. Artificial pupils and Maxwellian view. Applied Optics, 1992, 31(19): 3668–3677 https://doi.org/10.1364/AO.31.003668 pmid: 20725339
14	J Kollin. A retinal display for virtual-environment applications. SID International Symposium Digest of Technical Papers, 1993, 24: 827–827
15	J S Kollin, M R Tidwell. Optical engineering challenges of the virtual retinal display. In: Proceedings of SPIE-The International Society for Optical Engineering, 1995, 2537: 48–60
16	M Sugawara, M Suzuki, N Miyauchi. Late-News Paper: Retinal imaging laser eyewear with focus-free and augmented reality. Sid Symposium Digest of Technical Papers, 2016, 47(1): 164–167
17	W O Davis, D Brown, Y Ma, J W Coy. Evolution of MEMS scanning mirrors for laser projection in compact consumer electronics. International Society for Optics and Photonics, 2010, 7594(5): 75940A-1–75940A-12
18	M Watanabe, H Takayama, N Asai, R Matsuda, S Yamada. A retinal scanning display with a wavefront curvature modulator. Journal of the Society for Information Display, 2003, 11(3): 511–515 https://doi.org/10.1889/1.1821288
19
20	Wearable see-through display “Laser Eyewear” developed based on original laser retina imaging optics,
21
22	J Jia. Fast algorithm for CGH calculation and system design for holographic 3D display. Dissertation for the Doctoral Degree. Beijing: Beijing Institute of Technology, 2013
23	H Takahashi. Stereoscopic see-through retinal projection head-mounted display. In: Proceedings of SPIE-The International Society for Optical Engineering, 2008, 6803: 68031N-1–68031N-8
24	Z Yang, Z Guo, Z Yang. Design of retinal projection display system. Journal of Applied Optics, 2011, 32(2): 222–225
25	M Yang, Z Guo, Z Yang. Helmet-mounted displays based on retinal projection display. Journal of Applied Optics, 2012, 33(2): 370–373
26	T Ando, K Yamasaki, M Okamoto, T Matsumoto, E Shimizu. Evaluation of HOE for head-mounted display. SPIE Proceedings, Practical Holography XIII, 1999, 3637: 110–118 https://doi.org/10.1117/12.343762
27	T Ando, K Yamasaki, M Okamoto, T Matsumoto, E Shimizu. Retinal projection display using holographic optical element. SPIE Proceedings, Practical Holography XIV and Holographic Materials VI, 2000, 3956: 211–216 https://doi.org/10.1117/12.379998
28	Y Takatsuka, H Yabu, K Yoshimoto, H Takahashi. Retinal projection display using diffractive optical element. In: Proceedings of Intelligent Information Hiding and Multimedia Signal, 2014: 403–406
29	H Takahashi, Y Ito, S Nakata, K Yamada. Retinal projection type super multi-view head-mounted display. Society of Photo-Optical Instrumentation Engineers (SPIE), Conference Series, 2014, 9012: 90120L-1–90120L-6
30	M M Bayer. Retinal scanning display: a novel HMD approach for army aviation. In: Proceedings of SPIE-The International Society for Optical Engineering, 2002, 4711: 202–213
31	S C McQuaide, E J Seibel, R Burstein, T A III Furness. 50.4: Three-dimensional virtual retinal display system using a deformable membrane mirror. SID Symposium Digest of Technical Papers, 2002, 33(1): 1324–1327
32	S C McQuaide, E J Seibel, J P Kelly, B T Schowengerdt, T A Furness III. A retinal scanning display system that produces multiple focal planes with a deformable membrane mirror. Displays, 2003, 24(2): 65–72 https://doi.org/10.1016/S0141-9382(03)00016-7
33	G Westheimer. The Maxwellian view. Vision Research, 1966, 6(11–12): 669–682 https://doi.org/10.1016/0042-6989(66)90078-2 pmid: 6003389
34	J C Maxwell, Q Zaidi. On the theory of compound colours, and the relations of the colours of the spectrum. Color Research and Application, 1993, 18(4): 270–287 https://doi.org/10.1002/col.5080180411
35	E Viirre, R Johnston, H Pryor, S Nagata, T A Furness 3rd. Laser safety analysis of a retinal scanning display system. Journal of Laser Applications, 1997, 9(5): 253–260 https://doi.org/10.2351/1.4745467 pmid: 10174266
36	H Urey, F A DeWitt IV, P A Lopez, J Tauscher. MEMS raster correction scanner for SXGA resolution retinal scanning display. SPIE Proceedings, 2003, 4985: 106–114

Viewed

Full text

Abstract

Cited

Shared

Discussed