Advances in Application of Augmented Reality Technology in Upper Limb Functional Rehabilitation Poststroke

doi:10.3969/j.issn.1673-5765.2021.03.005

Abstract

Abstract:

Augmented reality technology, as a new rehabilitation measure, is in its infancy in poststroke upper-limb functional rehabilitation. The key augmented reality technologies for upper limb impairment mainly include tracking registration technology, display technology and interactive technology. The principle of augmented reality technology for upper-limb functional rehabilitation includes: reshaping the normal left-right balance mode through training; promoting brain plasticity and functional rehabilitation through high-intensity, repeatable, task-oriented functional exercise. At present, the common augmented reality technologies for poststroke upper-limb functional rehabilitation include vision-based, tactile-based, mirror-based and mobile phone-based augmented reality systems. There are still many problems in the application of augmented reality technology in upper-limb functional rehabilitation after stroke, which need to be further studied and improved in the future.

Key words: Augmented reality; Stroke; Rehabilitation

摘要：

增强现实技术作为一项康复新技术，目前在卒中患者上肢功能康复中的应用处于萌芽阶段。应用于上肢的增强现实关键技术包括跟踪注册技术、显示技术和交互技术。增强现实技术对卒中上肢功能的康复原理主要包括：通过功能训练重塑正常的左右制衡模式；通过高强度、可重复、任务导向性的功能性运动促进卒中患者脑的可塑性和功能重组。目前常见应用于卒中患者上肢功能康复的增强现实技术包括基于视觉、基于触觉、基于镜像和基于手机的增强现实系统。增强现实技术在卒中患者上肢康复应用中还存在很多问题，有待进一步研究以不断完善。

关键词: 增强现实; 卒中; 康复

LI Chong, TIAN Shi-Liu, LIU Xiang-Yun, JIA Jie. Advances in Application of Augmented Reality Technology in Upper Limb Functional Rehabilitation Poststroke[J]. Chinese Journal of Stroke, 2021, 16(03): 240-245.

李冲，田石榴，刘向云，贾杰. 增强现实技术在卒中后上肢功能康复中的研究进展[J]. 中国卒中杂志, 2021, 16(03): 240-245.

References

[1] CAMPBELL B，KHATRI P. Stroke[J]. Lancet，2020，

396（10244）：129-142.

[2] WARD N S. Restoring brain function after stroke

- bridging the gap between animals and humans[J].

Nat Rev Neurol，2017，13（4）：244-255.

[3] NAKAYAMA H，JØRGENSEN H S，RAASCHOU

H O，et al. Recovery of upper extremity function

in stroke patients：the copenhagen stroke study[J].

Arch Phys Med Rehabil，1994，75（4）：394-398.

[4] KWAKKEL G，KOLLEN B J. Predicting activities

after stroke：what is clinically relevant?[J]. Int J

Stroke，2013，8（1）：25-32.

[5] SZCZEPA?SKA J，CIE?LIK B，RUTKOWSKI

S，et al. What can virtual reality offer to stroke

patients?a narrative review of the literature[J]. Neuro

Rehabilitation，2020，47（2）：109-120.

[6] LOA C，GUARINO P D，RICHARDS L G，et al.

Robot-assisted therapy for long-term upper-limb

impairment after stroke[J]. N Engl J Med，2010，362

（19）：1772-1783.

[7] BARSOM E Z，GRAAFLAND M，SCHIJVEN M P.

Systematic review on the effectiveness of augmented

reality applications in medical training[J]. Surg Endosc，2016，30（10）：4174-4183.

[8] AZUMA R，BAILLOT Y，BEHRINGER R，et

al. Recent advances in augmented reality[J]. IEEE

Computer Graphics and Applications，2001，21（6）：

34-47.

[9] SUTHERLAND I. The Ultimate Display[J]. IFIP，

1965，2（2）：506-508.

[10] MILGRAM P，KISHINO P. A taxonomy of mixed

reality visual displays[J/OL]. IEICE Transactions on

Information Systems，1994，E77-D（12）：1-15[2020-

12-11]. https：//www.semanticscholar.org/paper/

A-Taxonomy-of-Mixed-Reality-Visual-Displays-

Milgram-Kishino/f78a31be8874eda176a5244c64528

9be9f1d4317.

[11] WAGNER D，REITMAYR G，MULLONI A，et

al. Pose tracking from natural features on mobile

phones[J/OL]. ISMAR，2008：125-134[2020-12-11].

https：//ieeexplore.ieee.org/document/4637338.

[12] JIANG B L，NEUMANN U，YOU S. A robust

hybrid tracking system for outdoor augmented

reality[J/OL]. IEEE Virtual Reality，2004：

3-275[2020-12-11]. https：//doi.org/10.1109/

VR.2004.1310049.

[13] YOKOKOHJI Y，SUGAWARA Y，YOSHIKAWA

T. Accurate image overlay on video see-through

HMDs using vision and accelerometers[EB/OL].

200-05-22[2020-12-11]. https：//ieeexplore.ieee.org/

document/840505.

[14] STATE A，HIROTA G，CHEN D，et al. Superior

augmented reality registration by integrating

landmark tracking andmagnetic tracking[C].

SIGGRAPH '96，Los Angeles，1996[2020-12-11].

https：//doi.org/10.1145/237170.237282.

[15] RAKESH D. A study on wearable gestural

interface-a sixthsense technology[J/OL].

IOSR，2013，10：10-16[2020-12-11]. https：//doi.

org/10.1145/1667146.1667160.

[16] LEVOY M，HANRAHAN P. Light Field

Rendering[C]. SIGGRAPH '96，Los

Angeles，1996[2020-12-11]. https：//doi.

org/10.1145/237170.237199.

[17] 贾杰. 脑卒中后左右制衡机制及其对上肢手功能康

复的意义[J]. 中国康复理论与实践，2018，24（12）：

1365-1370.

[18] 朱镛连. 脑卒中康复与神经康复机制[J]. 中国康复理

论与实践，2003，9（3）：129-132.

[19] DEHEM S，LEJEUNE T，STOQUART G，et

al. Robotic-assisted serious game for motor and

cognitive post-stroke rehabilitation[J/OL]. ISMAR，

2017：1-8[2020-12-11]. https：//doi.org/10.1109/

SeGAH.2017.7939262.

[20] RIENER R，NEF T，COLOMBO G. Robot-aided

neurorehabilitation of the upper extremities[J]. Med

Biol Eng Comput，2005，43（1）：2-10.

[21] GORMAN C，GUSTAFSSON L. The use of

augmented reality for rehabilitation after stroke：a

narrative review[J/OL]. Disabil Rehabil Assist

Technol，2020：1-9[2020-12-11]. https：//doi.org/10.1

080/17483107.2020.1791264.

[22] 贾杰. “中枢-外周-中枢”闭环康复——脑卒中后

手功能康复新理念[J]. 中国康复医学杂志，2016，31

（11）：1180-1182.

[23] ALAMRI A，KIM H，EL SADDIK A. A decision

model of stroke patient rehabilitation with augmented

reality-based games[C]. International Conference on

Autonomous and Intelligent Systems，Wuhan，China，

2010. https：//doi.org/10.1109/AIS.2010.5547014.

[24] CORRÊA A G，FICHEMAN I，LOPES R，et al.

Augmented reality in occupacional Therapy[EB/OL].

2013-01-01[2020-12-11]. https：//ieeexplore.ieee.org/

xpl/conhome/6589039/proceeding.

[25] 刘佳，张晶晶，陈旭，等. 视触觉增强现实技术在

上肢康复中的研究进展[J]. 中国康复理论与实践，

2018，24（5）：544-548.

[26] MOUSAVI HONDORI H，KHADEMI M，

DODAKIAN L，et al. A spatial augmented reality

rehab system for post-stroke hand rehabilitation[J].

Stud Health Technol Inform，2013，184（5）：279-

285.

[27] COLOMER C，LLORENS R，NOÉ E，et al. Effect

of a mixed reality-based intervention on arm，hand，

and finger function on chronic stroke[J]. J Neuroeng

Rehabil，2016，13（1）：45.

[28] DA GAMA A E，CHAVES T M，FIGUEIREDO L

S，et al. Mirrarbilitation：a clinically-related gesture

recognition interactive tool for an AR rehabilitation

system[J]. Comput Methods Programs Biomed，2016，

135（3）：105-114.

[29] DA GAMA A，FALLAVOLLITA P，TEICHRIEB V，

et al. Motor rehabilitation using kinect：a systematic

review[J]. Games Health J，2015，4（2）：123-135.

[30] LUO X，KENYON R. V，KLINE T. An augmented

reality training environment for post-stroke

finger extension rehabilitation[EB/OL]. 2005-

07-01[2020-12-11]. https：//ieeexplore.ieee.org/

document/1501112.

[31] HOSSAIN M S，HARDY S，ALAMRI A，et al.

AR-based serious game framework for post-stroke

rehabilitation[J/OL]. Multimedia Systems，2016，

22：659-674[2020-12-11]. https：//doi.org/10.1007/

s00530-015-0481-6.

[32] ZHAO M Y，ONG S K，NEE A Y C. An augmented reality-assisted therapeutic healthcare system based

on bare-hand interaction[J]. Int J Hum Comput

Interact，2016，32（9）：708-721.

[33] TANG Y S，LIU S，DENG Y R，et al. Construction

of force haptic reappearance system based on

Geomagic Touch haptic device[J/OL]. Comput

Methods Programs Biomed，2020，190：105-

344[2020-12-11]. https：//doi.org/10.1016/

j.cmpb.2020.105344.

[34] TONG Q Q，YUAN Z Y，LIAO X Y，et al. Magnetic

levitation haptic augmentation for virtual tissue

stiffness perception[J]. IEEE Trans Vis Comput

Graph，2018，24（12）：3123-3136.

[35] ASSIS G A，CORRÊA A G，MARTINS M B，et al.

An augmented reality system for upper-limb poststroke

motor rehabilitation：a feasibility study[J].

Disabil Rehabil Assist Technol，2016，11（6）：521-

528.

[36] HOERMANN S，FERREIRA D S L，MORKISCH

N，et al. Computerised mirror therapy with

augmented reflection technology for early stroke

rehabilitation：clinical feasibility and integration as

an adjunct therapy[J]. Disabil Rehabil，2017，39（15）：

1503-1514.

[37] CORREA-AGUDELO E，FERRIN C，VELEZ

P，et al. Computer imagery and neurological

rehabilitation：on the use of augmented reality in

sensorimotor training to step ip naturally occurring

cortical reorganization in patients following stroke[J/

OL]. Stud Health Technol Inform，2016，220：71-

76[2020-12-11]. PMID：27046556. https：//ebooks.

iospress.nl/Extern/EnterMedLine.aspx?ISSN=0926-

9630&Volume=220&SPage=71.

[38] DECONINCK F J，SMORENBURG A R，

BENHAM A，et al. Reflections on mirror therapy：

a systematic review of the effect of mirror visual

feedback on the brain[J]. Neurorehabil Neural Repair，

2015，29（4）：349-361.

[39] LAPIANA N，DUONG A，LEE A，et al.

Acceptability of a mobile phone-based augmented

reality game for rehabilitation of patients with upper

limb deficits from stroke：case study[J/OL]. JMIR

Rehabil Assist Technol，2020，7（2）：e17822[2020-

12-11]. https：//doi.org/10.2196/17822.

[40] SONG X Y，DING L，ZHAO J C. Cellphone

augmented reality game-based rehabilitation for

improving motor function and mental state after

stroke[EB/OL]. 2019-05-22[2020-12-11]. https：//

ieeexplore.ieee.org/document/8771093.