Emerging technologies for health and medicine_ virtual reality, augmented reality, artificial intelligence, internet of things, robotics, industry

Emerging Technologies for

Health and Medicine

Scrivener Publishing

100 Cummings Center, Suite 541J

Beverly, MA 01915-6106

Publishers at Scrivener

Martin Scrivener ([email protected])

Phillip Carmical ([email protected])

Emerging Technologies for

Health and Medicine

Dac-Nhuong Le

Deputy-Head, Faculty of Information Technology, Haiphong University,

Haiphong, Vietnam

Chung Van Le

CVS Center, Duy Tan University, Danang, Vietnam

Jolanda G. Tromp

University of New York in Oswego, NY, USA

Gia Nhu Nguyen

Dean, Graduate School, Duy Tan University, Danang, Vietnam

Virtual Reality, Augmented Reality,

Artifi cial Intelligence, Internet of

Th ings, Robotics, Industry 4.0

Th is edition fi rst published 2018 by John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, USA and

Scrivener Publishing LLC, 100 Cummings Center, Suite 541J, Beverly, MA 01915, USA

© 2018 Scrivener Publishing LLC

For more information about Scrivener publications please visit www.scrivenerpublishing.com.

All rights reserved No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in

any form or by any means, electronic, mechanical, photocopying, recording, or otherwise, except as permitted by

law Advice on how to obtain permission to reuse material from this title is available at http://www.wiley.com/go/

permissions.

Wiley Global Headquarters

111 River Street, Hoboken, NJ 07030, USA

For details of our global editorial offi ces, customer services, and more information about Wiley products visit us at www.

wiley.com.

Limit of Liability/Disclaimer of Warranty

While the publisher and authors have used their best eff orts in preparing this work, they make no representations

or warranties with respect to the accuracy or completeness of the contents of this work and specifi cally disclaim

all warranties, including without limitation any implied warranties of merchantability or fi tness for a particular

purpose No warranty may be created or extended by sales representatives, written sales materials, or promotional

statements for this work Th e fact that an organization, website, or product is referred to in this work as a citation

and/or potential source of further information does not mean that the publisher and authors endorse the informa￾tion or services the organization, website, or product may provide or recommendations it may make Th is work

is sold with the understanding that the publisher is not engaged in rendering professional services Th e advice

and strategies contained herein may not be suitable for your situation You should consult with a specialist where

appropriate Neither the publisher nor authors shall be liable for any loss of profi t or any other commercial dam￾ages, including but not limited to special, incidental, consequential, or other damages Further, readers should be

aware that websites listed in this work may have changed or disappeared between when this work was written and

when it is read.

Library of Congress Cataloging-in-Publication Data

ISBN 978-1-119-50981-3

Cover images: Provided by the author

Cover design by: Russell Richardson

Set in size of 11pt and Minion Pro by Exeter Premedia Services Private Ltd., Chennai, India

Printed in the USA

10 9 8 7 6 5 4 3 2 1

v

Contents

List of Figures xiii

List of Tables xix

Foreword xxi

Preface xxiii

Acknowledgments xxix

Acronyms xxxi

Part I Virtual Reality, Augmented Reality Technologies

and Applications for Health And Medicine

1 Reviews of the Implications of VR/AR Health Care Applications 3

Muhammad Sharif, Ghulam Jillani Ansari, Mussarat Yasmin,

Steven Lawrence Fernandes

1.1 Introduction 4

1.2 Virtual Reality and Augmented Reality 5

1.2.1 Virtual Realty 5

1.2.2 Augmented Reality or Mixed Reality 6

1.2.3 Line of Diff erence between VR/AR 6

1.2.4 Formats and Design Elements of VR/AR Technology 7

1.2.5 Presence, Reality and Realism 8

1.3 Features of VR/AR Technology in Health Care 9

1.3.1 Implications of VR/AR Technology in Health

Care Services and Applications 9

1.3.2 Health Care Services 9

1.3.3 Health Care Applications 11

1.4 Future Assessments in VR/AR Technology 14

1.5 Key Challenges for Adopting VR/AR Technology 14

1.6 Conclusion 15

References 15

vi Contents

2 Using 3D Simulation in Medical Education: A Comparative Test

of Teaching Anatomy using VR 21

Chung Van Le, J.G. Tromp, Vikram Puri

2.1 Introduction 22

2.2 Literature Review of Training with Medical VR 23

2.3 Methodology of this Study 24

2.4 Results 26

2.5 Discussion 29

References 30

3 Building Empathy in Young Children using

Augmented Reality: A Case Study in Malaysia 35

N.Zamin, F.A.Khairuddin, D.R.A.Rambli, E.N.M.Ibrahim,

M.S.A.Soobni

3.1 Introduction 36

3.2 Motivations 36

3.3 Literature Review 36

3.4 Proposed Approach 38

3.5 Results and Discussions 38

3.6 Conclusions 41

References 41

4 Eff ectiveness of Virtual Reality Mock Interview Training 43

J. Garcia, J. Tromp, H. Seaton

4.1 Introduction 44

4.2 Virtual Reality Training Literature Review 44

4.3 Methodology 45

4.3.1 Participants 45

4.3.2 Materials 46

4.3.3 Procedure 47

4.4 Results 47

4.5 Disscussion 48

4.6 Conclusions 49

References 50

5 Augmenting Dental Care: A Current Perspective 51

Anand Nayyar, Gia Nhu Nguyen

5.1 Introduction 52

5.1.1 Origin of Augmented Reality 52

5.1.2 History of Augmented Reality 53

5.2 Augmented Reality Technology in Medical Technology 53

5.3 Existing Technologies in Medical/Healthcare Technology 55

5.4 Augmenting Dental Care-AR Technologies assisting

Dentists for Dental Care 55

5.4.1 Augmented Reality Technologies in Oral

and Maxillofacial Surgery 56

Contents vii

5.4.2 Augmented Reality Technologies in

Dental Implant Surgery 58

5.4.3 Augmented Reality Technologies in

Orthognathic Surgery 59

5.4.4 Augmented Reality Apps in Dental Applications 61

5.5 Augmented Reality in Dental Education 61

5.6 Augmented Reality based Education Technologies for Dentistry 62

5.6.1 DentSim 62

5.6.2 Th e Virtual Dental Patient: System for

Virtual Teeth Drilling 63

5.6.3 Mobile AR Systems for Dental Morphology Learning 64

5.6.4 Periosim 64

5.7 Conclusion 65

References 65

6 Review of Virtual Reality Evaluation Methods and

Psychophysiological Measurement Tools 69

M.A. Munoz, J.G. Tromp, Cai Zhushun

6.1 Science Can Help Inform Virtual Reality Development 70

6.1.1 Objectives of Evaluations 71

6.1.2 Test Oft en and Test Early 73

6.1.3 Testing Options in the Early Pre-Prototype Phase 77

6.2 Virtual Reality Can Help Inform Psychology and Science 78

6.3 Types of Psychophysiological Measures and Tools 79

6.3.1 Electrodermal Activity 79

6.3.2 Cardiovascular activity 79

6.3.3 Muscular Activity: Facial Expressions 80

6.3.4 Electrical brain activity: Electroencephalography 81

6.4 Outcome of the Evaluation 82

6.5 Conclusions 83

References 83

Part II Artifi cial Intelligence Technologies and

Applications for Health and Medicine

7 AI Technologies for Mobile Health of Stroke Monitoring &

Rehabilitation Robotics Control 89

B.M. Elbagoury, M.B.H.B. Shalhoub, M.I. Roushdy,

Th omas Schrader

7.1 Introduction 90

7.2 Research Chapter Objectives 92

7.3 Literature Review 92

7.3.1 Pervasive Computing and Mobile Health Technologies 92

7.3.2 Rehabilitation Robotics for Stroke Patients 93

7.4 Description of the Research Telemedicine Platform 94

7.4.1 A State of the Art Telemedicine Robot

Rehabilitation System 94

viii Contents

7.4.2 Wireless telemedicine module with robot 96

7.4.3 Wireless intelligence sensor network extract

user’s biofeedback signal 96

7.5 A proposed intelligent adaptive behavior control to

rehabilitation robotics 96

7.6 Materials and Methods 98

7.7 Conclusion Summary: Artifi cial Intelligence Technologies 98

References 100

8 Artifi cial Intelligence for Smart Cancer Diagnosis 103

M.H.B. Shalhoub, Naif M. Hassan Bin Shalhoub,

Bassant M. Elbagoury, Abdel-Badeeh M. Salem

8.1 Introduction 104

8.2 Background and Related work 105

8.2.1 De-noising methods 105

8.2.2 Image Segmentation Overview 106

8.3 Proposed System Architecture 107

8.4 Telemedicine System Modules 109

8.4.1 Image Compression 109

8.4.2 Image Enhancement and Region of

Interest Segmentation 110

8.5 Results and discussion 113

8.6 Conclusion and Future Work 114

References 114

9 Mobile Doctor Brain AI App: Artifi cial Intelligence for

IoT Healthcare 117

Bassant M.Elbagoury, Ahmed A.Bakr, Mohamed Roushdy,

Th omas Schrader

9.1 Introduction 118

9.2 State of the Art 118

9.2.1 Mobile Doctor AI App for Stroke Emergency in

Haij Crowd 118

9.2.2 Proposed Architecture 119

9.3 Proposed System Design 120

9.3.1 AI Telemedicine Platform and Proposed

System Architecture 120

9.3.2 Wireless intelligence sensor network extract

user’s biofeedback signal 121

9.4 Proposed Artifi cial Intelligence Techniques for

New AI IoT Health-Care Solutions for Stroke Monitoring 122

9.4.1 Support vector machine (SVM) 122

9.4.2 Case-based Reasoning 125

9.4.3 Particle Swarm Intelligence and ARX Model

for Stroke Motion Estimation and Optimization 126

9.5 Conclusion 126

References 126

Contents ix

10 An Artifi cial Intelligence Mobile Cloud Computing Tool 129

M. Hassan Bin Shalhoub, Mohammed H. Bin Shalhoub,

Mariam Marzouq Al-Otaibi, Bassant M. Elbagoury

10.1 Introduction 130

10.2 Background and State-of-the-Art 130

10.3 Development and Proposing a New Intelligent case-based

Reasoning Decision Engine for Cacer Diagnosis 131

10.4 Experimental Results of Th e Proposed System 132

10.5 Conclusion 133

References 133

11 Advanced Intelligent Robot Control Interfaces for

Th e VR Simulation 137

Gal IonelAlexandru, Vladareanu Luige and Shuang Cang

11.1 Introduction 138

11.2 Proposed Mechanical Structure 138

11.3 Unit 3D Integration 139

11.4 Results 148

11.5 Conclusion 150

Acknowledgments 150

References 150

12 Analysis of Telemedicine Technologies 153

Vikram Puri, Jolanda G Tromp, Noell C.L. Leroy, Chung Le Van,

Nhu Gia Nguyen

12.1 Introduction 154

12.2 Literature Review 154

12.3 Architecture of Telemedicine Technologies 155

12.4 Enabling Technologies for Telemedicine 156

12.4.1 Telehealth for Congestive Heart Failure 156

12.4.2 Telemedicine for the Veterans 157

12.4.3 Tele-ICU (Intensive Care Unit) 157

12.4.4 Helping Patients Adhere to Medication Regimes 158

12.4.5 eReferral - reduces consultation time 158

12.5 Conclusion 159

References 159

Part III Robotics Technologies and Applications for

Health and Medicine

13 Critical Position using Environment Model Applied

on Walking Robots 165

M. Migdalovici, L. Vladareanu, N. Pop, H. Yu, M. Iliescu,

V. Vladareanu, D. Baran, G. Vladeanu

13.1 Introduction 166

13.2 On the Environment’s Mathematical Model 166

x Contents

13.3 Physical and Mathematical Models of Th e Walking Robot Leg 169

13.4 On Critical Positions of 3D Walking Robots 171

13.5 Mathematical model of beam without damping 173

13.6 Mathematical Model of Beam with Viscous Damping 175

13.7 Conclusion 175

References 176

14 Th e Walking Robot Equilibrium Recovery Applied on

Th e NAO Robot 179

N. Pop, L. Vladareanu, H.Wang, M. Ungureanu, M. Migdalovici,

V. Vladareanu, Y. Feng, M. Lin, E. P. Mastan and I. El Emary

14.1 Introduction 180

14.2 Th e Choice of the Model 180

14.3 Mathematical Modeling of Twolink Biped Walking Robot 181

14.4 Linear Control Design 182

14.4.1 Linear Quadratic Regulator 183

14.4.2 Numerical Results using MATLAB 184

14.5 Results and Discussion 187

14.6 Conclusions 188

References 188

15 Development of A Robotic Teaching Aid for

Disabled Children in Malaysia 191

N.Zamin, N.I. Arshad, N. Rafi ey and A.S. Hashim

15.1 Introduction 192

15.2 Case Study - Autism 192

15.3 Movitations 192

15.4 Proposed Approach 193

15.5 Results and Discussions 195

15.6 Robotic Intervention Enhance Autistic Students’

Engagement, Interaction and Focus 197

15.7 Conclusion 200

References 200

16 Training System Design of Lower Limb Rehabilitation

Robot based on Virtual Reality 203

H. Wang, M. Lin, Z. Jin, X. Wang, J. Niu, H. Yu, L. Zhang,

L. Vladareanu

16.1 Introduction 204

16.2 Application Device 204

16.2.1 Lower Limb Rehabilitation Robot 204

16.2.2 Necessary Sensor Element 205

16.3 Trajectory Planning and Smooth Motion 206

16.3.1 Design of Training Velocity and Acceleration

with Linear Path 206

Contents xi

16.3.2 Design of Training Velocity and Acceleration

with Circle Path 208

16.3.3 Design of Training Velocity and Acceleration with

Arbitrary Trajectory 209

16.3.4 Th e Analysis of Ambiguous Points 209

16.3.5 Th e Simulation of Training Velocity and Acceleration

in the Planning Trajectory 209

16.4 Virtual Reality Training System 212

16.4.1 Design of Intention Judgment of Patients 213

16.4.2 Design of Adapting Training Posture Function 215

16.4.3 Interaction Control Strategy 215

16.5 Virtual Reality Soft ware Design 216

16.5.1 Virtual Scene Build 216

16.5.2 Game Function Design 217

16.6 Virtual Reality Training Experiment 219

16.6.1 Model Synchronization Test 219

16.6.2 Feedback Terrains Test 219

16.7 Conclusion 220

Contributions 220

Acknowledgements 220

References 220

Part IV Internet of Th ings Technologies and

Applications for Health And Medicine

17 Automation of Appliances Using Electroencephalography 225

Shivam Kolhe, Dhaval Khemani, Chintan Bhatt,

and Nilesh Dubey

17.1 Introduction 226

17.2 Background, History and Future Aspects 226

17.3 Brain with Its Main Parts and Th eir Functions 227

17.3.1 Central Nervous System 228

17.3.2 Peripheral Nervous System 229

17.3.3 How are Th e Brain Signals Generated 230

17.3.4 What is Neuron Synapse? 232

17.4 Working of BCI 233

17.4.1 Types of Waves Generated and Detected by Brain 234

17.4.2 How to Perform Electroencephalogram 236

17.4.3 How to Take Measurements of the Head 237

17.4.4 How are EEG Signals Recorded 238

17.4.5 Methods to Display EEG on Screen 239

17.4.6 Eye Blink EEG Patterns 240

17.5 BCI Classes 241

17.5.1 Applications of BCI 242

17.5.2 Challenges BCI is facing 242

xii Contents

17.6 Conclusion 243

References 243

18 Designing a Beautiful Life for Indian Blind Peoples: A Smart Stick 245

Aatrey Vyas, Dhaval Bhimani, Smit Patel, Hardik Mandora,

Chintan Bhatt

18.1 Introduction 246

18.2 Internet of Th ings 246

18.3 Background 247

18.4 Purpose Approach 248

18.4.1 Ultrasonic Sensor 248

18.4.2 NodeMCU 249

18.4.3 Global positioning system (GPS) 249

18.4.4 Buzzer 250

18.4.5 Flow Diagram 251

18.5 Implementation 251

18.6 Advantages and Disadvantages 256

18.7 Conclusion 257

References 258

19 Smart Home: Personal Assistant And Baby Monitoring System 259

Shivam Kolhe, Sonia Nagpal, Priya Makwana, Chintan Bhatt

19.1 Introduction 260

19.2 Background 261

19.3 Proposed Design and Implementation 261

19.3.1 Smart Home Personal Assistant 262

19.3.2 Baby Monitoring System 265

19.4 Online Energy Meter 268

19.5 Sensors used and Th eir Working 269

19.5.1 Temperature Sensor 269

19.5.2 Soil Moisture Sensor 270

19.5.3 PIR (Passive InfraRed) Sensor 272

19.6 Conclusion 283

References 284

xiii

List of Figures

1.1 (a) Example of Virtual Reality [10], (b) Example of

Augmented Reality Training in Health care [4] 4

1.2 Relationship of Real and Virtual Environment

(Augmented Reality or Mixed Reality) [15] 5

1.3 Levels of VR Immersion (a) A Non Immersive VR System

(b) A Semi Immersive VR System (c) A Fully Immersive

VR System [10] 8

1.4 AR Systems Formats (a) Marked AR System.

(b) Mark less AR System [38] 8

1.5 Gadgets and Wearable Devices used in

Health Care Applications [37] 12

2.1 3D virtual reality simulation of human anatomy 22

2.2 Practicing in Virtual Reality 23

2.3 Design of the Study 24

2.4 Th ree teaching methods: A. Plastic models,

B. Real cadaver, C. Virtual Reality 26

2.5 Th e scores of the diff erent university students

(HPMU, DTU and BMTU) aft er the fi rst posttraining exam 27

2.6 Th e scores of the diff erent university students

(HPMU, DTU and BMTU) aft er the second posttraining exam 27

2.7 Th e scores of the diff erent university students (HPMU, DTU and

BMTU) grouped together per condition (Manikin, Cadaver, VR)

aft er the fi rst posttraining exam (Post test 1, yellow), and

the second posttraining exam (Post test 2, red) 28

2.8 Th e aggregated scores of all university students (HPMU, DTU

and BMTU) grouped together per condition

(Manikin, Cadaver, VR), with the fi rst posttraining

exam scores (Post test 1, orange), and the scores on the

second posttraining exam (Post test 2, green) 29

3.1 AR Market Predictions 37

3.2 An empathy scene 39

3.3 Th e response buttons 39

3.4 Among the Participants 39

3.5 Testing on Preschool Students 40

4.1 Oculus Rift Consumer Version 1 45

4.2 Example of two users communicating in a Virtual Reality space 46

xiv List of Figures

4.3 Image of Virtual Reality Interview Training Session 46

4.4 Participants response to measure 12 48

4.5 Participants responses to measure 13 48

5.1 Oral and Maxillofacial Surgery-Before and Aft er Results 56

5.2 3D Patient Skull Generation 57

5.3 Dental Implant Surgery via Screw fi tted on Jawbone 58

5.4 Orthognathic Surgery 60

5.5 Dental Simulation 62

5.6 DentSim Real Time Root Canal Treatment Simulation 63

6.1 Th e iterative process of VR Development 70

6.2 Usability and other potential acceptance criteria,

Nielsen’s Usability Diagram. 71

6.3 Th e process of empirical evaluation 72

6.4 Electrode Placement to recording Galvanic Skin Response 80

6.5 Electrode Placement to recording facial expressions with EMG 81

6.6 Th e development cycle, using Rapid prototype <> test cycles

by the Interaction Design Foundation 82

7.1 Intelligent Telemedicine Rehabilitation Robotic Architecture 95

7.2 Hierarchical Intelligent Behavior Control for Robot 95

7.3 Intelligent Behavior Control Algorithm 97

7.4 General process model for Telemedicine sensor data management 98

7.5 Mobile Patient Emergency for Stroke Patients to Nearest Hospital 99

7.6 Artifi cial Intelligence Technologies Components 100

8.1 Basic Service-Oriented Architecture 107

8.2 SOA Service Communication using WCF 107

8.3 SOA implemented as WCF process and services 108

8.4 Th e Proposed Telemedicine System Modules 109

8.5 Block Diagram of Image Compression Using Wavelet Technique 109

8.6 Two level wavelet decomposition 110

8.7 Image Enhancement and ROI segmentation fl owchart 110

8.8 Results of Image Enhancement and Region of

Interest Segmentation 111

8.9 Mammogram images while applying steps of Fuzzy C-Mean

algorithm steps. (a) Original image, (b) image with segmented

ROI aft er applying the morphological operators, (c) Th e resulted

image aft er clustering 113

9.1 Mobile Doctor Brain AI App 119

9.2 Research Area 1: AI for Raspberry pi - system on chip 120

9.3 Research Area 2: AI Real-time EMG Human Motion Analysis 120

9.4 General process model for Artifi cial Intelligence Telemedicine

sensor data management (Th ree Layers: Signal Processing,

Mobile Data Aggregation with AI Engine an Cloud

CBR Patients Expert system) 121

9.5 Patient Emergency Scenario for Stroke/Heart Attack Elderly and

Expert Doctor Recommendations 122

9.6 Architecture of support vector machine 123