Category Archives: About XR

Information about Virtual Reality, Augmented Reality and Mixed Reality.

Surgery and Laboratory Instruments Identification

Kristian Saari,  elaborated an application to help in the identification of surgery and laboratory instruments as the final thesis for the Degree Programme in Information Technology of Savonia University of Applied Sciences. The  work  was done for the FutureEdu project in collaboration with Savonian experts and degree supervisors.

The purpose of the thesis was to create an application for social and health care students that would allow them to identify surgical and laboratory instruments. The application should also offer a comprehensive database of these instruments. The output was to be executed as an Android application that works on both mobile phones and tablets.

The application was created by using the TensorFlow machine learning framework and the Teachable Machine platform that generates machine learning models. With the help of these two, an image recognition function was created, where an object can be identified by a real-time image. This function enabled the display of instrument information in the application. Other ready-made class libraries were also utilised to build a 2D code recognition for situations where making an image is not an option. A library was also created in the application that gives the user access to all the instruments that are found in the database without an identification feature.

The result was an Android application that works on both mobile phones and tablets. The application offers teachers a good and easy-to-use tool for their work that supports both the teaching and the learning of students. It is a workable first version of an application with the following three functions: image recognition, 2D code recognition and a library. The application is not yet directly ready for users, but it must first be tested and developed further insofar as needed.

For more details (in Finnish): Surgery and Laboratory Instruments Identification

VR Microscope

VR Microscope
Thesis for the Degree Program of Information Technology
Kimmo Pakarinen

The purpose of the thesis was to produce a virtual reality learning environment for learning the use of microscope and the parts of microscope. The subject and the goals for the thesis came from Future Technologies in Education project (FutureEdu).

The theoretical section of the thesis covered theoretical studying of microscope parts and using of microscope. Information was gathered from the Internet and interviewing the professionals in the field. The theoretical part also included practical learning with a real microscope.

The development section of the thesis covered a modification of the 3D model of the microscope, developing microscope operations to the 3D model of microscope, researching and developing environment guidelines, the user interface, implementing software to the
Virtual Reality environment and researching further development opportunities.

As a result of this thesis, 3D virtual reality software was developed for learning the parts and the usage of microscope. The first pilot of the software was planned for last autumn, but unfortunately piloting was rescheduled for fall 2020, due to COVID-19.

As piloting was rescheduled, this opened an opportunity to further develop the software. During this summer, a student from Savonia UAS did his internship in our project and developed the software further. All in all, the internship made it possible to produce even better software to be piloted this fall.
You can find this thesis from Theseus, the Open Repository of the Universities of Applied Sciences:

Conference Participation

FutureEdu team participated in the online-conference together with the project partner, Yatrus Foundation from Bulgaria to share and disseminated innovations in education.

11th International Conference Education, Research & Development
Bulgaria, 24th – 26th August, 2020

The conferences dealt with broad topics concerning e-learning, virtual innovations, internationalization and research in education.  Anssi Mähönen, project manager of FutureEdu project presented the two topics below:

Work Life Related Virtual Learning (XR) Environments for Biomedical Laboratory Science



Satellite Education Model -Work Oriented Professionals for HealthCare by a Distance Learning Method


Anssi Mähönen, Sirkka-Liisa Halimaa, Paola Kontro, Jaana Heiskanen, Tommi Kinnunen, Susanna Vuohelainen, Kimmo Pakarinen

Anssi Mähönen, Sirkka-Liisa Halimaa





Virtual Learning Environment in the FutureEdu project

Welcome to listen the discussion about the FutureEdu project coordinated by Savonia UAS, which develops virtual learning environments together with working life. The virtual learning environments are a clinical laboratory, an operating room and equipment maintenance room.  You can hear from our experts Anssi Mähönen, Sirkka-Liisa Halimaa, Susanna Vuohelainen and Tommi Kinnunen, from Savonia UAS and  Sakky’s expert Jaana Heiskanen.

In Finnish 

XR Technologies in Nursing Education

XR Technologies in Nursing Education

XR technologies and digitalization are changing the world. Different kinds of devices of XR technologies are beginning to be in consumer prices. Nowadays you can buy simple VR glasses by less than twenty euros. Of course, the best ones are more expensive and may cost thousands of euros. In the simplest way, those technologies are already in our mobile phones applications and features.

XR technologies are changing the health care and health care education too. Nursing shortage, which is a worldwide problem, can benefits a lot from the possibilities brought by XR technologies. This problem, together with the financial demands and decreasing practical training placement forces educators to find adequate teaching methods, that are more effective, attractive and present new ways of doing things.

In health care education, simulation pedagogy, learning practical, technical skills sessions are widely used before starting the on-the-job learning and clinical practice. Students gradually get more into practice, applying the knowledge to each situation and gathering more experience and new competencies and skills. When we think about the VR – content and application, what should we emphasize for an appropriate VR simulator? Of course, the usability, the right and authentic content are essential features. “The feeling of being there” is important. That means that the virtual environment becomes the dominant reality and the user has the feeling of having visited a place rather than just seeing images of it (Bracq et all 2019).

Other aspects to take into account are the technical and pedagogical features. Technical features include technological requirements, for example, possible bugs and gestures needed when using the scenario. Pedagogical features include the overall feedback from the scenario, the effective way the user can progress in the scenario and the guidance given to user during the scenario.

Virtual reality and other XR technologies can play an important role in the transition toward an authentic working environment in a cost-effective way. VR can be used to create different nursing simulations and scenarios, from wards to operating rooms and to practice wide selection of skills and tasks. These VR simulations and scenarios can be a part of a lesson, but also more and more self-learning tools. VR content is usable at any time and at any place, as long as the user has the required hardware and software. Of course, the guidance for the use is also needed.

Virtual and augmented reality in health care is being used, for example in therapies, in pain treatment, nursing and surgery. In our project, we are going to create a virtual environment for operating room, where VR technologies will be used. Here, I will have a look to three VR applications for nursing education currently found on the market.

Let us first start with the PeriopSim, which seem to be one of the most appropriate solution for our operating virtual environment. PeriopSim focus on surgical training and assessment for the operating team. It has been developed in close collaboration with surgeons, nurses, educators and neuroscientists. There are modules for surgery and for the instrumentation. Both modules are interactive and have several surgical procedures. There is also assessment and scoring in both modules. Briefly, users can practice and be assess on a procedure, on the anticipation of surgeon and sterile spheres, sharpness of safety, sterilization of technique, instrumentation and passing technique.

Our second option, the Oxford Medical Simulation, which does not provide scenarios for intraoperative nursing care at the moment, do have a very good feedback system in their application. What you do as a user, affects the scenario. User can have feedback about what went well and what to improve. The completion time of the scenario is also showed. The user can have analytics of the progress and skills performance. Teacher can see when students have been practicing and can see analytics for the group or individual student. One disadvantage is that user do not have to use hand devices, so the experience is not fully immersive VR.

UbiSim, our third option, claims to be the world’s first immersive VR training platform for nursing. Even though they are continually adding scenarios and environments, unfortunately, I did not found any new intraoperative nursing (that does not mean they do not have one). What is very good in UbiSim is that they have also debriefing after the session. You can visualize the whole recording session and reflect with self-guided questions. You can also review the personalized performance feedback and go through a quiz to assess your understanding.

Like mentioned in the beginning, XR technologies can be one remedy for nursing shortage. Virtual simulators are suitable for almost everybody. Based on a study done about training scrub nurses in the preparation of the instrumentation table, issues such as age, gender and experience had no effect on the evaluation of acceptability of the simulator (Bracq et all 2019).

Besides all the good in VR, there are also disadvantages in virtual reality. Several studies have pointed out, that user can suffer oculomotor fatigue, nausea and global simulator sickness. (Bracq et all 2019) I hope that this will be overcome as technology further develops. At the same time, we cannot go on only by technology ahead. Technology is not an answer for everything. Traditional learning methods are good too. This is particularly good to keep in mind, when considering that we have different learners and learning styles. We must also discuss and further study the effectiveness of the education with these technologies.

Bracq, M-S., Michinov, E., Arnaldi, B., Caillaud, B., Gibaud B., Gouranton, V., Jannin, P. (2019). Learning procedural skills with a virtual reality simulator: An acceptability study, Nurse Education Today 79 (2019, 153-160.
Oxford Medical Simulation (read 19.5.2020)
PeriopSim (read 19.5.2020)
UbiSim (read 19.5.2020)

Written by Jaana Heiskanen