eISSN: 2299-0054
ISSN: 1895-4588
Videosurgery and Other Miniinvasive Techniques
Current issue Archive Videoforum Manuscripts accepted About the journal Supplements Editorial board Journal's reviewers Abstracting and indexing Subscription Contact Instructions for authors Ethical standards and procedures
SCImago Journal & Country Rank

vol. 15
Original paper

The impact of tiredness on virtual reality robotic surgical skills

Alin Adrian Cumpanas
Razvan Bardan
Ovidiu Ferician
Silviu Constantin Latcu
Octavian Fulger Lazar
Ciprian Duta

Department of Urology, Victor Babes University of Medicine and Pharmacy, Timisoara, Romania
2nd Department of Surgery, Victor Babes University of Medicine and Pharmacy, Timisoara, Romania
Videosurgery Miniinv 2020; 15 (2): 298–304
Online publish date: 2020/02/24
Article file
- The impact.pdf  [0.08 MB]
Get citation
JabRef, Mendeley
Papers, Reference Manager, RefWorks, Zotero


Robotic surgery is a fast-growing field, continuously replacing open and laparoscopic procedures in all surgical specialties. The advantages of the robotic system for the surgeons (e.g. 3D visualization, tremor reduction, intuitive motion, Endo Wrist manipulation with 7 degrees of freedom), the surgical outcomes and the patients’ preference are the main driving forces which lead to a steady increase in the number of robotic surgical procedures within the last years [14]. In contrast with laparoscopic and open approaches and besides the aforementioned advantages, the robotic surgery approach offers the benefit of ergonomics. Ergonomics in robotic surgery means a more comfortable position sitting at the console, with adjustable viewer height, arm-rest height and foot-pedal location. Taking short breaks during the surgery could possibly improve the surgeons’ further surgical steps. Moreover, when two consoles are available, part of the procedure can be performed by the assistant console surgeon, “passing the ball” between the two console surgeons, minimizing the effects of tiredness on the surgical outcome.

Overcoming the learning curve in robotic surgery is not an easy task, dozens or hundreds of procedures often being necessary to perform in order to become proficient. Moreover, it seems that open or laparoscopic previous experience does not entirely convert to console surgical skills [57]. At the beginning of the individual learning process the length of the robotic procedures can be significantly longer than the corresponding open or laparoscopic approaches. Even for experienced console surgeons, there are robotic procedures which can exceed 4–5 h (e.g. retroperitoneal lymph node dissection, radical cystectomy with intracorporeal neobladder) [8, 9]. In this situation, a question arises: are the surgeons’ skills influenced by tiredness, which could eventually lead to poorer results?

The effect of tiredness has been proved for the surgeons’ musculature (both for laparoscopic and robotic approaches) [10, 11]. There are studies in the literature demonstrating the negative impact of sleep deprivation on surgical performance and in robotic surgical skills [12]. However, it is still unclear how much the surgical skills are altered and which type of skills are more affected at the final steps of long, complex and demanding surgical procedures performed as part of a regular, daily program [13].


The aim of this study was to evaluate to what extent the surgeon’s skills are influenced by long procedures, using the objective assessment of different surgical skills by a virtual reality robotic simulator.

Material and methods

Fifteen surgeons with previous training exercises on a da Vinci surgical simulator (dVSS-Trainer, Mimic Technologies, Seattle, WA, USA) were enrolled in the study. They were asked to perform a continuous 4 h virtual robotic surgical simulator training session, with a break of 5 min after every hour of training.

The training started in the morning (starting between 8 and 9 a.m.) with a warming-up session of 10 min (when the three monitored exercises/tasks were explained and other types of exercises, on choice, were presented).

At the beginning of the study and at the end of each of the 4 h of training, three exercises of increasing difficulty were selected from the simulator’s menu and were mandatory to be performed by the participants in order to assess the surgeons’ skills. The three exercises were: Peg Board level 1 (consisting in multiple peg transfers on a vertical pad and requiring EndoWrist manipulation, camera movement and navigation, clutching, targeting the objects, grasping the objects and applying the grasping force); Energy Dissection level 2 (which consists in dissections of the small branches of a large vessel using the scissors and the forceps; it requires the skills mentioned for the previous exercise plus dissection tasks, applying monopolar or bipolar energy long enough to seal the vessel and switching between the monopolar and bipolar energy sources); and Suture Sponge level 3, the most complex of them (consisting in sutures on a virtual sponge, through specific dots and with a specific robotic arm, forehand and backhand sutures with the right hand and with the left hand, requiring EndoWrist manipulation, camera movement and navigation, clutching, targeting the objects, grasping the objects, applying a grasping force, needleholder control and needleholder driving). The results of these exercises were recorded and analyzed. Apart from these exercises, in every hour, the participants had to perform at their choice other types of exercises from the simulator menu which were neither registered nor assessed.

The participants were asked to postpone the completion of the study exercises if they had a night shift the night before the study, in order to avoid potential biases which could arise (e.g. accumulative tiredness due to surgical procedures during the night, sleep-deprivation consequences).

The study was conducted according to the national requirements and fulfilled the local ethical committee approval criteria. Consent was obtained from all the participants of the study, being explained the study objectives, methods and that all data were to be analyzed anonymously. The study was carried in accordance with Good Clinical Practice Guidelines implemented in the World Medical Association Declaration of Helsinki.

Statistical analysis

Statistical analysis was performed using the Kruskal-Wallis test. Data were displayed as mean values ± standard deviation. Mean and standard deviations were expressed as continuous data. A p-value < 0.05 was considered significant.


The mean age of the study group was 34 years (range: 27–53 years). All the participants in the study were male, having experience in open and laparoscopic surgery.

The overall score for the three exercises, comparing the results at the beginning of the training session (initial score) with those after 4 h of virtual reality simulator practice (final score), are presented in Table I.

Table I

Overall initial and final scores for the three exercises

ExerciseInitial score Mean value ± SDFinal score (after 4 h) Mean value ± SDStatistical significance, p
Exercise 1 (Peg board – level 1)84 ±1977 ±210.039
Exercise 2 (Energy dissection – level 2)75 ±1568 ±190.038
Exercise 3 (Suture Sponge – level 3)66 ±1956 ±220.040

One can see that, for overall scores, there is a statistically significant difference between initial and final scores for all the three exercises.

The specific metrics for the first exercise (Peg board level 1), detailed by hours, are presented in Table II.

Table II

Specific metrics, by hours, for exercise 1 (Peg Board level 1)

ParameterInitial results Mean value ± SDAfter 1 h of activity Mean value ± SDAfter 2 h of activity Mean value ± SDAfter 3 h of activity Mean value ± SDFinal results (after 4 h of activity) Mean value ± SDStatistical significance
Time to complete [s]92 ±2391 ±2490 ±2294 ±2497 ±25Initial vs. 2 h, p = 0.036
2 h vs. final, p = 0.032
Initial vs. final, p = 0.028
Instrument collision0.88 ±300.89 ±280.85 ±320.89 ±300.95 ±32Initial vs. 2 h, p = 0.032
2 h vs. final, p = 0.034
Initial vs. final, p = 0.041
Excessive force applied to instruments0.07 ±0.010.06 ±0.010.05 ±0.020.09 ±0.010.1 ±0.01Initial vs. 2 h, p = 0.034
2 h vs. final, p = 0.032
Initial vs. final, p = 0.047
Instruments out of view0.32 ±0.050.29 ±0.040.27 ±0.060.34 ±0.050.35 ±0.06Initial vs. 2 h, p = 0.042
2 h vs. final, p = 0.039
Initial vs. final, p = 0.045
Economy of motion [cm]145 ±38134 ±42135 ±46146 ±44156 ±47Initial vs. 2 h, p = 0.038
2 h vs. final, p = 0.039
Initial vs. final, p = 0.042
Drops0.20 ±0.040.21 ±0.060.18 ±0.060.22 ±0.070.37 ±0.05Initial vs. 2 h, p = 0.029
2 h vs. final, p = 0.034
Initial vs. final, p = 0.038
Master workspace9 ±28 ±18 ±210 ±312 ±3Initial vs. 2 h, p = 0.042
2 h vs. final, p = 0.041
Initial vs. final, p = 0.038

[i] Bold values for statistically significant values; NS – no statistical significance.

For the easiest exercise (Peg board, level 1), the detailed analysis reveals the steady improvement of most of the specific metrics (time to complete, instrument collision, excessive force applied to instruments, instruments out of view) at 1 h and 2 h. Thereafter, the specific metrics have a tendency to slightly alter.

The results for exercise 2 (including more complex tasks) are presented in Table III.

Table III

Specific metrics, by hours, for exercise 2 (Energy Dissection level 2)

ParamterInitial results Mean value ± SDAfter 1 h of activity Mean value ± SDAfter 2 h of activity Mean value ± SDAfter 3 h of activity Mean value ± SDFinal results (after 4 h of activity) Mean value ± SDStatistical significance
Time to complete [s]102 ±2199 ±1796 ±23105 ±25120 ±23Initial vs. 2 h, p = 0.028
2 h vs. final, p = 0.043
Initial vs. final, p = 0.035
Economy of motion [cm]157 ±26153 ±28148 ±29159 ±31169 ±30Initial vs. 2 h, p = 0.027
2 h vs. final, p = 0.026
Initial vs. final, p = 0.042
Instrument collision0.5 ±0.10.3 ±0.070.4 ±0.080.5 ±0.080.6 ±0.09Initial vs. 2 h, p > 0.05 – NS
2 h vs. final, p > 0.05 – NS
Initial vs. final, p > 0.05 – NS
Excessive force0.26 ±0.040.23 ±0.070.21 ±0.060.29 ±0.040.34 ±0.03Initial vs. 2 h, p = 0.034
2 h vs. final, p = 0.032
Initial vs. final, p = 0.036
Instruments out of view0.2 ±0.020.1 ±0.050.2 ±0.040.4 ±0.040.5 ±0.05Initial vs. 2 h, p > 0.05 – NS
2 h vs. final, p = 0.038
Initial vs. final, p = 0.037
Misapplied energy time6.1 ±1.25.8 ±1.45.7 ±1.26.4 ±1.26.5 ±1.1Initial vs. 2 h, p > 0.05 – NS
2 h vs. final, p > 0.05 – NS
Initial vs. final, p > 0.05 – NS
Master workspace14.9 ±3.214.4 ±3.113.9 ±3.414.6 ±3.316.2 ±3.1Initial vs. 2 h, p = 0.032
2 h vs. final, p = 0.029
Initial vs. final, p = 0.036

[i] Bold values for statistically significant values; NS – no statistical significance.

The results for exercise # 2 (Energy dissection level 2) show the same pattern as observed in exercise # 1: the specific metrics improve within the first 2 h, after which the subjects’ performance worsens statistically significantly, with two exceptions – misapplied energy time and instrument collision.

Table IV presents the results for the most complex exercise (Suture Sponge level 3).

Table IV

Specific metrics, by hours, for exercise 3 (Suture Sponge level 3)

ParameterInitial results Mean value ± SDAfter 1 h of activity Mean value ± SDAfter 2 h of activity Mean value ± SDAfter 3 h of activity Mean value ± SDFinal results (after 4 h of activity) Mean value ± SDStatistical significance
Time to complete [s]250 ±30240 ±35231 ±32245 ±34270 ±31Initial vs. 2 h, p = 0.032
2 h vs. final, p = 0.036
Initial vs. final, p = 0.042
Economy of motion [cm]344 ±68325 ±64322 ±66356 ±64370 ±62Initial vs. 2 h, p = 0.034
2 h vs. final, p = 0.037
Initial vs. final, p = 0.032
Instrument collision2.5 ±0.52.3 ±0.72.3 ±0.52.6 ±0.52.8 ±0.4Initial vs. 2 h, p = 0.07 – NS
2 h vs. final, p = 0.07 – NS
Initial vs. final, p = 0.06 – NS
Excessive force0.3 ±0.020.2 ±0.040.3 ±0.050.4 ±0.040.6 ±0.02Initial vs. 2 h, p = 0.2 – NS
2 h vs. final, p = 0.027
Initial vs. final, p = 0.032
Instruments out of view0.81 ±0.150.78 ±0.20.71 ±0.21.35 ±0.11.42 ±0.2Initial vs. 2 h, p = 0.034
2 h vs. final, p = 0.026
Initial vs. final, p = 0.032
Drops0.2 ±0.020.2 ±0.010.1 ±0.020.3 ±0.030.6 ±0.03Initial vs. 2 h, p = 0.028
2 h vs. final, p = 0.032
Initial vs. final, p = 0.042
Master workspace7.3 ±1.36.8 ±1.26.5 ±1.27.4 ±1.39.3 ±1.1Initial vs. 2 h, p = 0.038
2 h vs. final, p = 0.027
Initial vs. final, p = 0.032

[i] Bold values for statistically significant values; NS – no statistical significance.

One can observe that there is the same trend in altering the subjects’ performance on specific metrics for the most demanding exercise. Besides the statistical significance, the difference in absolute values between the initial and the final results of excessive force and mastering the workplace are much higher compared with the previous two exercises. Meanwhile, the instrument collision specific metrics remain unmodified, being the only one not influenced by tiredness when subjects were evaluated on their performance on the most complex exercise.


With the tremendous development of robotic surgery, more complex surgical procedures are reported to be feasible by this approach. This means longer, skill-demanding and challenging procedures, even for experienced console surgeons. For open surgery, there are high-volume centers which prefer, in the case of long, complex surgical procedures, to use two surgical teams (e.g. for radical cystectomy with an orthotopic neobladder in the University Medical Center in Mansoura, Egypt there is one team doing the cystectomy and lymph node dissection, followed by the team which performs the orthotopic neobladder). This way, both teams are focused on specific, shorter tasks, avoiding the approach of the most sensitive and skill demanding steps (e.g. reconstruction of the bladder) with tired surgeons.

The use of a virtual robotic surgical skills simulator (dVSS-Trainer) offers, beside the training value, the opportunity to objectively assess the surgical skills, their improvement or alteration with time. By choosing different types of exercises, with different levels of difficulty, one can evaluate with reliable accuracy the ex-vivo surgical skills [14, 15]. Among the long list of exercises offered by the dVSS-Trainer platform, the three exercises we chose for this study (requiring two-handed maneuvers, camera movements, cautery use, etc.) have been described as including reliable and balanced tasks in order to offer a close-to-reality evaluation of the surgeons’ skills and do not depend on the previous surgical experience [6, 16].

A study performed on more than 400 surgeons reported that 56% of them described physical symptoms or discomfort (neck stiffness, finger and eye fatigues) after robotic surgical procedures [10]. Does it translates into poorer surgical skills at the end of the procedure? A recent study comparing the levels of mental workload using the PFS (Piper Fatigue Scale) prior to the surgery and after the surgery revealed significantly increased levels after surgery for both laparoscopic and robotic surgeons [17]. Until now, most of the published studies have evaluated the ergonomic aspects of the robotic surgery and/or the physical and mental stress during the robotic surgery [11, 18, 19]. To our knowledge, this is the first study to evaluate the impact of longer robotic procedures on surgeons’ skill using the virtual reality simulator.

How the surgeons’ fatigue would affect specific tasks requiring attention and dexterity is still unclear. Functional brain magnetic resonance imaging (MRI) studies on sleep-deprived people showed the decrease of the signals from the dorsolateral prefrontal cortex, which has an important role in performing high-demanding, sustained attention tasks [20]. There are studies in the literature showing that starting non-emergent complex surgical procedures late in the day is associated with 2 times higher absolute and risk-adjusted mortality [21].

Besides the overall score for the three exercises at the beginning of the study and after 4 h (which are statistically significant for all of the exercises), it is interesting to analyze the specific metrics of the three exercises. Most of them change according to the same pattern: improving within the first hour, showing a statistically significant deterioration at 2 h and continuing to worsen until the end of the study period. No statistically significant changes were noted between increments of 1 h for each of the specific metrics of the three exercises.

The specific metrics that did not alter statistically significantly during the study were: instrument collision (initial vs. 2 h, 2 vs. 4 h and initial vs. final), instruments out of view (initial vs. 2 h) and misapplied energy time (initial vs. 2 h, 2 vs. 4 h and initial vs. final) for exercise 2 and instrument collision (initial vs. 2 h, 2 vs. 4 h and initial vs. final) and excessive force (initial vs. 2 h) for exercise 3. It seems that the instrument collision and misapplied energy time are more frequently not affected by the long lasting simulator practice. Meanwhile, instruments out of view (exercise #2) and excessive force applied to instruments (exercise #3) are not statistically significantly worsened after 2 h of practice but in the end are statistically significantly poorer than at the beginning. This can be explained by the role of working memory. The working memory was described in sleep-deprivation studies as keeping task-relevant information for a few seconds in order to be used for routine ongoing activities, and it has been proved that it is not always affected by sleep deprivation/tiredness [22, 23].

One can see that specific metrics such as time to complete, economy of motion, drops and master workspace suffer statistically significant alteration after 2 h of console practice, altering the overall score for all the three exercises. We can say that these are the most specific metrics prone to change as the surgeon gets tired.

The strengths of this study are that the study group is a homogeneous one, with surgeons with open and laparoscopic experience, having experience in console training exercises only, without robotic surgical experience. By this, we aimed to avoid biases due to different robotic surgical experience on simulator exercises. Another strength was the study’s design including the choice of the exercises (type, level of difficulty) and the simple and clear console program to obtain reliable results and to avoid biases. Between the hourly evaluations, the participants were allowed to perform training exercises at their own choice, to avoid the boredom described to occur when the same exercises are repeated for a long period of time [24]. The study limitations are represented by the relatively small number of participants and the study length, limited to 4 h. A larger study will be started, including longer simulator periods and an increased number of tasks and situations to be evaluated.

Having said this, what could be the clinical implications? Being a simulator study, it is questionable to what degree the obtained results could be translated into real-life robotic surgery, but it is reasonable to consider so, as long as emerging data from the last years report the surgeons’ fatigue as an important factor affecting the mortality and complication rates [25, 26]. Whether further, larger studies would confirm our results, one should take into consideration the use of the major advantages of robotic surgery which could combat the effect of fatigue (e.g. two-console surgery, changing the console surgeon or taking breaks to combat fatigue).


The specific metrics on the virtual reality robotic surgical simulator are altered after a 4-hour console training period. After the first hour of training (when the performance improves), the surgeons’ performance slightly decreases to a statistically significant difference at the end of the study. Further larger and more complex studies are necessary to evaluate the translation from the simulator to real-life surgery.

Conflict of interest

The authors declare no conflict of interest.



Yates DR, Vaessen C, Roupret M , authors. From Leonardo to da Vinci: the history of robot-assisted surgery in urology. BJU Int. 2011. 108:p. 1708–13


Rassweiler J, Hruza M, Teber D, Su LM , authors. Laparoscopic and robotic assisted radical prostatectomy – critical analysis of the results. Eur Urol. 2006. 49:p. 612–24


Orvieto MA, Marchetti P, Castillo OA, et al. , authors. Robotic technologies in surgical oncology training and practice. Surg Oncol. 2011. 20:p. 203–9


Bourcier T, Chammas J, Becmeur PH, et al. , authors. Robotically assisted pterygium surgery: first human case. Cornea. 2015. 34:p. 1329–30


Ou YC, Yang CR, Wang J, et al. , authors. Robotic-assisted laparoscopic radical prostatectomy: learning curve of first 100 cases. Int J Urol. 2010. 17:p. 635–40


Cumpanas AA, Bardan R, Ferician OC, et al. , authors. Does previous open surgical experience have any influence on robotic surgery simulation exercises? Videosurgery Miniinv. 2017. 12:p. 366–71


Schommer E, Patel VR, Mouraviev V, et al. , authors. Diffusion of robotic technology into urologic practice has led to improved resident physician robotic skills. J Surg Educ. 2017. 74:p. 55–60


Bochner BH, Dalbagni G, Sjoberg DD, et al. , authors. Comparing open radical cystectomy and robot-assisted laparoscopic radical cystectomy: a randomized clinical trial. Eur Urol. 2015. 67:p. 1042–50


Mittakanti HR, Porter JR , authors. Robotic retroperitoneal lymph node dissection for testicular cancer: feasibility and latest outcomes. Curr Opin Urol. 2019. 29:p. 173–9


Lee G, Lee M, Green I, et al. , authors. Surgeons’ physical discomfort and symptoms during robotic surgery: a comprehensive ergonomic survey study. Surg Endosc. 2017. 31:p. 1697–706


Lee GI, Lee MR, Clanton T, et al. , authors. Comparative assessment of physical and cognitive ergonomics associated with robotic and traditional laparoscopic surgeries. Surg Endosc. 2014. 28:p. 456–65


Banfi T, Coletto E, d’Ascanio P, et al. , authors. Effects of sleep deprivation on surgeons dexterity. Front Neurol. 2019. 10:p. 595


Berguer R, Smith W , authors. An ergonomic comparison of robotic and laparoscopic technique: the influence of surgeon experience and task complexity. J Surg Res. 2006. 134:p. 87–92


Perrenot C, Perez M, Tran N, et al. , authors. The virtual reality simulator dV-Trainer is a valid assessment tool for robotic surgical skills. Surg Endosc. 2012. 26:p. 2587–93


Walliczek U, Fortsch A, Dworschak P, et al. , authors. Effect of training frequency on the learning curve on the da Vinci Skills Simulator. Head Neck. 2016. 38 Suppl 1:p. E1762–9


Finnerty BM, Afaneh C, Aronova A, et al. , authors. General surgery training and robotics: are residents improving their skills? Surg Endosc. 2016. 30:p. 567–73


González-Sánchez M, González-Poveda I, Mera-Velasco S, Cuesta-Vargas AI , authors. Comparison of fatigue accumulated during and after prolonged robotic and laparoscopic surgical methods: a cross-sectional study. Surg Endosc. 2017. 31:p. 1119–35


Klein MI, Warm JS, Riley MA, et al. , authors. Mental workload and stress perceived by novice operators in the laparoscopic and robotic minimally invasive surgical interfaces. J Endourol. 2012. 26:p. 1089–94


Nowakowski M, Trybek P, Rubinkiewicz M, et al. , authors. Upper extremity surface electromyography signal changes after laparoscopic training. Videosurgery Miniinv. 2018. 13:p. 485–93


Chee MW, Goh CS, Namburi P, et al. , authors. Effects of sleep deprivation on cortical activation during directed attention in the absence and presence of visual stimuli. Neuroimage. 2011. 58:p. 595–604


Yount KW, Lau CL, Yarboro LT, et al. , authors. Late operating room start times impact mortality and cost for nonemergent cardiac surgery. Ann Thorac Surg. 2015. 100:p. 1653–9


Xie W, Berry A, Lustig C, et al. , authors. Poor sleep quality and compromised visual working memory capacity. J Int Neuropsychol Soc. 2019. 25:p. 583–94


Cumpanas A, Ferician O, Latcu S, et al. , authors. Does sleep deprivation alter virtual reality-based robotic surgical skills? Videosurgery Miniinv. 2020. 15:p. 97–105


Teishima J, Hattori M, Inoue S, et al. , authors. Impact of laparoscopic experience on the proficiency gain of urologic surgeons in robot-assisted surgery. J Endourol. 2012. 26:p. 1635–8


Halvachizadeh S, Teuber H, Cinelli P, et al. , authors. Does the time of day in orthopedic trauma surgery affect mortality and complication rates? Patient Saf Surg. 2019. 13:p. 8


Chacko AT, Ramirez MA, Ramappa AJ, et al. , authors. Does late night hip surgery affect outcome? J Trauma Acute Care Surg. 2011. 71:p. 447–53

Copyright: © 2020 Fundacja Videochirurgii This is an Open Access article distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0) License (http://creativecommons.org/licenses/by-nc-sa/4.0/), allowing third parties to copy and redistribute the material in any medium or format and to remix, transform, and build upon the material, provided the original work is properly cited and states its license.
Quick links
© 2020 Termedia Sp. z o.o. All rights reserved.
Developed by Bentus.
PayU - płatności internetowe