Grading of Surgeon Technical Performance Predicts Postoperative Pancreatic Fistula for Pancreaticoduodenectomy Independent of Patient-related Variables.

OBJECTIVE: To evaluate and quantify surgical skill by grading surgical performance of the pancreaticojejunostomy from robotic pancreaticoduodenectomies (RPDs). We hypothesized that video grading of surgical performance would contribute to estimating risk of postoperative pancreatic fistula (POPF) after pancreaticoduodenectomy.

BACKGROUND: POPF majorly contributes to pancreaticoduodenectomy morbidity. Risk scores [Fistula Risk Score (FRS) and Braga] derived from patient variables are validated for predicting POPF. Birkmeyer et al showed assessment of surgical proficiency is an important component of outcomes.

METHODS: POPF was diagnosed using International Study Group definition. Technical performance of robotic pancreaticojejunostomy video was graded by 2 blinded surgeons using: (1) pancreaticojejunostomy step-by-step variables [PJ-specific variables (PJVs); max = 115]; and (2) the Objective Structured Assessment of Technical Skills (OSATS) score.

RESULTS: One hundred thirty-three pancreaticojejunostomies were analyzed. POPF was 18%. Higher FRS (P = 0.011) and Braga (P = 0.041) scores predicted POPF. Graders' subjective prediction did not correlate with FRS/Braga scores. Grader 1 scores (P = 0.043), but not grader 2 (P = 0.44), predicted POPF. PJV scores >105 were predictive of POPF (P = 0.039). Scoring only PJV duct-to-mucosa stitches (max = 50) was highly predictive of POPF (P = 0.0053). Higher OSATS scores were associated with a decreased rate of POPF (P = 0.022). On multivariate analysis, adding technical scoring to statistically significant patient variables (ie, gland texture) improves the model and can independently predict POPF. The strongest predictive model for POPF consisted of soft gland (odds ratio = 18.28, 95% confidence interval = 2.19-152.57) and low OSATS (odds ratio = 0.82, 95% confidence interval = 0.70-0.96). OSATS, modeled with FRS or Braga scores, independently predicted POPF.

CONCLUSIONS: This is the first study to demonstrate that technical scoring of a surgeon's performance independently predicts patient outcomes in pancreatic surgery. Future studies should consider how to validate and incorporate technical metrics.