Surgical Visual Understanding (SurgVU) Dataset
This dataset provides a resource for the machine learning community to tackle challenges in surgical data science, though it is incremental as it primarily offers new data rather than novel methods.
The authors introduced the Surgical Visual Understanding (SurgVU) dataset, a large collection of surgical videos with labels, to address the need for foundational data in surgical data science, enabling research on various machine learning problems in this domain.
Owing to recent advances in machine learning and the ability to harvest large amounts of data during robotic-assisted surgeries, surgical data science is ripe for foundational work. We present a large dataset of surgical videos and their accompanying labels for this purpose. We describe how the data was collected and some of its unique attributes. Multiple example problems are outlined. Although the dataset was curated for a particular set of scientific challenges (in an accompanying paper), it is general enough to be used for a broad range machine learning questions. Our hope is that this dataset exposes the larger machine learning community to the challenging problems within surgical data science, and becomes a touchstone for future research. The videos are available at https://storage.googleapis.com/isi-surgvu/surgvu24_videos_only.zip, the labels at https://storage.googleapis.com/isi-surgvu/surgvu24_labels_updated_v2.zip, and a validation set for tool detection problem at https://storage.googleapis.com/isi-surgvu/cat1_test_set_public.zip.