SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama
This dataset may drive a paradigm shift in text-to-video and advance short drama video generation, but it appears incremental as it builds on existing data collection and annotation methods.
The authors tackled the problem of generating high-quality shooting scripts for short dramas by creating SkyScript-100M, a dataset containing 1,000,000,000 pairs of scripts and shooting scripts, derived from 6,660 popular short drama episodes totaling 10 terabytes and 2,000 hours of video.
Generating high-quality shooting scripts containing information such as scene and shot language is essential for short drama script generation. We collect 6,660 popular short drama episodes from the Internet, each with an average of 100 short episodes, and the total number of short episodes is about 80,000, with a total duration of about 2,000 hours and totaling 10 terabytes (TB). We perform keyframe extraction and annotation on each episode to obtain about 10,000,000 shooting scripts. We perform 100 script restorations on the extracted shooting scripts based on our self-developed large short drama generation model SkyReels. This leads to a dataset containing 1,000,000,000 pairs of scripts and shooting scripts for short dramas, called SkyScript-100M. We compare SkyScript-100M with the existing dataset in detail and demonstrate some deeper insights that can be achieved based on SkyScript-100M. Based on SkyScript-100M, researchers can achieve several deeper and more far-reaching script optimization goals, which may drive a paradigm shift in the entire field of text-to-video and significantly advance the field of short drama video generation. The data and code are available at https://github.com/vaew/SkyScript-100M.