Extracting Code from Programming Tutorial Videos
The number of programming tutorial videos on the web increases daily. Video hosting sites such as YouTube host millions of video lectures, with many programming tutorials for various languages and platforms. These videos contain a wealth of valuable information, including code that may be of interest. However, two main challenges have so far prevented the effective indexing of programming tutorial videos: (i) code in tutorials is typically written on-the-fly, with only parts of the code visible in each frame, and (ii) optical character recognition (OCR) is not precise enough to produce quality results from videos.
We present a novel approach for extracting code from videos that is based on: (i) consolidating code across frames, and (ii) statistical language models for applying corrections at different levels, allowing us to make corrections by choosing the most likely token, combination of tokens that form a likely line structure, and combination of lines that lead to a likely code fragment in a particular language. We implemented our approach in a tool called ACE, and used it to extract code from 40 Android video tutorials on YouTube. Our evaluation shows that ACE extracts code with high accuracy, enabling deep indexing of video tutorials.
Wed 2 NovDisplayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
15:40 - 17:20
Session 2Onward! Papers at Zürich 2
Chair(s): Jeff Huang Texas A&M University
|Bloqqi: Modular Feature-Based Block Diagram Programming|
Niklas Fors Lund University, Görel Hedin Lund University, SwedenDOI Pre-print
|Building White-Box Abstractions by Program Refinement|
Mehrdad Afshari Vivibe LLC, Zhendong Su University of California, DavisDOI Pre-print
|Function Passing: A Model for Typed, Distributed Functional Programming|
Heather Miller Ecole Polytechnique Federale de Lausanne, Philipp Haller KTH Royal Institute of Technology, Normen Müller , Jocelyn Boullier EPFL, Jorge Vicente Cantero EPFLDOI
|Extracting Code from Programming Tutorial Videos|
Shir Yadid Technion, Eran Yahav TechnionDOI