Onward! 2016
Sun 30 October - Fri 4 November 2016 Amsterdam, Netherlands
co-located with SPLASH 2016
Wed 2 Nov 2016 16:55 - 17:20 at Zürich 2 - Session 2 Chair(s): Jeff Huang

The number of programming tutorial videos on the web increases daily. Video hosting sites such as YouTube host millions of video lectures, with many programming tutorials for various languages and platforms. These videos contain a wealth of valuable information, including code that may be of interest. However, two main challenges have so far prevented the effective indexing of programming tutorial videos: (i) code in tutorials is typically written on-the-fly, with only parts of the code visible in each frame, and (ii) optical character recognition (OCR) is not precise enough to produce quality results from videos.
We present a novel approach for extracting code from videos that is based on: (i) consolidating code across frames, and (ii) statistical language models for applying corrections at different levels, allowing us to make corrections by choosing the most likely token, combination of tokens that form a likely line structure, and combination of lines that lead to a likely code fragment in a particular language. We implemented our approach in a tool called ACE, and used it to extract code from 40 Android video tutorials on YouTube. Our evaluation shows that ACE extracts code with high accuracy, enabling deep indexing of video tutorials.

Wed 2 Nov

onward-2016-papers
15:40 - 17:20: Onward! Papers - Session 2 at Zürich 2
Chair(s): Jeff HuangTexas A&M University
onward-2016-papers15:40 - 16:05
Talk
Niklas ForsLund University, Görel HedinLund University, Sweden
DOI Pre-print
onward-2016-papers16:05 - 16:30
Talk
Mehrdad AfshariVivibe LLC, Zhendong SuUniversity of California, Davis
DOI Pre-print
onward-2016-papers16:30 - 16:55
Talk
Heather MillerEcole Polytechnique Federale de Lausanne, Philipp HallerKTH Royal Institute of Technology, Normen Müller, Jocelyn BoullierEPFL, Jorge Vicente-CanteroEPFL
DOI
onward-2016-papers16:55 - 17:20
Talk
Shir YadidTechnion, Eran YahavTechnion
DOI