Onward! 2016
Sun 30 October - Fri 4 November 2016 Amsterdam, Netherlands
co-located with SPLASH 2016
Wed 2 Nov 2016 16:55 - 17:20 at Zürich 2 - Session 2 Chair(s): Jeff Huang

The number of programming tutorial videos on the web increases daily. Video hosting sites such as YouTube host millions of video lectures, with many programming tutorials for various languages and platforms. These videos contain a wealth of valuable information, including code that may be of interest. However, two main challenges have so far prevented the effective indexing of programming tutorial videos: (i) code in tutorials is typically written on-the-fly, with only parts of the code visible in each frame, and (ii) optical character recognition (OCR) is not precise enough to produce quality results from videos.
We present a novel approach for extracting code from videos that is based on: (i) consolidating code across frames, and (ii) statistical language models for applying corrections at different levels, allowing us to make corrections by choosing the most likely token, combination of tokens that form a likely line structure, and combination of lines that lead to a likely code fragment in a particular language. We implemented our approach in a tool called ACE, and used it to extract code from 40 Android video tutorials on YouTube. Our evaluation shows that ACE extracts code with high accuracy, enabling deep indexing of video tutorials.

Wed 2 Nov

Displayed time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change

15:40 - 17:20
Session 2Onward! Papers at Zürich 2
Chair(s): Jeff Huang Texas A&M University
15:40
25m
Talk
Bloqqi: Modular Feature-Based Block Diagram Programming
Onward! Papers
Niklas Fors Lund University, Görel Hedin Lund University, Sweden
DOI Pre-print
16:05
25m
Talk
Building White-Box Abstractions by Program Refinement
Onward! Papers
Mehrdad Afshari Vivibe LLC, Zhendong Su University of California, Davis
DOI Pre-print
16:30
25m
Talk
Function Passing: A Model for Typed, Distributed Functional Programming
Onward! Papers
Heather Miller Ecole Polytechnique Federale de Lausanne, Philipp Haller KTH Royal Institute of Technology, Normen Müller , Jocelyn Boullier EPFL, Jorge Vicente Cantero EPFL
DOI
16:55
25m
Talk
Extracting Code from Programming Tutorial Videos
Onward! Papers
Shir Yadid Technion, Eran Yahav Technion
DOI