Lightweight Programming Experiments without Programmers and Programs: An Example Study on the Effect of Similarity and Number of Object Identifiers on the Readability of Source Code using Natural Texts
It is often said that controlled experiments should check the effect of programming languages or styles on programming. But it is also often said that running controlled experiments is a very time consuming and error prone task – that's why a lot of researchers do not run such experiments. Both arguments are plausible, but there is potentially an alternative: lightweight experiments where the effort to run such experiments is low and which (still) fulfill the requirements of controlled experiments with two exceptions: First, these experiments do not use programmers as subjects, and second, the experiments do not contain programming tasks. Instead, such experiments try to find analogies from other domains where the topic to be studied is (still) close enough to the original target domain but where it is easier to find participants and experimental setups. This paper illustrates such a lightweight experiment by introducing a study on the effect of number of identifiers and similarity of identifiers on (code) readability – without using source code and without programmers as subjects. The result of the experiment is comparable to other experimental results which gives a first indicator that it is possible to run such lightweight experiments that approximate the results of full-blown experiments. This paper argues that such lightweight experiments could be useful in the process of experimentation – they cannot and should not supersede full-blown experiments, but they can help in early stages of experimentation.
Wed 2 Nov Times are displayed in time zone: Amsterdam, Berlin, Bern, Rome, Stockholm, Vienna change
10:30 - 10:55 Talk | Lightweight Programming Experiments without Programmers and Programs: An Example Study on the Effect of Similarity and Number of Object Identifiers on the Readability of Source Code using Natural Texts Onward! Papers Tim MarterUniversity of Duisburg-Essen, Paul BabuckeUniversity of Duisburg-Essen, Philipp LembkenUniversity of Duisburg-Essen, Stefan HanenbergUniversity of Duisburg-Essen DOI | ||
10:55 - 11:20 Talk | Emergent Software Services Onward! Papers Nicolás CardozoUniversidad de los Andes DOI Pre-print Media Attached | ||
11:20 - 11:45 Talk | Nez: Practical Open Grammar Language Onward! Papers Kimio KuramitsuYokohama National University, Japan DOI | ||
11:45 - 12:10 Talk | Exploring Cheap Type Inference Heuristics in Dynamically Typed Languages Onward! Papers DOI |