next up previous
Next: The current level of Up: Why should we experiment? Previous: Why should we experiment?

Traditional scientific method isn't applicable

The fact that -- in the field of computer science -- the subject of inquiry is information rather than matter or energy makes no no difference to the applicability of the traditional scientific method. In order to understand the nature of information processes, computer scientists must observe phenomena, formulate explanations and theories, and test them.

There are plenty of computer science theories that haven't been tested. For instance, functional programming, object-oriented programming, and formal methods are all thought to improve programmer productivity, program quality, or both. It is surprising that none of these obviously important claims have ever been tested in a systematic way, even though they are all 30 years old and a lot of effort has been invested in developing programming languages and formal techniques.

Traditional sciences use theory test and exploration iteratively because observations help formulate new theories that can be tested later. An important requirement for any experiment, however, is repeatability. Repeatability makes sure that results can be checked independently and thus raises confidence in the results and helps eliminate errors, hoaxes, and frauds.



Walter Tichy
Mon May 4 16:58:54 MET DST 1998