Topic: testing compilers (was: C++ test suite available from FSF)


Author: rfg@netcom.com (Ronald F. Guilmette)
Date: Mon, 15 Nov 1993 09:56:08 GMT
Raw View
In article <27078@alice.att.com> ark@alice.UUCP () writes:
>In article <matth.752290227@extro.ucc.su.OZ.AU> matth@extro.ucc.su.OZ.AU (Matthew Hannigan) writes:
>
>> I would _really_ like to see the result of the testsuite on some
>> commercial compilers.  Not that I think that they aren't better
>> (at the moment), but how much better?
>
>In my experience, the ability of a compiler to pass a test suite
>is only slightly related to its usability.  It is part of the story,
>but only part...

For once, I will agree with Andrew.

It is certainly the case that there is more to a quality compiler than mere
correctness and/or conformance to standards.  (In particular, performance of
generated code is always an important issue.)  But if we exclude correctness,
conformance to standards, and performance of generated code, the "usability"
of a compiler is a rather nebulous characteristic, and one which is not so
easily quantified.

Correctness, conformance, and performance *are* however characteristics which
can be quantified, and which SHOULD BE quantified.

--

-- Ronald F. Guilmette, Sunnyvale, California -------------------------------
------ domain address: rfg@netcom.com ---------------------------------------
------ uucp address: ...!uunet!netcom.com!rfg -------------------------------