[cc65] testsuite reloaded (die ultimative lobhudelei :))

From: Groepaz <groepaz1gmx.net>
Date: 2009-07-27 17:07:21
oookay :) some recent ramblings on c.s.c. made me look at my compiler 
testsuite again, i have updated it a bit and i ran it on the latest snapshot 
in various configurations (c89/c99/cc65 standard that is). i also added a few 
more tests that check certain things that were reported as bugs in older 
versions. and guess what? 2.12.9 gloriously passes *every single test*, 
including some of the weird ones that exposed some bugs in earlier versions. 
(and for giggles: including one test that gcc manages to screw up, depending 
on optimization settings). thats awesome, really. many thanks and much 
respect to Uz, and everyone else involved in bringing the compiler to this 
state.

i will put up a webpage some time later with the detailed reports, i'd like to 
add even more tests - and atleast one that breaks something :) - before 
though, since right now the results are a bit "boring" =P (btw, if someone 
knows any regression test collections other than what sdcc and lcc comes 
with - i have included those already - point me to them please)

... and then said ramblings on usenet mentioned dhrystone.c, which made me 
curious enough to compile it with cc65 too :) and again, the outcome looks 
totally awesome. check this:

MACHINE     MICROPROCESSOR      OPERATING       COMPILER      DHRYSTONES/SEC.
TYPE                            SYSTEM                        NO REG    REGS
--------------------------	------------	-----------	---------------
Commodore 64  6510-1Mhz       C64 ROM         C Power 2.9 trim    19     34
Commodore 64  6510-1MHz       C64 ROM         C Power 2.8         36     36
Apple IIe     65C02-1.02Mhz   DOS 3.3         Aztec CII v1.05i    37     37
Commodore128  8502-2Mhz       C128 ROM        C Power 128  trim   43     68
Commodore 64  6510-0.98MHz    C64 ROM         cc65 2.12.9         50     52
Home Brew     Z80-4.00Mhz     CPM-80          Hisoft C++          53     53
Home Brew     Z80-2.5Mhz      CPM-80 v2.2     Aztec CII v1.05g    91     91
Commodore128  8502-2Mhz       C128 ROM        cc65 2.12.9        100    105

(this is compiled with -Osir, which i think is fair enough considering what 
kind of optimizations other compilers do even at very conservative 
optimization levels. the numbers drop by less than 5 points when using -O 
only, so its still very good even then)

as a sidenote: interisting how the worst compiler gains most from using 
register variables, and the best compilers gain very little :)

-- 

http://www.hitmen-console.org    http://magicdisk.untergrund.net
http://www.pokefinder.org        http://ftp.pokefinder.org

In a society in which there is no law, and in theory no compulsion, the only 
arbiter of behaviour is public opinion. But public opinion, because of the 
tremendous urge to conformity in gregarious animals, is less tolerant than 
any system of law. When human beings are governed by "thou shalt not," the 
individual can practice a certain amount of eccentricity; when they are 
supposedly governed by "love" or "reason," he is under continuous pressure to 
make him behave exactly the same way as everyone else. 
<George Orwell>

----------------------------------------------------------------------
To unsubscribe from the list send mail to majordomo@musoftware.de with
the string "unsubscribe cc65" in the body(!) of the mail.
Received on Mon Jul 27 17:07:31 2009

This archive was generated by hypermail 2.1.8 : 2009-07-27 17:07:34 CEST