5 P41 RRO0785-16 Appendix B: Lisp Performance Studies

Code: 386

Computer Type: Compaq 386 (20Mhz 386)
Operating System: 386/IX 5.3 rev level 1.01 (unix)
Lisp: Lucid 2.0

Disk Configuration: 134MB ESDI

Swapping Size: unknown

Memory Configuration: 10MB; 32kB 20ns cache
Display Configuration: terminal

Other Configuration: none

Special Comments: none

Timing Template: elapsed (run)

Date-of-test: Spring 1988

Code: 386T

Computer Type: Compaq 386 portable (Toaster) -
Operating System: 386/EX 5.3 rev level 1.01 (unix)
Lisp: Lucid 2.0

Disk Configuration: 40MB

Swapping Size: unknown

Memory Configuration: 10MB; no cache

Display Configuration: tiny LCD

Other Configuration: tiny display

Special Comments: portable version of "386" above
Timing Template: elapsed (run)

Date-of-test: Spring 1988

Code: 4/260

Computer Type: Sun 4/280

Operating System: SunOS 3.2 Gamma

Lisp: Lucid 2.1

Disk Configuration: unknown

Swapping Size: unknown

Memory Configuration: 32MB

Display Configuration: Hi Res color in mono

Other Configuration:

Special Comments: used :EXPAND 130 :GROWTH-RATE 130
Timing Template: elapsed (user-run + system-run)
Date-of-test: Summer 1988

251 E. H. Shortliffe
Appendix B: Lisp Performance Studies 5 P41 RRO0O0785-16

Code: 4/280

Computer Type: Sun 4/280

Operating System: SunOS 3.2 Gamma
Lisp: Lucid 2.1 beta

Disk Configuration: 417 (Eagle)
Swapping Size: 60MB

Memory Configuration: 8MB

Display Configuration: Hi Res mono
Other Configuration:

Special Comments:

Timing Template: elapsed (user-run + system-run)
Date-of-test: Winter 1988

Code: DEC-II

Computer Type: DEC MicroVax Il/GPX
Operating System: VMS

Lisp: VaxLisp

Disk Configuration: 2 x 159MB

Swapping Size: 3k pg page, 8k pg swap
Memory Configuration: 16MB

Display Configuration: GPX

Other Configuration:

Special Comments:

Timing Template: elapsed - gc-elapsed (run - gc-run)
Date-of-test: Fall 1987

Code: DEC-III

Computer Type: DEC MicroVax III (3500)
Operating System: VMS

Lisp: VaxLisp

Disk Configuration: (RD53)

Swapping Size: unknown

Memory Configuration: 16MB

Display Configuration:

Other Configuration:

Special Comments:

Timing Template: elapsed - gc-elapsed (run - gc-run)
Date-of-test: Fall 1987

E. H. Shortliffe 252
5 P41 RROO785-16 Appendix B: Lisp Performance Studies

Code: E-3/75

Computer Type: Sun 3/75

Operating System: SunOS 3.1

Lisp: Franz Extended Common Lisp 2.0

Disk Configuration: 70MB SCSI

Swapping Size: 50MB local

Memory Configuration: 28MB

Display Configuration: standard resolution mono
Other Configuration: Files on Sun 3/180 NFS server
Special Comments: Under suntools

Timing Template: elapsed (run + gc)

Date-of-test: Fall 1987

Code: EXP1

Computer Type: Texas Instruments Explorer I
Operating System: Explorer Lisp Release 4.1
Lisp: Explorer Lisp Release 4.1

Disk Configuration: 2 x 140MB SCSI

Swapping Size: 80MB

Memory Configuration: 8MB

Display Configuration: 1024 x 768 mono

Other Configuration:

Special Comments: TGC (incremental generation scavenging GC) on
Timing Template: elapsed - paging

Date-of-test: November 1988

Code: EXP2

Computer Type: Texas Instruments Explorer IT
Operating System: Explorer Lisp Release 4.1
Lisp: Explorer Lisp Release 4.1

Disk Configuration: 2 x 140MB SCSI

Swapping Size: 80MB

Memory Configuration: 16MB

Display Configuration: 1024 x 768 mono

Other Configuration:

Special Comments: TGC (incremental generation scavenging GC)
Timing Template: elapsed - paging

Date-of-test: November 1988

253 E. H. Shortliffe
Appendix B: Lisp Performance Studies 5 P41 RROO785-16

Code: EXP2+

Computer Type: Texas Instruments Explorer II Plus
Operating System: Explorer Lisp Release 4.1

Lisp: Explorer Lisp Release 4.1

Disk Configuration: 2 x 140MB SCSI

Swapping Size: 80MB

Memory Configuration: 16MB

Display Configuration: 1024 x 768 mono

Other Configuration:

Special Comments: TGC (incremental generation scavenging GC)
Timing Template: elapsed - paging

Date-of-test: November 1988

Code: F-4/280

Computer Type: Sun 4/280

Operating System: SunOS 4.0

Lisp: Franz Allegro Common Lisp 3.0.1 beta

Disk Configuration: 2x900

Swapping Size: 118MB

Memory Configuration: 32MB

Display Configuration: Hi Res mono

Other Configuration: Not running under GnuEmacs; no multi-
processing; 4MB initial memory

Special Comments:

Timing Template: elapsed (user-run + system-run)
Date-of-test: Winter 1989

Code: HP

Computer Type: Hewlett Packard 9000/350
Operating System: Unix

Lisp: HP Lisp 1.0

Disk Configuration: 130MB (7958)
Swapping Size: unknown

Memory Configuration: 16MB

Display Configuration: color

Other Configuration: under gnuemacs
Special Comments:

Timing Template: elapsed - run
Date-of-test: Fall 1987

E. H. Shortliffe 254
5 P41 RROO0785-16 Appendix B: Lisp Performance Studies

Code; K-3/75

Computer Type: Sun 3/75

Operating System: SunOS 3.1

Lisp: Kyoto Common Lisp "September 16, 1986"
Disk Configuration: 70MB SCSI

Swapping Size: 50MB local

Memory Configuration: 28MB

Display Configuration: standard resolution mono
Other Configuration: Files on Sun 3/180 NFS server
Special Comments: Under suntools

Timing Template: elapsed - run

Date-of-test: Fall 1987

Code: L-3/75

Computer Type: Sun 3/75

Operating System: SunOS 3.1

Lisp: Lucid 2.0

Disk Configuration: 70MB SCSI

Swapping Size: 50MB local

Memory Configuration: 28MB

Display Configuration: standard resolution mono
Other Configuration: Files on Sun 3/180 NFS server
Special Comments: used :-EXPAND 90 :GROWTH-RATE 90
Timing Template: elapsed (user-run + system-run)
Date-of-test: Fall 1987

Code: Mac2

Computer Type: Apple Macintosh II
Operating System: Mac OS 5

Lisp: Allegro Common Lisp 1.1
Disk Configuration: 100MB internal
Swapping Size: n/a

Memory Configuration: 5MB

Display Configuration: E-machines Big Picture 17" mono
Other Configuration:

Special Comments:

Timing Template: elapsed - paging
Date-of-test: Spring 1988

255

E. H. Shortliffe
Appendix B: Lisp Performance Studies 5 P41 RROO785-16

Code: Maci

Computer Type: Symbolics MacIvory
Operating System: Genera 7.3i

Lisp: Genera 7.3i

Disk Configuration: 300MB external
Swapping Size: 25,000kW (122MB)
Memory Configuration: 2,688kW (13MB); 2MB Mac II
Display Configuration: Radius

Other Configuration: Apple EtherTalk
Special Comments:

Timing Template: elapsed - paging
Date-of-test: December 1988

Code: mX

Computer Type: Texas Instruments microExplorer

Operating System: Explorer Lisp 5.0

Lisp: Explorer Lisp 5.0

Disk Configuration: 100MB Rodime

Swapping Size: 60MB

Memory Configuration: 12MB mX processor; 2MB Mac II

Display Configuration: 24" (1280 x 960) Moniterm Viking IT

Other Configuration: Apple EtherTalk

Special Comments:

Timing Template: elapsed - paging

Date-of-test: December 1988

Code: RT

Computer Type: IBM RT/AP

Operating System: AIX 2.1.2 (unix)

Lisp: 2.0.5 (Lucid 1.01)

Disk Configuration: "Fast" EESDI controller; 3 x 7OMB

Swapping Size: 80k x 512kB blocks (40,960MB)

Memory Configuration: 16MB of "fast" memory

Display Configuration: Moniterm 1024 x 768 mono

Other Configuration: AFT floating point unit; GSL windows

Special Comments: Used :EXPAND 69 to get GMB semispace;
This should be the fastest RT version now available

Timing Template: elapsed (user-run + system-run)

Date-of-test: Spring 1988

E. H. Shortliffe 256
5 P41 RRO00785-16 Appendix B: Lisp Performance Studies

Code: Sym

Computer Type: Symbolics 3645
Operating System: Symbolics Release 6.1
Lisp: Symbolics Release 6.1

Disk Configuration: 368MB

Swapping Size: 200MB

Memory Configuration: 8MB

Display Configuration:

Other Configuration: FPA, no color
Special Comments: EGC on; preliminary indications are that 6.1
performs better in these test than 7.2
Timing Template: elapsed - paging
Date-of-test: Winter 1988

Code: XCL

Computer Type: Xerox 1186

Operating System: Xerox Lisp, Lyric release
Lisp: Xerox Lisp, Lyric release

Disk Configuration: 40MB

Swapping Size: 16MB

Memory Configuration: 3.5MB

Display Configuration: 19" mono

Other Configuration:

Special Comments:

Timing Template: elapsed - gc - paging
Date-of-test: Winter 1988

257 E. H. Shortliffe
Appendix B: Lisp Performance Studies 5 P41 RR00785-16

Appendix B -- Test Procedures
To run a BB1 test the following procedure was followed:

1.
2.

6.
7.

The .LISP files were copied to the host under test.

Lisp was restarted and any necessary configuration, such as disabling
end-of-screen processing, was done.

If necessary, a (PROCLAIN 'COPTIMIZE (SPEED X) (SAFETY Y)))

form was entered.

The form (TIME (LOAD "COMPILE-BB1.L1SP"}) was entered and
allowed to complete without interruption, and the resulting information
was recorded. A side effect of loading the COMPILE-BB1 file is that the
source files are compiled and loaded.

The form (TIME (BB1::TEST-BBED!T)} was entered and allowed to
complete. The results were recorded.

Step 5 was repeated, which usually resulted in a better time.

Steps 2 through 6 were done a total of 4 times; once skipping step 3 and
then for CX, Y) = (3, 0), (0, 3), and (8, 2).

To run a SOAR test the following procedure was followed:

1.

The .LISP and .SOAR files were copied to the host under test.

2. Lisp was restarted and any necessary configuration, such as disabling

8.

9.

end-of-screen processing, was done.

. The form (TINE (COMPILE-FILE "SOAR.LISP")) was entered and

allowed to complete. The results were recorded.
Step 2 was repeated.

. The following forms were entered:

{LOAD “SOAR"}
(LOAD “DEFAULT.SOAR"}
(LOAD "“EIGHT.SOAR")

The form (TINE (RUN-TASK)) was entered. "1<Return>3<Return>" was
immediately typed ahead as responses to the prompts soon to follow. The
timing was allowed to complete and the results recorded for the "A mode"
test.

The form (|N|IT-SOAR) was entered.

Step 6 was repeated with "1<Return>1<Return>" in place of
"1<Return>3<Return>" for the "B mode" test.

Steps 7 and 8 were repeated with "3<Return>3<Return>" in place of
"1<Return>3<Return>" for the "C mode" test.

10. The following forms were entered:

E. H. Shortliffe 258
5 P41 RROO785-16 Appendix B: Lisp Performance Studies

(EXCISE EIGHT*MON|TOR-STATE)
(WATCH -1)

11. Step 9 was repeated for the "C no trace mode" test.
12. Steps 2 and 5 were repeated to reload SOAR.
13. Steps 7 and 8 were repeated for the "A no trace mode" test.

259 E. H. Shortliffe
5 P41 RROO785-16 Appendix C: AIM Management Committees

Appendix C: AIM Management Committee Membership

Following are the current membership lists of the various SUMEX-AIM
management committees:

AIM Executive Committee:

SHORTLIFFE, Edward H., M.D., Ph.D. (Chairman)
Principal Investigator - SUMEX

Medical School Office Building, Rm. X271

Stanford University Medical Center

Stanford, California 94305

(415) 723-6970

FEIGENBAUM, Edward A., Ph.D.
Co-Principal Investigator - SUMEX
Heuristic Programming Project
Department of Computer Science
701 Welch Road, Building C
Stanford University

Stanford, California 94305

(415) 723-4879

KULIKOWSKI, Casimir, Ph.D.
Department of Computer Science
Rutgers University

New Brunswick, New Jersey 08903
(201) 932-2006

LEDERBERG, Joshua, Ph.D.
President

The Rockefeller University
1230 York Avenue

New York, New York 10021
(212) 570-8080, 570-8000

LINDBERG, Donald A.B., M.D. (Past Adv Group Chrmn)
Director, National Library of Medicine

8600 Rockville Pike

Bethesda, Maryland 20814

(301)496-6221

MYERS, Jack D., M.D.

School of Medicine

Scaife Hall, 1291

University of Pittsburgh
Pittsburgh, Pennsylvania 15261
(412) 648-9933

261 E. H. Shortliffe
Appendix C: AIM Management Committees 5 P41 RROO785-16

AIM Advisory Group:

MYERS, Jack D., M.D. (Chairman)
School of Medicine

Scaife Hall, 1291

University of Pittsburgh
Pittsburgh, Pennsylvania 15261
(412) 648-9933

AMAREL, Saul, Ph.D.

Department of Computer Science
Rutgers University

New Brunswick, New Jersey 08903
(201) 932-3546

COULTER, Charles L., Ph.D. (Exec. Secretary)
Bldg 31, Room 5B41

Biomedical Research Technology Program
National Institutes of Health

9000 Rockville Pike

Bethesda, Maryland 20892

(301) 496-5411

FEIGENBAUM, Edward A., Ph.D. (Ex-officio)
Co-Principal Investigator - SUMEX

Heuristic Programming Project

Department of Computer Science

701 Welch Road, Building C

Stanford University

Palo Alto, California 94305

(415) 723-4879

KULIKOWSKI, Casimir, Ph.D.
Department of Computer Science
Hill Center Busch Campus
Rutgers University

New Brunswick, New Jersey 08903
(201) 932-2006

LEDERBERG, Joshua, Ph.D.
President

The Rockefeller University
1230 York Avenue

New York, New York 10021
(212) 570-8080, 570-8000

E. H. Shortliffe 262
5 P41 RROO785-16 Appendix C: AIM Management Committees

LINDBERG, Donald A.B., M.D.
Director, National Library of Medicine
Building 38, Rm. 2E-17B

8600 Rockville Pike

Bethesda, Maryland 20814

(301) 496-6221

MINSKY, Marvin, Ph.D.

Artificial Intelligence Laboratory
Massachusetts Institute of Technology
545 Technology Square

Cambridge, Massachusetts 02139
(617) 253-5864

MOHLER, William C., M.D.

Associate Director

Division of Computer Research and Technology
National Institutes of Health

Building 12A, Room 3033

9000 Rockville Pike

Bethesda, Maryland 20892

(301) 496-1168

PAUKER, Stephen G., M.D.

Department of Medicine - Cardiology

Tufts New England Medical Center Hospital
171 Harrison Avenue

Boston, Massachusetts 02111

(617) 956-5910

SHORTLIFFE, Edward H., M.D., Ph.D. (Ex-officio)
Principal Investigator - SUMEX

Medical School Office Building, Rm. X271

Stanford University Medical Center

Stanford, California 94305

(415) 723-6979

SIMON, Herbert A., Ph.D.
Department of Psychology
Baker Hall, 339
Carnegie-Mellon University
Schenley Park

Pittsburgh, Pennsylvania 15213
(412) 578-2787, 578-2000

263 E. H. Shortliffe
Appendix C: AIM Management Committees 5 P41 RROO785-16

Stanford Community Advisory Committee:

SHORTLIFFE, Edward H., M.D., Ph.D. (Chairman)
Principal Investigator - SUMEX

Medical School Office Building, Rm. X271

Stanford University Medical Center

Stanford, California 94305

(415) 723-6979

FEIGENBAUM, Edward A., Ph.D.
Heuristic Programming Project
Department of Computer Science
Margaret Jacks Hall

Stanford University

Stanford, California 94305

(415) 723-4879

LEVINTHAL, Elliott C., Ph.D.

Departments of Mechanical and Electrical Engineering
Building 530

Stanford University

Stanford, California 94305

(415) 723-9037

E. H. Shortliffe 264