►shootout: Expression Performance Comparison for Racket
1 Introduction
2 Interface
shootout
3 History
4 Legal
Version: 0.1

shootout: Expression Performance Comparison for Racket

Neil Van Dyke

License: LGPL 3   Web: http://www.neilvandyke.org/racket-shootout/

 (require (planet neil/shootout:1:0))

1 Introduction

This package provides the shootout syntax, which is a convenient tool to help compare the performance of multiple Racket expressions. This can be useful when hand-optimizing performance-sensitive Racket code.

For example, the program:

  (define (va x (y "bbb") (z "ccc"))
    (expt 42 42)
    (string-append x y z))
  
  (define (fa x y z)
    (expt 42 42)
    (string-append x y z))
  
  (shootout (va "aaa")
            (fa "aaa" "bbb" "ccc")
            #:repeat 1000000)

might produce a log similar to:

SHOOTOUT-SAMPLING-GC-BASE

 

SHOOTOUT-BEGIN (REPEAT 1000000, GC-BASE-MS 2498, GC-BASE-GCMS 2496)

 

SHOOTOUT-EXPRESSION 1:

(va "aaa")

SHOOTOUT-TIMING (RUN 275, RUN-GCMS 12, COST 274, COST-GCMS 12, CLEANUP-DIFF -2.0)

 

SHOOTOUT-EXPRESSION 2:

(fa "aaa" "bbb" "ccc")

SHOOTOUT-TIMING (RUN 255, RUN-GCMS 12, COST 254, COST-GCMS 13, CLEANUP-DIFF -1.0)

 

SHOOTOUT-END

The most meaningful numbers in this version of shootout are “RUN” and “RUN-GCMS”. RUN is the real time in milliseconds during which the expression ran for the specificed number of iteractions (the “REPEAT” number). “RUN-GMCS” is the number of milliseconds of garbage collection (GC) time that occurred during the run. Neither of these numbers includes the GC “cleanup” time that shootout performs in an attempt to gauge any lingering GC cost of the expression.

Note that multiple runs of shootout may give substantially different results. So, you may wish to run multiple times and take the variation into consideration before drawing any conclusions.

Note that shootout is only an aid for performance-comparison, and does not control for all variables, nor are its measurements necessarily accurate.

2 Interface

(shootout expr ... #:repeat repeat)

Performs repeat iterations of each expr and reports performance information in a log.

Note that the format of this log and the information is reports is likely to change in future versions of this package.

3 History

4 Legal

Copyright (c) 2010 Neil Van Dyke. This program is Software; you can redistribute it and/or modify it under the terms of the GNU Lesser General Public License as published by the Free Software Foundation; either version 3 of the License (LGPL 3), or (at your option) any later version. This program is distributed in the hope that it will be useful, but without any warranty; without even the implied warranty of merchantability or fitness for a particular purpose. See http://www.gnu.org/licenses/ for details. For other licenses and consulting, please contact the author.