equal
deleted
inserted
replaced
4 |
4 |
5 CalipeL is a simple framework to ease development and maintenance |
5 CalipeL is a simple framework to ease development and maintenance |
6 of benchmarks and performance regressions. CalipeL has been heavily |
6 of benchmarks and performance regressions. CalipeL has been heavily |
7 inspired by [SUnit][1] and [Caliper][2] |
7 inspired by [SUnit][1] and [Caliper][2] |
8 |
8 |
9 Features: |
9 The basic ideas behind are: |
|
10 |
|
11 - Benchmarking and (especially) interpreting benchmark results is always |
|
12 a monkey business. Therefore the framework should be as simple as |
|
13 possible so everybody understands the meaning of numbers it gives. |
|
14 - Benchmark results should be kept and managed at single place so one |
|
15 can view and retrieve all past benchmark results pretty much the same |
|
16 way as one can view and retrieve past versions of the software from |
|
17 VCS. |
|
18 |
|
19 ## Features |
10 |
20 |
11 - *simple* - creating a benchmark is as simple as writing a method in a class |
21 - *simple* - creating a benchmark is as simple as writing a method in a class |
12 - *flexible* - a special set-up and/or warm-up routines could be specified at benchmark-level as well as set of parameters to allow fine-grained measurements |
22 - *flexible* - a special set-up and/or warm-up routines could be specified at benchmark-level as well as set of parameters to allow fine-grained measurements |
13 under different conditions |
23 under different conditions |
14 - *multi-language* - supports multiple languages to allow for language/runtime comparison |
24 - *multi-language* - supports multiple languages to allow for language/runtime comparison |