Benchmark Module

Bastian Friedrich

Collax GmbH

Daniel-Constantin Mierla

Edited by

Bastian Friedrich

Revision History
Revision $Revision: 5901 $$Date: 2013-01-29 13:35:11 +0100 (Tue, 29 Jan 2013) $

Table of Contents

1. Admin Guide
1.1. Overview
1.2. Dependencies
1.2.1. OpenSIPS Modules
1.2.2. External Libraries or Applications
1.3. Exported Parameters
1.3.1. enable (int)
1.3.2. granularity (int)
1.3.3. loglevel (int)
1.4. Exported Functions
1.4.1. bm_start_timer(name)
1.4.2. bm_log_timer(name)
1.5. Exported pseudo-variables
1.5.1. $BM_time_diff
1.6. Exported MI Functions
1.6.1. bm_enable_global
1.6.2. bm_enable_timer
1.6.3. bm_granularity
1.6.4. bm_loglevel
1.6.5. bm_poll_results
1.7. Example of usage
2. Developer Guide
2.1. Available Functions
2.1.1. bm_register(name, mode, id)
2.1.2. bm_start(id)
2.1.3. bm_log(id)
2.2. Benchmark API Example

List of Examples

1.1. Set enable parameter
1.2. Set granularity parameter
1.3. Set loglevel parameter
1.4. bm_start_timer usage
1.5. bm_log_timer usage
1.6. Enabling a timer
1.7. Getting the results via FIFO interface
1.8. benchmark usage
2.1. Using the benchmark module's API from another module

Chapter 1. Admin Guide

1.1. Overview

This module helps developers to benchmark their module functions. By adding this module's functions via the configuration file or through its API, OpenSIPS can log profiling information for every function.

The duration between calls to start_timer and log_timer is stored and logged via OpenSIPS's logging facility. Please note that all durations are given as microseconds (don't confuse with milliseconds!).

1.2. Dependencies

1.2.1. OpenSIPS Modules

The following modules must be loaded before this module:

  • No dependencies on other OpenSIPS modules.

1.2.2. External Libraries or Applications

The following libraries or applications must be installed before running OpenSIPS with this module loaded:

  • None.

1.3. Exported Parameters

1.3.1. enable (int)

Even when the module is loaded, benchmarking is not enabled per default. This variable may have three different values:

  • -1 - Globally disable benchmarking

  • 0 - Enable per-timer enabling. Single timers are inactive by default and can be activated through the MI interface as soon as that feature is implemented.

  • 1 - Globally enable benchmarking

Default value is “0”.

Example 1.1. Set enable parameter

modparam("benchmark", "enable", 1)

1.3.2. granularity (int)

Logging normally is not done for every reference to the log_timer() function, but only every n'th call. n is defined through this variable. A sensible granularity seems to be 100.

If granularity is set to 0, then nothing will be logged automatically. Instead bm_poll_results MI command can be used to retrieve the results and clean the local values.

Default value is “100”.

Example 1.2. Set granularity parameter

modparam("benchmark", "granularity", 500)

1.3.3. loglevel (int)

Set the log level for the benchmark logs. These levels should be used:

  • -3 - L_ALERT

  • -2 - L_CRIT

  • -1 - L_ERR

  • 1 - L_WARN

  • 2 - L_NOTICE

  • 3 - L_INFO

  • 4 - L_DBG

Default value is “3” (L_INFO).

Example 1.3. Set loglevel parameter

modparam("benchmark", "loglevel", 4)

This will set the logging level to L_DBG.

1.4. Exported Functions

1.4.1.  bm_start_timer(name)

Start timer “name”. A later call to “bm_log_timer()” logs this timer..

Example 1.4. bm_start_timer usage


1.4.2.  bm_log_timer(name)

This function logs the timer with the given ID. The following data are logged:

  • Last msgs is the number of calls in the last logging interval. This equals the granularity variable.

  • Last sum is the accumulated duration in the current logging interval (i.e. for the last “granularity” calls).

  • Last min is the minimum duration between start/log_timer calls during the last interval.

  • Last max - maximum duration.

  • Last average is the average duration between bm_start_timer() and bm_log_timer() since the last logging.

  • Global msgs number of calls to log_timer.

  • Global sum total duration in microseconds.

  • Global min... You get the point. :)

  • Global max also obvious.

  • Global avg possibly the most interesting value.

Example 1.5. bm_log_timer usage


1.5. Exported pseudo-variables

Exported pseudo-variables are listed in the next sections.

1.5.1. $BM_time_diff

$BM_time_diff - the time difference elapsed between calls of bm_start_timer(name) and bm_log_timer(name). The value is 0 if no bm_log_timer() was called.

1.6. Exported MI Functions

1.6.1. bm_enable_global

Enables/disables the module. Parameter may be -1, 0 or 1. See discription of "enable" parameter.

1.6.2. bm_enable_timer

Enable or disable a single timer. The following example enables timer "test" (the second parameter must be 0 to disable):

Example 1.6. Enabling a timer

opensipsctl fifo bm_enable_timer test 1

1.6.3. bm_granularity

Modifies the benchmarking granularity. See "granularity" variable.

1.6.4. bm_loglevel

Modifies the module log level. See "loglevel" variable.

1.6.5. bm_poll_results

Returns the current and global results for each timer. This command is only available if the "granularity" variable is set to 0. It can be used to get results in stable time intervals instead of every N messages. Each timer will have 2 nodes - the local and the global values. Format of the values is the same as the one normally used in logfile. This way of getting the results allows to interface with external graphing applications like Munin.

If there were no new calls to bm_log_timer since last check, then all current values of a timer will be equal 0. Each call to bm_poll_results will reset current values (but not global ones).

Example 1.7. Getting the results via FIFO interface

opensipsctl fifo bm_poll_results

1.7. Example of usage

Measure the duration of user location lookup.

Example 1.8. benchmark usage


Chapter 2. Developer Guide

The benchmark module provides an internal API to be used by other OpenSIPS modules. The available functions are identical to the user exported functions.

Please note that this module is intended mainly for developers. It should be used with caution in production environments.

2.1. Available Functions

2.1.1.  bm_register(name, mode, id)

This function register a new timer and/or returns the internal ID associated with the timer. mode controls the creation of new timer if not found. id is to be used by start and log timer functions.

2.1.2.  bm_start(id)

This function equals the user-exported function bm_start_timer. The id is passed as an integer, though.

2.1.3.  bm_log(id)

This function equals the user-exported function bm_log_timer. The id is passed as an integer, though.

2.2. Benchmark API Example

Example 2.1. Using the benchmark module's API from another module

#include "../benchmark/benchmark.h"
struct bm_binds bmb;
/* load the benchmarking API */
if (load_bm_api( &bmb )!=0) {
    LM_ERR("can't load benchmark API\n");
    goto error;
/* Start/log timers during a (usually user-exported) module function */
bmb.bm_register("test", 1, &id)