Publication No 40046

Author(s)

Kögel, J.*; Scholz, S.

Title

Processing of Flow Accounting Data in Java: Framework Design and Performance Evaluation

Topics

Network Management

Methods

Performance Evaluation

Keywords

NETWORK MANAGEMENT; MONITORING; PARALLEL COMPUTING; JAVA; GARBAGE COLLECTION; PERFORMANCE MEASUREMENT

Abstract

Flow Accounting is a passive monitoring mechanism implemented in routers that gives insight into traffic behavior and network characteristics. However, processing of Flow Accounting data is a challenging task, especially in large networks where the rate of Flow Records received at the collector can be very high. We developed a framework for processing of Flow Accounting data in Java. It provides processing blocks for aggregation, sorting, statistics, correlation, and other tasks. Besides reading data from files for offline analysis, it can also directly process data received from the network. In terms of multithreading and data handling, the framework is highly configurable, which allows performance tuning depending on the given task. For setting these parameters there are several trade-offs concerning memory consumption and processing overhead. In this paper, we present the framework design, study these trade-offs based on a reference scenario and examine characteristics caused by garbage collection.

Year

2010

Reference entry

Kögel, J.; Scholz, S.
Processing of Flow Accounting Data in Java: Framework Design and Performance Evaluation
Proceedings of the 16th EUNICE/IFIP WG 6.6 Workshop (EUNICE 2010), Trondheim, June 2010, pp. 177-187

BibTex file

Download  [BIBTEX]

Full Text

Download  [PDF]

Authors marked with an asterisk (*) were IKR staff members at the time the publication has been written.