NXLog Agent batch processing
NXLog Agent implements an internal batch processing mechanism to process and move data along the defined routes efficiently. Batch settings can be specified globally or at the module level using the BatchSize and BatchFlushInterval directives. The module-level settings override the global settings.
Records are organized in batches by the input modules. Input modules accumulate records until they reach the batch size or flush interval. Once reaching either of these limits, the module writes the batch to a queue for processing by the following module(s) in the route. Output modules read the batched records from their log queues, process them, and write them to the output buffer in the same order they read them.