Preprocessors operate on the raw data stream and transform it. They are run before data reaches the codec and do not know or care about tremors internal representation.
Online codecs, preprocessors can be chained to perform multiple operations in succession.
Splits the input into lines (character 13
\n as line separator)
Splits the input into lines (null byte
\0 as line separator)
Splits the input into lines (pipe
| as line separator)
Decodes base64 encoded data to the raw bytes.
Decompresses a data stream, it is assumed that each message reaching the decompressor is a complete compressed entity.
The compression algorithm is detected automatically from the supported formats, if it can't be detected the assumption is that the data was decompressed and will be send on. Errors then can be transparently handled in the codec.
Decompress GZ compressed payload
Decompress Zlib ( deflate ) compressed payload
Decompress Xz2 ( 7z ) compressed payload
Decompress framed snappy compressed payload ( does not support raw snappy )
Decompress Lz4 compressed payload
Reassembles messages that were split apart using the GELF chunking protocol. The message content is decompressed after reassembly so no additional decompression is needed.
Removes empty messages (aka zero len).
Seperates a continous stream of data based on length prefixing. The lenght for each package in a stream is based on the first 64 bit decoded as a unsigned big endian value.