summaryrefslogtreecommitdiffstats
path: root/runtime/stream.c
Commit message (Collapse)AuthorAgeFilesLines
* imfile: support LF escaping in read mode 2Rainer Gerhards2013-09-101-6/+16
|
* imfile: support LF escaping in read mode 1Rainer Gerhards2013-09-101-4/+12
|
* Merge branch 'v7-stable'Rainer Gerhards2013-07-191-1/+1
|\ | | | | | | | | Conflicts: runtime/stream.c
| * Merge branch 'v6-stable' into tmpRainer Gerhards2013-07-191-1/+1
| |\
| | * bugfix: correction to the interface of stream objTomas Heinrich2013-07-191-1/+1
| | | | | | | | | | | | | | | | | | | | | The datatype of the argument to SetiMaxFileSize() was too small and could overflow. The SetMaxFileSize() interface wasn't used at all (possibly confused with SetiMaxFileSize()) and was dropped.
* | | Merge branch 'v7-stable'Rainer Gerhards2013-06-251-1/+0
|\| |
| * | build: fix issues on FreeBSDRainer Gerhards2013-06-251-1/+0
| | | | | | | | | | | | | | | The last fix was incomplete. Thanks to Christiano for testing and suggestions.
* | | fix regression on unencrypted queue filesRainer Gerhards2013-05-161-0/+2
| | |
* | | cleanupRainer Gerhards2013-05-161-5/+5
| | |
* | | complete handle multiple blocks in encrypted queue filesRainer Gerhards2013-05-161-1/+14
| | |
* | | properly handle padding bytes when reading queue filesRainer Gerhards2013-05-161-5/+10
| | |
* | | enable ability to read existing encrypted queue fileRainer Gerhards2013-05-151-2/+18
| | |
* | | clean up crypto provider state files on queue file rolloverRainer Gerhards2013-05-151-3/+3
| | |
* | | clean up crypto provider state files on queue file closeRainer Gerhards2013-05-151-1/+18
| | |
* | | basic queue file encryptionRainer Gerhards2013-05-131-1/+7
|/ /
* | cleanupRainer Gerhards2013-04-241-3/+0
| |
* | logenc: milestone: rsyslog writes .encinfo side filesRainer Gerhards2013-04-111-1/+4
| |
* | log encryption: add rscrytool to decrypt log filesRainer Gerhards2013-04-051-3/+2
| | | | | | | | also add test parameter to be able to set key
* | log encryption: initial PoC implementationRainer Gerhards2013-04-051-2/+25
| | | | | | | | rough baseline, needs to be extended for actual use.
* | imfile: now detects file change when rsyslog was inactiveRainer Gerhards2013-03-201-24/+79
| | | | | | | | | | | | | | | | Previosly, this case could not be detected, so if a file was overwritten or rotated away while rsyslog was stopped, some data was missing. This is now detected and the new file being forwarded right from the beginning. closes: http://bugzilla.adiscon.com/show_bug.cgi?id=228
* | omfile: improved async writing, finally enabled full async writeRainer Gerhards2013-01-141-11/+17
| | | | | | | | also fixed a couple of smaller issues along that way
* | Merge branch 'v7-stable'Rainer Gerhards2012-11-221-10/+22
|\ \ | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: configure.ac doc/manual.html plugins/imfile/imfile.c plugins/imklog/bsd.c plugins/imklog/imklog.c plugins/imklog/imklog.h
| * | refactor stream.h; fix some issues with last patchRainer Gerhards2012-11-151-25/+16
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Most importantly, the last patch for imfile contained a number of glitches, which are fixed by this commit (a memory leak under unusual conditions, partial message loss when rsyslog was terminated in the interim & mixing file data to the wrong files when multiple monitors were used [due to static variable]). The commit is actually a re-write of the patch, based on its core idea. Also some other minor cleanup was done.
| * | bugfix: imfile discarded some file partsMilan Bartos2012-11-151-3/+24
| | | | | | | | | | | | | | | | | | | | | | | | | | | File lines that were incomplete (LF missing) *at the time imfile polled the file* were partially discarded. That part of the line that was read without the LF was discarded, and the rest of the line was submitted in the next polling cycle. This is now changed so that the partial content is saved until the complete line is read. Note that the patch affects only read mode 0.
* | | queue: file delete stream does no longer do real ioRainer Gerhards2012-11-191-2/+59
| | | | | | | | | | | | | | | | | | This stream is primarily used for state tracking, and has been modified to do just that. This results in considerable less io being done and the respective speedup.
* | | bugfix: dynafile zip files could be corruptedRainer Gerhards2012-11-051-9/+7
| | | | | | | | | | | | | | | | | | | | | | | | This could happen if a dynafile was destructed before the first write. In practice, this could happen if few lines were written to a file and it then became evicted from the dynafile cache. This would probably look very random, because it depended on the timing in regard to message volume and dynafile cache size.
* | | Merge branch 'master-ratelimit'Rainer Gerhards2012-10-301-2/+0
|\ \ \
| * | | Merge branch 'master' into master-ratelimitRainer Gerhards2012-10-241-2/+0
| | | | | | | | | | | | | | | | | | | | Conflicts: doc/v7compatibility.html
* | | | Merge branch 'v7-stable'Rainer Gerhards2012-10-301-0/+1
|\ \ \ \ | |/ / / |/| / / | |/ / | | | | | | Conflicts: configure.ac doc/manual.html
| * / testbench: complex1.sh testcase failed on slower machinesRainer Gerhards2012-10-291-0/+1
| |/ | | | | | | ... due to too small timeout for enqueue processing --> messages got lost
* | fix compile problem with DEBUG instrumentation enabledRainer Gerhards2012-10-081-1/+0
| |
* | Merge branch 'c1-streamzip' into master-streamzipRainer Gerhards2012-10-051-47/+94
|\ \ | |/ |/| | | | | | | | | | | | | Conflicts: ChangeLog configure.ac doc/rsyslog_conf_global.html runtime/stream.c tools/omfile.c
| * improved omfile zip writer to increase compressionRainer Gerhards2012-09-141-49/+94
| | | | | | | | | | This was achieved by somewhat reducing the robustness of the zip archive. This is controlled by the new setting $OMFileVeryReliableZip.
* | small bugfix: stream timeout API use was incorrectRainer Gerhards2012-08-221-2/+2
| | | | | | | | Thanks to Andre Lorbach for mentioning this.
* | Merge branch 'v5-stable' into v5-betaRainer Gerhards2012-08-221-6/+4
|\| | | | | | | | | Conflicts: runtime/ruleset.c
| * bugfix: strm class could abort under some circumstancesRainer Gerhards2012-07-241-6/+4
| | | | | | | | | | ... it could pass a NULL pointer to unlink. Depending on OS implementation, this could (or could not...) lead to a segfault.
* | changed TRUE/FALSE to RSTRUE/RSFALSERainer Gerhards2012-08-221-2/+2
|/ | | | This is done to prevent name claches with libraries.
* bugfix: $OMFileFlushInterval period was doubled - now using correct valueRainer Gerhards2011-10-181-1/+1
|
* bugfix: imfile did invalid system call under some circumstancesRainer Gerhards2011-10-071-4/+6
| | | | | | when a file that was to be monitored did not exist BUT the state file actually existed. Mostly a cosmetic issue. Root cause was incomplete error checking in stream.c; so patch may affect other code areas.
* Merge branch 'v4-stable' into v5-stableRainer Gerhards2011-05-031-0/+11
|\
| * bugfix: memory and file descriptor leak in stream processingRainer Gerhards2011-05-031-0/+11
| | | | | | | | | | | | | | | | Leaks could occur under some circumstances if the file stream handler errored out during the open call. Among others, this could cause very big memory leaks if there were a problem with unreadable disk queue files. In regard to the memory leak, this closes: http://bugzilla.adiscon.com/show_bug.cgi?id=256
* | cosmetic: making comments in stream.c a bit more readableRainer Gerhards2011-02-101-4/+6
| |
* | Merge branch 'v5-stable' into v5-develRainer Gerhards2011-01-261-10/+11
|\ \ | | | | | | | | | | | | | | | | | | Conflicts: ChangeLog configure.ac doc/manual.html
| * | Merge branch 'v4-stable' into v5-stableRainer Gerhards2011-01-261-10/+11
| |\|
| | * imfile bugfix: potential duplication of log contentRainer Gerhards2011-01-101-13/+9
| | | | | | | | | | | | | | | | | | Under some circumstances an invalid truncation was detected. This code has now been removed, a file change (and thus resent) is only detected if the inode number changes.
| | * forgot the actual patch with the last commit :(Rainer Gerhards2010-12-171-1/+1
| | |
| | * bugfix: imfile potentially duplicates linesRainer Gerhards2010-12-171-0/+5
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This can happen when 0 bytes are read from the input file, and some writer appends data to the file BEFORE we check if a rollover happens. The check for rollover uses the inode and size as a criterion. So far, we checked for equality of sizes, which is not given in this scenario, but that does not indicate a rollover. From the source code comments: Note that when we check the size, we MUST NOT check for equality. The reason is that the file may have been written right after we did try to read (so the file size has increased). That is NOT in indicator of a rollover (this is an actual bug scenario we experienced). So we need to check if the new size is smaller than what we already have seen!
* | | enhanced imfile to support multi-line messagesDavid Lang2011-01-251-26/+85
| | | | | | | | | | | | Signed-off-by: Rainer Gerhards <rgerhards@adiscon.com>
* | | improved imudp real-time scheduling support & bugfixDražen Kačar2011-01-101-1/+7
|/ / | | | | | | | | | | | | The original code had quite some issues, which are fixed by this commit. Also we do more error checking now. Signed-off-by: Rainer Gerhards <rgerhards@adiscon.com>
* | Merge branch 'v4-stable' into v5-stableRainer Gerhards2010-10-191-1/+8
|\| | | | | | | | | | | | | | | Conflicts: configure.ac runtime/cfsysline.c tools/ompipe.c