summaryrefslogtreecommitdiffstats
path: root/runtime/queue.c
Commit message (Collapse)AuthorAgeFilesLines
...
* | | | | | | | added --enable-debugless configure option for very high demanding environmentsRainer Gerhards2012-05-291-6/+6
|/ / / / / / / | | | | | | | | | | | | | | | | | | | | | | | | | | | | This actually at compile time disables a lot of debug code, resulting in some speedup (but serious loss of debugging capabilities)
* | | | | | | Merge branch 'v6-stable'Rainer Gerhards2012-05-101-11/+5
|\ \ \ \ \ \ \ | | |_|_|_|_|/ | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: ChangeLog configure.ac doc/manual.html
| * | | | | | bugfix: disk queue was not persisted on shutdown, regression of fix toRainer Gerhards2012-05-101-11/+5
| | |_|_|_|/ | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | http://bugzilla.adiscon.com/show_bug.cgi?id=299 The new code also handles the case of shutdown of blocking light and full delayable sources somewhat smarter and permits, assuming sufficient timouts, to persist message up to the max queue capacity. Also some nits in debug instrumentation have been fixed.
* | | | | | Merge branch 'v6-stable'Rainer Gerhards2012-05-031-6/+47
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: tools/syslogd.c
| * | | | | bugfix: rsyslog did not terminate when delayable inputs were blockedRainer Gerhards2012-05-031-5/+42
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ...due to unvailable sources. Fixes: http://bugzilla.adiscon.com/show_bug.cgi?id=299 Thanks to Marcin M for bringing up this problem and Andre Lorbach for helping to reproduce and fix it.
| * | | | | bugfix: inside queue.c, some thread cancel states were not correctly reset.Rainer Gerhards2012-05-031-5/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | While this is a bug, we assume it did have no practical effect because the reset as it was done was set to the state the code actually had at this point. But better fix this...
| * | | | | bugfix: active input in "light delay state" could block rsyslog terminationRainer Gerhards2012-04-271-0/+4
| | | | | | | | | | | | | | | | | | | | | | | | at least for prolonged period of time...
* | | | | | Merge branch 'v5-stable-newstats'Rainer Gerhards2012-04-071-0/+1
|\ \ \ \ \ \ | | |_|_|_|/ | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: action.c configure.ac doc/imuxsock.html plugins/imklog/imklog.c plugins/imptcp/imptcp.c plugins/imtcp/imtcp.c plugins/imudp/imudp.c plugins/imuxsock/imuxsock.c runtime/glbl.c runtime/glbl.h runtime/net.c runtime/ruleset.c tcpsrv.h tools/syslogd.c
| * | | | | Merge branch 'v5-stable' into v5-stable-newstatsRainer Gerhards2012-04-071-4/+8
| |\| | | | | | |_|_|/ | |/| | | | | | | | | | | | | Conflicts: configure.ac
| * | | | Merge branch 'v5-stable' into v5-stable-newstatsRainer Gerhards2012-03-141-3/+2
| |\ \ \ \ | | |_|_|/ | |/| | | | | | | | | | | | | | | | | | | | | | | Conflicts: plugins/imuxsock/imuxsock.c runtime/queue.c runtime/queue.h
| * | | | Merge branch 'v5-stable' into v5-stable-newstatsRainer Gerhards2012-03-121-1/+8
| |\ \ \ \
| * | | | | added configuration directives to customize queue light delay marksRainer Gerhards2012-02-211-0/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | $MainMsgQueueLightDelayMark, $ActionQueueLightDelayMark; both specify number of messages starting at which a delay happens.
| * | | | | added instrumentationRainer Gerhards2011-12-191-1/+10
| | | | | |
* | | | | | Merge branch 'v6-stable'Rainer Gerhards2012-04-071-4/+8
|\ \ \ \ \ \ | | |_|_|/ / | |/| | | |
| * | | | | bugfix: segfault on startup if $actionqueuefilename was missing for disk ↵Tomas Heinrich2012-04-051-1/+2
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | queue config Signed-off-by: Rainer Gerhards <rgerhards@adiscon.com>
| * | | | | bugfix: segfault if disk-queue was started up with old queue fileTomas Heinrich2012-04-051-3/+6
| | |_|/ / | |/| | | | | | | | | | | | | Signed-off-by: Rainer Gerhards <rgerhards@adiscon.com>
* | | | | added "date-unixtimestamp" property replacer option to format as a unix ↵Rainer Gerhards2012-03-291-1/+0
| | | | | | | | | | | | | | | | | | | | timestamp
* | | | | Merge branch 'v6-stable'Rainer Gerhards2012-03-171-3/+2
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: plugins/imuxsock/imuxsock.c runtime/queue.c runtime/queue.h
| * | | | changed statsobj interface and added better docRainer Gerhards2012-03-141-3/+2
| | |/ / | |/| |
* | | | Merge branch 'v6-stable'Rainer Gerhards2012-03-121-0/+8
|\| | | | | | | | | | | | | | | | | | | Conflicts: runtime/queue.c
| * | | bugfix: stopped DA queue was never processed after a restartRainer Gerhards2012-03-121-1/+8
| |/ / | | | | | | | | | ...due to a regression from statistics module.
* | | Merge branch 'v5-devel'Rainer Gerhards2011-12-191-0/+9
|\ \ \ | | |/ | |/| | | | | | | | | | | | | Conflicts: ChangeLog action.c plugins/imudp/imudp.c
| * | experimental: added first stats counter to action objectRainer Gerhards2011-12-161-1/+1
| | |
| * | more work on queue statistics counterRainer Gerhards2011-12-161-4/+8
| | |
| * | new stats counter "discarded" for queue objectRainer Gerhards2011-12-161-0/+5
| | | | | | | | | | | | Tells how many messages have been discarded due to queue full condition.
| * | Merge branch 'v5-stable' into v5-develAndre Lorbach2011-08-181-0/+9
| |\| | | | | | | | | | | | | Conflicts: configure.ac
* | | Merge branch 'beta'Andre Lorbach2011-08-181-1/+8
|\ \ \ | | |/ | |/| | | | | | | Conflicts: runtime/queue.c
| * | removed debug code from action.c and runtime/queue.c after testingAndre Lorbach2011-08-181-4/+0
| | |
| * | bugfix: fixed incorrect state handling for Discard Action (transactions)Andre Lorbach2011-08-181-0/+13
| | |
* | | milestone: queue-params are properly initialized for action queuesRainer Gerhards2011-08-011-0/+34
| | |
* | | milestone: generic action parameters parsed via new config systemRainer Gerhards2011-08-011-1/+1
| | |
* | | milestone: queue object now has a param handler for new conf interfaceRainer Gerhards2011-07-221-39/+168
| |/ |/| | | | | ... and action queue defs use this new interface (but not yet the main queues)
* | Merge branch 'v5-stable' into v5-develRainer Gerhards2011-06-211-4/+8
|\| | | | | | | | | | | | | Conflicts: ChangeLog configure.ac doc/manual.html
| * bugfix: mutex was invalidly left unlocked during action processingv5.8.2Rainer Gerhards2011-06-211-4/+8
| | | | | | | | | | | | | | | | | | At least one case where this can occur is during thread shutdown, which may be initiated by lower activity. In most cases, this is quite unlikely to happen. However, if it does, data structures may be corrupted which could lead to fatal failure and segfault. I detected this via a testbench test, not a user report. But I assume that some users may have had unreproducable aborts that were cause by this bug.
* | Merge branch 'v5-stable' into v5-develRainer Gerhards2011-05-111-1/+5
|\|
| * Merge branch 'v4-stable' into v5-stableRainer Gerhards2011-05-111-1/+5
| |\ | | | | | | | | | | | | Conflicts: runtime/queue.c
| | * bugfix: invalid processing in QUEUE_FULL conditionRainer Gerhards2011-05-111-2/+6
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | If the the multi-submit interface was used and a QUEUE_FULL condition occured, the failed message was properly destructed. However, the rest of the input batch, if it existed, was not processed. So this lead to potential loss of messages and a memory leak. The potential loss of messages was IMHO minor, because they would have been dropped in most cases due to the queue remaining full, but very few lucky ones from the batch may have made it. Anyhow, this has now been changed so that the rest of the batch is properly tried to be enqueued and, if not possible, destructed.
| | * some cleanup based on clang static analyzer resultsRainer Gerhards2010-12-161-3/+2
| | |
* | | better handling of queue i/o errors in disk queues.Rainer Gerhards2011-05-031-6/+59
|/ / | | | | | | | | | | | | | | This is kind of a bugfix, but a very intrusive one, thus it goes into the devel version first. Right now, "file not found" is handled and leads to the new emergency mode, in which disk action is stopped and the queue run in direct mode. An error message is emited if this happens.
* | stop adding data to DA queue when low watermark has been reachedRainer Gerhards2011-03-301-0/+4
| | | | | | | | | | potentially closes: http://bugzilla.adiscon.com/show_bug.cgi?id=241 But needs more verification.
* | Merge branch 'v5-stable' into v5-betaRainer Gerhards2011-02-251-0/+5
|\ \ | | | | | | | | | | | | Conflicts: ChangeLog
| * | bugfix: memory leak when $RepeatedMsgReduction on was usedRainer Gerhards2011-02-251-0/+5
| | | | | | | | | | | | bug tracker: http://bugzilla.adiscon.com/show_bug.cgi?id=225
* | | bugfix: very long running actions could prevent shutdown under some ↵Rainer Gerhards2011-02-111-1/+1
| | | | | | | | | | | | | | | | | | circumstances This has now been solved, at least for common situations.
* | | removed no longer needed codeRainer Gerhards2011-02-111-2/+0
| | |
* | | bugfix: queue engine did not properly slow down inputs in FULL_DELAY mode...Rainer Gerhards2011-02-111-1/+12
| | | | | | | | | | | | | | | | | | ...when in disk-assisted mode. This especially affected imfile, which created unnecessarily queue files if a large set of input file data was to process.
* | | Merge branch 'v5-stable' into v5-develRainer Gerhards2010-12-171-1/+1
|\| | | | | | | | | | | | | | | | | | | | Conflicts: ChangeLog configure.ac doc/manual.html
| * | bugfix: batch processing flagged invalid message as "bad" under some ↵Rainer Gerhards2010-12-161-1/+1
| | | | | | | | | | | | | | | | | | circumstances also fixed some cosmetic nits
* | | improved statistics-gathering subsystemRainer Gerhards2010-09-131-0/+32
|/ / | | | | | | | | | | | | | | ... well, actually this is a first real implementation of this subsystem. I have added a counter registry, a way to access the countres (as readable string) and a way to define and maintem them. Also, module impstats has been updated to utilize the new system. Finally, I added some counters. I hope that this sets the baseline for useful future enhancements.
* | fixed a couple of regressionsRainer Gerhards2010-06-231-1/+6
| | | | | | | | | | | | | | | | by implementing some code that was missing so far ;) as well as finding some real bugs. I also did some general cleanup, removing debug strings and such. This code should be fairly OK to use, except when "exec only when previous action was suspended" is used -- this is NOT yet re-implemented in the tuned engine.
* | milestone(BUGGY): batch now pushed down to actionRainer Gerhards2010-06-151-2/+39
| | | | | | | | | | | | | | at least in important cases (not for non-direct action queues and some other minor things). This version is definitely buggy, but may be tried with success on a non-production system. I will continue to work on the correctness, but needed to commit now to get a baseline.
generated by cgit v1.2.3 (git 2.25.1) at 2025-07-05 08:16:10 +0000