summaryrefslogtreecommitdiffstats
path: root/runtime/queue.h
Commit message (Collapse)AuthorAgeFilesLines
* Merge branch 'v7-devel'Rainer Gerhards2013-11-191-0/+1
|\
| * bugfix: legacy directive $ActionQueueWorkerThreads was not honoredRainer Gerhards2013-11-191-0/+1
| |
* | Merge branch 'master-ruleeng' into master-ruleeng-simdRainer Gerhards2013-11-071-1/+1
|\ \
| * | Merge branch 'master' into master-ruleengRainer Gerhards2013-11-071-1/+1
| |\| | | | | | | | | | | | | | | | Conflicts: runtime/wti.c runtime/wti.h
| | * cleanup no longer needed codeRainer Gerhards2013-11-071-1/+1
| | |
* | | cleanup no longer used codeRainer Gerhards2013-11-051-1/+0
| | |
* | | refactor bShutdownImmediate handlingRainer Gerhards2013-11-051-4/+3
| | |
* | | remove no longer needed codeRainer Gerhards2013-11-051-1/+0
|/ /
* | milestone: now shuffeling wti ptr correctly down to action handlerRainer Gerhards2013-10-271-2/+2
| | | | | | | | | | except if main queue is in direct mode -- this need smore work and thinking (probably via pthreads state variables, but let's see later)
* | milestone: calling sequence changed so that wti is passed to many functionsRainer Gerhards2013-10-261-2/+2
|/
* basic queue file encryptionRainer Gerhards2013-05-131-1/+1
|
* enable shuffling of crypto parameters down through queue definitionRainer Gerhards2013-05-101-3/+8
|
* Merge branch 'v7-stable-newmsglock' into master-newmsglockRainer Gerhards2012-12-061-0/+2
|\ | | | | | | | | | | | | Conflicts: runtime/msg.c runtime/queue.c tools/syslogd.c
| * fix missing functionality: ruleset(){} could not specify ruleset queueRainer Gerhards2012-11-301-0/+2
| | | | | | | | | | | | | | | | | | | | The "queue.xxx" parameter set was not supported, and legacy ruleset config statements did not work (by intention). The fix introduces the "queue.xxx" parameter set. It has some regression potential, but only for the new functionality. Note that using that interface it is possible to specify duplicate queue file names, which will cause trouble. This will be solved in v7.3, because there is a too-large regression potential for the v7.2 stable branch.
* | queue: file delete stream does no longer do real ioRainer Gerhards2012-11-191-2/+5
| | | | | | | | | | | | This stream is primarily used for state tracking, and has been modified to do just that. This results in considerable less io being done and the respective speedup.
* | queue: change generic msg ptr (pUsr) to be of msg_t typeRainer Gerhards2012-11-031-5/+5
| |
* | queue: change gerenic queue pUsr ptr to be action_tRainer Gerhards2012-11-031-2/+2
| | | | | | | | | | | | this was always action_t, but the initial design was more generic. We are making it specific now in order to gain better performance (after all, we did not need the generic engine in the past 8 years...)
* | generate disk .qi file once at queue constructionRainer Gerhards2012-11-021-0/+2
|/ | | | | ... instead of each time a file write happens. In some situations (very frequent sync), this can probably be a big performane win.
* debug log: emit (some) action queue parameters to debug logRainer Gerhards2012-07-051-0/+1
|
* Merge branch 'v5-stable-newstats'Rainer Gerhards2012-04-071-0/+1
|\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: action.c configure.ac doc/imuxsock.html plugins/imklog/imklog.c plugins/imptcp/imptcp.c plugins/imtcp/imtcp.c plugins/imudp/imudp.c plugins/imuxsock/imuxsock.c runtime/glbl.c runtime/glbl.h runtime/net.c runtime/ruleset.c tcpsrv.h tools/syslogd.c
| * Merge branch 'v5-stable' into v5-stable-newstatsRainer Gerhards2012-03-141-1/+1
| |\ | | | | | | | | | | | | | | | | | | Conflicts: plugins/imuxsock/imuxsock.c runtime/queue.c runtime/queue.h
| * | added configuration directives to customize queue light delay marksRainer Gerhards2012-02-211-0/+1
| | | | | | | | | | | | | | | $MainMsgQueueLightDelayMark, $ActionQueueLightDelayMark; both specify number of messages starting at which a delay happens.
| * | added instrumentationRainer Gerhards2011-12-191-0/+2
| | |
* | | Merge branch 'v6-stable'Rainer Gerhards2012-03-171-1/+1
|\ \ \ | | |/ | |/| | | | | | | | | | | | | Conflicts: plugins/imuxsock/imuxsock.c runtime/queue.c runtime/queue.h
| * | changed statsobj interface and added better docRainer Gerhards2012-03-141-1/+1
| |/
* | Merge branch 'v5-devel'Rainer Gerhards2011-12-191-0/+2
|\ \ | | | | | | | | | | | | | | | | | | Conflicts: ChangeLog action.c plugins/imudp/imudp.c
| * | more work on queue statistics counterRainer Gerhards2011-12-161-1/+2
| | |
| * | new stats counter "discarded" for queue objectRainer Gerhards2011-12-161-0/+1
| |/ | | | | | | Tells how many messages have been discarded due to queue full condition.
* | milestone: queue-params are properly initialized for action queuesRainer Gerhards2011-08-011-0/+1
| |
* | milestone: queue object now has a param handler for new conf interfaceRainer Gerhards2011-07-221-0/+3
|/ | | | ... and action queue defs use this new interface (but not yet the main queues)
* removed no longer needed codeRainer Gerhards2011-02-111-1/+0
|
* improved statistics-gathering subsystemRainer Gerhards2010-09-131-0/+6
| | | | | | | | ... well, actually this is a first real implementation of this subsystem. I have added a counter registry, a way to access the countres (as readable string) and a way to define and maintem them. Also, module impstats has been updated to utilize the new system. Finally, I added some counters. I hope that this sets the baseline for useful future enhancements.
* milestone(BUGGY): batch now pushed down to actionRainer Gerhards2010-06-151-0/+2
| | | | | | | at least in important cases (not for non-direct action queues and some other minor things). This version is definitely buggy, but may be tried with success on a non-production system. I will continue to work on the correctness, but needed to commit now to get a baseline.
* somewhat improved direct mode queue performanceRainer Gerhards2010-06-091-1/+3
| | | | | ... but only for batch enqueues. This will not help much with the current code, but will play well with upcoming changes.
* adapted new atomic instruction emulation to v5 engineRainer Gerhards2010-04-271-0/+1
| | | | code did not compile after merge from v4
* Merge branch 'v4-devel' into masterRainer Gerhards2010-04-271-0/+1
|\ | | | | | | | | | | | | | | | | | | | | | | Conflicts: runtime/Makefile.am runtime/atomic.h runtime/queue.c runtime/queue.h runtime/wti.c runtime/wti.h runtime/wtp.c runtime/wtp.h
| * bugfix: problems with atomic operations emulationRainer Gerhards2010-04-271-0/+1
| | | | | | | | | | | | replaced atomic operation emulation with new code. The previous code seemed to have some issue and also limited concurrency severely. The whole atomic operation emulation has been rewritten.
* | replaced data type "bool" by "sbool" because this created some portability ↵Rainer Gerhards2010-02-021-5/+5
| | | | | | | | issues
* | added the capability to have ruleset-specific main message queuesRainer Gerhards2009-10-271-2/+2
| | | | | | | | | | This offers considerable additional flexibility AND superior performance (in cases where multiple inputs now can avoid lock contention)
* | removed no longer needed flag variableRainer Gerhards2009-10-271-1/+0
| |
* | some cleanupRainer Gerhards2009-10-271-1/+0
| |
* | bugfix: message processing states were not set correctly in all casesRainer Gerhards2009-10-191-6/+0
| | | | | | | | | | | | however, this had no negative effect, as the message processing state was not evaluated when a batch was deleted, and that was the only case where the state could be wrong.
* | added some debug settings plus improved shutdown sequenceRainer Gerhards2009-10-131-4/+5
| | | | | | | | ... non-working version!
* | simplified startup of queue DA modeRainer Gerhards2009-07-201-1/+0
| |
* | further code simplificationRainer Gerhards2009-07-171-11/+0
| | | | | | | | | | | | | | | | | | ... could even remove one mutex by using a better algorithm. I think I also spotted some situation in which a hang could have happened. As I can't fix it in v4 and less without moving to the new engine, I make no effort in testing this out. Hangs occur during shutdown, only (if at all). The code changes should also result in some mild performance improvement. Some bug potential, but overall the bug potential should have been greatly reduced.
* | Merge branch 'omfile' into tmpRainer Gerhards2009-06-221-8/+8
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | This was a complex manual merge, especially in action.c. So if there occur some problems, this would be a good point to start troubleshooting. I run a couple of tests before commiting and they all went well. Conflicts: action.c action.h runtime/queue.c runtime/queue.h runtime/wti.c runtime/wti.h
| * removed uniprocessor optimizationRainer Gerhards2009-06-191-7/+6
| | | | | | | | | | | | ... as it was not even optimal on uniprocessors any longer ;) I keep the config directive in, maybe we can utilize it again at some later point in time (questionable).
| * further optimized message objectRainer Gerhards2009-06-171-0/+1
| | | | | | | | pri, facility and severity string generation simplified
* | Merge branch 'omfile' into v5-develRainer Gerhards2009-06-161-0/+2
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Note that this was NOT a trivial merge, and there may be some issues. This needs to be seen when we continue developing. Conflicts: runtime/msg.h runtime/obj.h runtime/queue.c runtime/srUtils.h runtime/stream.c runtime/stream.h runtime/wti.c tests/Makefile.am tools/omfile.c tools/syslogd.c
| * added capability to fsync() queue disk files for enhanced reliabilityRainer Gerhards2009-06-091-0/+2
| | | | | | | | | | | | | | also adds speed, because you do no longer need to run the whole file system in sync mode. New testbench and new config directives: - $MainMsgQueueSyncQueueFiles - $ActionQueueSyncQueueFiles