summaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* milestone commit(BUGGY): batch is now handed down to rule processingRainer Gerhards2010-06-106-45/+105
| | | | | | | | Now, the full batch is passed down to the rule, which then enqueues the elements as single messages. Note that this code has some known defects and needs more changes until it is correct again. This is primarily a commit to be able to return to a known-(somewhat)-good state.
* some cleanupRainer Gerhards2010-06-105-60/+24
| | | | | as well as some work in preparation of storing doAction params inside the batch
* fixed regression for omruleset use caseRainer Gerhards2010-06-102-6/+16
| | | | | I did not revert to using the action ppMsg data element, as one of the next steps is to remove it by an overall much better solution.
* Merge branch 'concurrent-output' into tmpRainer Gerhards2010-06-108-105/+162
|\
| * main msg q consumer now preprocesses messages before doing rule processingRainer Gerhards2010-06-094-43/+52
| | | | | | | | | | | | | | things like ACL check and message parsing. This leads to a greater level of concurrent processing. Beware, though, that this commit duplicates some messages. May be a regression from this or an earlier commit. I will soon sort out.
| * somewhat improved direct mode queue performanceRainer Gerhards2010-06-093-19/+42
| | | | | | | | | | ... but only for batch enqueues. This will not help much with the current code, but will play well with upcoming changes.
| * added support for high-performance action queue submission if not all mark ↵Rainer Gerhards2010-06-084-43/+68
| | | | | | | | | | | | | | | | | | | | messages should be logged this was previously not properly handeld. This is also the first occurence of a (real) CAS loop inside rsyslog. Note that the performance is now very well in the default configuration, and mark message directives are still correctly being handled. So this code looks close to final, but needs to have some bug cleanup as the testsuite shows.
* | fixing msg duplication & loss regression, causes slowdownRainer Gerhards2010-06-103-8/+8
|/ | | | | | | | messages could get lost or be duplicated due to non-proper sync of transactions. This is a notable slowdown again, but we know how to get back concurrency, it just takes "some" more programming. It is important now to come back to correct code, so that we can base further improvements on that.
* performance enhancement: implemented stage 1 firehose mode for actionsRainer Gerhards2010-06-083-13/+146
| | | | | | | | | | | ... plus some other tests, namely string generation in parallel to action processing. The code is not yet solid and not fully compatible to older versions. But it is good enough for an early commit and some early testing/gaining of experience. The optimization was done based on the fine-grained partitioning paradigm worked on the past couple of weeks -- seems to work out really great :)
* bugfix: regression caused more locking action in msg.c than necessaryRainer Gerhards2010-06-086-43/+39
| | | | also: bugfix: mutexes used to similate atomic instructions were not destructed
* finshed implementation of strgen modulesRainer Gerhards2010-06-0419-115/+705
| | | | | | and also provided four build-in modules for the most common use cases, hopefully resulting in a speedup of around 5% for typical rsyslog processing.
* first implementation of strgen interfaceRainer Gerhards2010-06-0114-64/+644
| | | | | and a first built-in strgen module. Some tweaks and more default strgens are needed, but the code doesn't look too bad ;)
* experimental commit: facility to generate template via C functionRainer Gerhards2010-06-013-7/+103
| | | | | | | | | | | | | | This was a test done to try to generate templates with C code, via a new (potentially to-be-implemented) class of template modules. We have a rough POC inside this code, and it showed around 5% or better speedup. So it semms worth continuing in this direction. Note that this experimental commit works correct, but does any template in the form of $template tpl,=somewhat will lead to fixed template expansion based on the default file format.
* Merge branch 'v4-devel'Rainer Gerhards2010-05-203-3/+4
|\
| * Merge branch 'v4-stable' into v4-develRainer Gerhards2010-05-203-3/+4
| |\ | | | | | | | | | | | | Conflicts: ChangeLog
| | * some doc fixes; incorrect config samples could cause confusionRainer Gerhards2010-05-203-3/+4
| | | | | | | | | | | | thanks to Anthony Edwards for pointing the problems out
* | | project status updateRainer Gerhards2010-05-201-4/+4
| | |
* | | fixed typo in docRainer Gerhards2010-05-201-1/+1
| | |
* | | preparing for 5.5.5v5.5.5Rainer Gerhards2010-05-203-3/+3
| | |
* | | fixed race conditions during queue shutdown (DA case, disks active)Rainer Gerhards2010-05-184-15/+33
| | |
* | | added new cancel-reduced action thread termination methodRainer Gerhards2010-05-175-3/+60
| | | | | | | | | | | | | | | | | | | | | | | | We now manage to cancel threads that block inside a retry loop to terminate without the need to cancel the thread. Avoiding cancellation helps keep the system complexity minimal and thus provides for better stability. This also solves some issues with improper shutdown when inside an action retry loop.
* | | some more cleanup and a nasty little bug i doDie()Rainer Gerhards2010-05-102-13/+15
| | |
* | | small cleanupRainer Gerhards2010-05-101-5/+0
| | |
* | | made ompgsql identify its version on loadRainer Gerhards2010-05-071-0/+1
| | |
* | | improved syncdemo tool - added "partition" mode...Rainer Gerhards2010-05-051-9/+47
| | | | | | | | | | | | | | | ... and also analyzed the resulting assembly code to find out weak spots for the test. Explanations and new suggestions added.
* | | updating project statusRainer Gerhards2010-05-032-8/+11
| | |
* | | Merge branch 'v4-devel'v5.5.4Rainer Gerhards2010-05-031-1/+1
|\| | | | | | | | | | | | | | | | | | | | Conflicts: ChangeLog configure.ac doc/manual.html
| * | preparing for 4.7.2v4.7.2Rainer Gerhards2010-05-033-3/+3
| | |
* | | preparing for 5.5.4 releaseRainer Gerhards2010-05-034-6/+7
| | |
* | | added semaphores to sync test scenarioRainer Gerhards2010-05-021-12/+32
| | |
* | | enhanced tool to test timing of sync methodsRainer Gerhards2010-05-021-29/+93
| | |
* | | fixed recent regression: did not compile on systems with atomic instructionsRainer Gerhards2010-04-291-1/+1
| | |
* | | solved some race condition in testbenchRainer Gerhards2010-04-292-1/+3
| | | | | | | | | | | | | | | Note that this was NOT a race in rsyslog, but only one in a test case. So it had no implications to the correctness of rsyslogd.
* | | adapted new atomic instruction emulation to v5 engineRainer Gerhards2010-04-278-34/+60
| | | | | | | | | | | | code did not compile after merge from v4
* | | Merge branch 'v4-devel' into masterRainer Gerhards2010-04-2717-221/+120
|\| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: runtime/Makefile.am runtime/atomic.h runtime/queue.c runtime/queue.h runtime/wti.c runtime/wti.h runtime/wtp.c runtime/wtp.h
| * | bugfix: problems with atomic operations emulationRainer Gerhards2010-04-2716-226/+129
| | | | | | | | | | | | | | | | | | replaced atomic operation emulation with new code. The previous code seemed to have some issue and also limited concurrency severely. The whole atomic operation emulation has been rewritten.
* | | adapted merged code to v5 engineRainer Gerhards2010-04-261-1/+1
| | |
* | | Merge branch 'v5-stable'Rainer Gerhards2010-04-265-12/+49
|\ \ \
| * | | cosmetic: removed left-over debug messageRainer Gerhards2010-04-261-1/+0
| | | |
| * | | added new test to testbenchRainer Gerhards2010-04-261-0/+3
| | | | | | | | | | | | | | | | ... had forgotten this step...
| * | | bugfix(kind of): output plugin retry behaviour could cause engine to loopRainer Gerhards2010-04-264-12/+47
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The rsyslog engine did not guard itself against output modules that do not properly convey back the tryResume() behaviour. This then leads to what looks like an endless loop. I consider this to be a bug of the engine not only because it should be hardened against plugin misbehaviour, but also because plugins may not be totally able to avoid this situation (depending on the type of and processing done by the plugin).
* | | | Merge branch 'v5-stable'Rainer Gerhards2010-04-263-3/+34
|\| | | | | | | | | | | | | | | | | | | Conflicts: tests/diag.sh
| * | | added testcase for problem with pipe without a readerRainer Gerhards2010-04-263-0/+34
| | | | | | | | | | | | | | | | | | | | | | | | | | | | bug tracker: http://bugzilla.adiscon.com/show_bug.cgi?id=186 Note that this adds the test case, but does not yet provide a solution (so make check will hang when executed). Fix will be done next.
* | | | Merge branch 'v4-devel' into tmpRainer Gerhards2010-04-263-1/+26
|\ \ \ \ | | |/ / | |/| |
| * | | added new $Sleep directive to hold processing for a couple of seconds during ↵Rainer Gerhards2010-04-263-1/+26
| | | | | | | | | | | | | | | | startup
* | | | Merge branch 'v5-stable' into masterRainer Gerhards2010-04-262-30/+43
|\ \ \ \ | | |/ / | |/| | | | | | | | | | Conflicts: ChangeLog
| * | | bugfix(minor): status variable was uninitializedRainer Gerhards2010-04-262-1/+9
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | However, this would have caused harm only if NO parser modules at all were loaded, which would lead to a defunctional configuration at all. And, even more important, this is impossible as two parser modules are built-in and thus can not be "not loaded", so we always have a minimum of two.
| * | | Merge branch 'v4-stable' into v5-stableRainer Gerhards2010-04-014-16/+24
| |\ \ \ | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: tools/syslogd.c
* | \ \ \ Merge branch 'v4-devel' into masterRainer Gerhards2010-04-233-4/+5
|\ \ \ \ \ | | |_|/ / | |/| | | | | | | | | | | | | | | | | | | | | | | Conflicts: ChangeLog configure.ac doc/manual.html
| * | | | cosmetic: prepared ChangeLog for next releaseRainer Gerhards2010-04-231-0/+2
| | | | |