Mailing List Archive

rsyslog impstats disk-assisted queue size/enqueued counters
Just discovered not expected behavior.
The DA queue size counter was changed, without change in enqueued counter.

~$ grep "Jan 15 12:23" /var/log/remotelogs/lin/rsyslog-lin.stats|grep main
Jan 15 12:23:07 127.0.0.1 syslog.debug rsyslogd-pstats:main Q[DA]:
origin=core.queue size=0 enqueued=3244357 full=0 discarded.full=0
discarded.nf=0 maxqsize=69184
Jan 15 12:23:07 127.0.0.1 syslog.debug rsyslogd-pstats:main Q:
origin=core.queue size=20 enqueued=1918753024 full=0 discarded.full=0
discarded.nf=0 maxqsize=7000
Jan 15 12:23:22 127.0.0.1 syslog.debug rsyslogd-pstats:main Q[DA]:
origin=core.queue size=22946 enqueued=3270967 full=0 discarded.full=0
discarded.nf=0 maxqsize=69184
Jan 15 12:23:22 127.0.0.1 syslog.debug rsyslogd-pstats:main Q:
origin=core.queue size=19 enqueued=1918815373 full=0 discarded.full=0
discarded.nf=0 maxqsize=7000
Jan 15 12:23:37 127.0.0.1 syslog.debug rsyslogd-pstats:main Q[DA]:
origin=core.queue size=0 enqueued=3270967 full=0 discarded.full=0
discarded.nf=0 maxqsize=69184
Jan 15 12:23:37 127.0.0.1 syslog.debug rsyslogd-pstats:main Q:
origin=core.queue size=19 enqueued=1918847027 full=0 discarded.full=0
discarded.nf=0 maxqsize=7000
Jan 15 12:23:52 127.0.0.1 syslog.debug rsyslogd-pstats:main Q[DA]:
origin=core.queue size=0 enqueued=3270967 full=0 discarded.full=0
discarded.nf=0 maxqsize=69184
Jan 15 12:23:52 127.0.0.1 syslog.debug rsyslogd-pstats:main Q:
origin=core.queue size=19 enqueued=1918852425 full=0 discarded.full=0
discarded.nf=0 maxqsize=7000

When the DA enqueued counter gets updated? Why it was not updated in
this situation?

Peter
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
Re: rsyslog impstats disk-assisted queue size/enqueued counters [ In reply to ]
How to charge impstats module?


On 1/15/19 1:48 PM, Peter Viskup via rsyslog wrote:
> Just discovered not expected behavior.
> The DA queue size counter was changed, without change in enqueued counter.
>
> ~$ grep "Jan 15 12:23" /var/log/remotelogs/lin/rsyslog-lin.stats|grep main
> Jan 15 12:23:07 127.0.0.1 syslog.debug rsyslogd-pstats:main Q[DA]:
> origin=core.queue size=0 enqueued=3244357 full=0 discarded.full=0
> discarded.nf=0 maxqsize=69184
> Jan 15 12:23:07 127.0.0.1 syslog.debug rsyslogd-pstats:main Q:
> origin=core.queue size=20 enqueued=1918753024 full=0 discarded.full=0
> discarded.nf=0 maxqsize=7000
> Jan 15 12:23:22 127.0.0.1 syslog.debug rsyslogd-pstats:main Q[DA]:
> origin=core.queue size=22946 enqueued=3270967 full=0 discarded.full=0
> discarded.nf=0 maxqsize=69184
> Jan 15 12:23:22 127.0.0.1 syslog.debug rsyslogd-pstats:main Q:
> origin=core.queue size=19 enqueued=1918815373 full=0 discarded.full=0
> discarded.nf=0 maxqsize=7000
> Jan 15 12:23:37 127.0.0.1 syslog.debug rsyslogd-pstats:main Q[DA]:
> origin=core.queue size=0 enqueued=3270967 full=0 discarded.full=0
> discarded.nf=0 maxqsize=69184
> Jan 15 12:23:37 127.0.0.1 syslog.debug rsyslogd-pstats:main Q:
> origin=core.queue size=19 enqueued=1918847027 full=0 discarded.full=0
> discarded.nf=0 maxqsize=7000
> Jan 15 12:23:52 127.0.0.1 syslog.debug rsyslogd-pstats:main Q[DA]:
> origin=core.queue size=0 enqueued=3270967 full=0 discarded.full=0
> discarded.nf=0 maxqsize=69184
> Jan 15 12:23:52 127.0.0.1 syslog.debug rsyslogd-pstats:main Q:
> origin=core.queue size=19 enqueued=1918852425 full=0 discarded.full=0
> discarded.nf=0 maxqsize=7000
>
> When the DA enqueued counter gets updated? Why it was not updated in
> this situation?
>
> Peter
> _______________________________________________
> rsyslog mailing list
> http://lists.adiscon.net/mailman/listinfo/rsyslog
> http://www.rsyslog.com/professional-services/
> What's up with rsyslog? Follow https://twitter.com/rgerhards
> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
Re: rsyslog impstats disk-assisted queue size/enqueued counters [ In reply to ]
* alberto [20/01/2019 12:18] :
>
> How to charge impstats module?

There are a number of ways you can do this, depending on where you want to log the output of impstats.

One possibility is to put the following line in your rsyslog.conf:

module(load="impstats" interval="600" severity="7")

but you can check out the module's options in the documentation:
https://www.rsyslog.com/doc/v8-stable/configuration/modules/impstats.html

Note that you must load impstats right at the top of rsyslog.conf,
otherwise stats may not get turned on in all places.

Emmanuel
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
Re: rsyslog impstats disk-assisted queue size/enqueued counters [ In reply to ]
Sorry, my bad English...

I wanted to say:

How do you load the module?

module(load="impstats" ResetCounters="on"
log.file="/var/log/rsyslog_stats.log")

Do you load with "ResetCounters" parameter?



On 20/1/19 12:41, Emmanuel Seyman wrote:
> * alberto [20/01/2019 12:18] :
>> How to charge impstats module?
> There are a number of ways you can do this, depending on where you want to log the output of impstats.
>
> One possibility is to put the following line in your rsyslog.conf:
>
> module(load="impstats" interval="600" severity="7")
>
> but you can check out the module's options in the documentation:
> https://www.rsyslog.com/doc/v8-stable/configuration/modules/impstats.html
>
> Note that you must load impstats right at the top of rsyslog.conf,
> otherwise stats may not get turned on in all places.
>
> Emmanuel
> _______________________________________________
> rsyslog mailing list
> http://lists.adiscon.net/mailman/listinfo/rsyslog
> http://www.rsyslog.com/professional-services/
> What's up with rsyslog? Follow https://twitter.com/rgerhards
> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
Re: rsyslog impstats disk-assisted queue size/enqueued counters [ In reply to ]
* Alberto [20/01/2019 14:27] :
>
> How do you load the module?

I use:

module(load="impstats"
interval="86400"
severity="7"
log.syslog="off"
# need to turn log stream logging off!
log.file="/var/log/rsyslog-stats.log")

> Do you load with "ResetCounters" parameter?

Nope.

Emmanuel
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
Re: rsyslog impstats disk-assisted queue size/enqueued counters [ In reply to ]
The load and configuration is done like this:

$ModLoad impstats
$PStatInterval 15
$PStatSeverity 7

Peter

On Sun, Jan 20, 2019 at 5:09 PM Emmanuel Seyman <emmanuel@seyman.fr> wrote:
>
> * Alberto [20/01/2019 14:27] :
> >
> > How do you load the module?
>
> I use:
>
> module(load="impstats"
> interval="86400"
> severity="7"
> log.syslog="off"
> # need to turn log stream logging off!
> log.file="/var/log/rsyslog-stats.log")
>
> > Do you load with "ResetCounters" parameter?
>
> Nope.
>
> Emmanuel
> _______________________________________________
> rsyslog mailing list
> http://lists.adiscon.net/mailman/listinfo/rsyslog
> http://www.rsyslog.com/professional-services/
> What's up with rsyslog? Follow https://twitter.com/rgerhards
> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
Re: rsyslog impstats disk-assisted queue size/enqueued counters [ In reply to ]
I believe that with the old syntax, you have to set all the values before you
load the module, not after.

This is one of the reasons why you should really use the new syntax. It makes it
much clearer what you are doing.

David Lang

On Tue, 5 Feb 2019, Peter Viskup via rsyslog wrote:

> The load and configuration is done like this:
>
> $ModLoad impstats
> $PStatInterval 15
> $PStatSeverity 7
>
> Peter
>
> On Sun, Jan 20, 2019 at 5:09 PM Emmanuel Seyman <emmanuel@seyman.fr> wrote:
>>
>> * Alberto [20/01/2019 14:27] :
>>>
>>> How do you load the module?
>>
>> I use:
>>
>> module(load="impstats"
>> interval="86400"
>> severity="7"
>> log.syslog="off"
>> # need to turn log stream logging off!
>> log.file="/var/log/rsyslog-stats.log")
>>
>>> Do you load with "ResetCounters" parameter?
>>
>> Nope.
>>
>> Emmanuel
>> _______________________________________________
>> rsyslog mailing list
>> http://lists.adiscon.net/mailman/listinfo/rsyslog
>> http://www.rsyslog.com/professional-services/
>> What's up with rsyslog? Follow https://twitter.com/rgerhards
>> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
> _______________________________________________
> rsyslog mailing list
> http://lists.adiscon.net/mailman/listinfo/rsyslog
> http://www.rsyslog.com/professional-services/
> What's up with rsyslog? Follow https://twitter.com/rgerhards
> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
>
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
Re: rsyslog impstats disk-assisted queue size/enqueued counters [ In reply to ]
Thank you, David.

The stat interval and severity are set accordingly, the "issue" is
with the counters not changed as it was expected. Just realized it
were my wrong thought.

The line "size=22946 enqueued=3270967" means the enqueued counter
already contains the amount of messages in "size". Therefore in the
next line the enqueued was not changed.

Sorry, disregard.

Peter

On Tue, Feb 5, 2019 at 11:12 PM David Lang <david@lang.hm> wrote:
>
> I believe that with the old syntax, you have to set all the values before you
> load the module, not after.
>
> This is one of the reasons why you should really use the new syntax. It makes it
> much clearer what you are doing.
>
> David Lang
>
> On Tue, 5 Feb 2019, Peter Viskup via rsyslog wrote:
>
> > The load and configuration is done like this:
> >
> > $ModLoad impstats
> > $PStatInterval 15
> > $PStatSeverity 7
> >
> > Peter
> >
> > On Sun, Jan 20, 2019 at 5:09 PM Emmanuel Seyman <emmanuel@seyman.fr> wrote:
> >>
> >> * Alberto [20/01/2019 14:27] :
> >>>
> >>> How do you load the module?
> >>
> >> I use:
> >>
> >> module(load="impstats"
> >> interval="86400"
> >> severity="7"
> >> log.syslog="off"
> >> # need to turn log stream logging off!
> >> log.file="/var/log/rsyslog-stats.log")
> >>
> >>> Do you load with "ResetCounters" parameter?
> >>
> >> Nope.
> >>
> >> Emmanuel
> >> _______________________________________________
> >> rsyslog mailing list
> >> http://lists.adiscon.net/mailman/listinfo/rsyslog
> >> http://www.rsyslog.com/professional-services/
> >> What's up with rsyslog? Follow https://twitter.com/rgerhards
> >> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
> > _______________________________________________
> > rsyslog mailing list
> > http://lists.adiscon.net/mailman/listinfo/rsyslog
> > http://www.rsyslog.com/professional-services/
> > What's up with rsyslog? Follow https://twitter.com/rgerhards
> > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
> >
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.