binkd logging filenames...

[mark lewis]

call it a st00pid question but...

does binkd recognize log filenames like

bd%Y%M

so that it will automatically roll over the log files when the month and/or
year changes?

i just used %Y and %M in the example but i would hope that they would be the 4
digit year and 2 digit month (with leading zero padding for months less than
10)...

If binkd does do this, it isn't documented anywhere that i've found... if binkd
does NOT do this, does it recognize piped output (like apache) so that one
might feed the log output to a logging program that can/will do this??

ie: LOG "|foo.bar binkd%Y%m.log"

where the log output is fed to foo.bar and the binkd&Y%m.log is passed as a
command line option so that foo.bar knows what file to write to...

)\/(ark

[mark lewis]

no one has any ideas or comments on how to handle this??? i'm using
binkd/1.0a-446/OS2 at this time...


ml> call it a st00pid question but...

ml> does binkd recognize log filenames like

ml> bd%Y%m

ml> so that it will automatically roll over the log files when the
ml> month and/or year changes?

ml> i just used %Y and %m in the example but i would hope that they
ml> would be the 4 digit year and 2 digit month (with leading zero
ml> padding for months less than 10)...

ml> If binkd does do this, it isn't documented anywhere that i've
ml> found... if binkd does NOT do this, does it recognize piped output
ml> (like apache) so that one might feed the log output to a logging
ml> program that can/will do this??

ml> ie: LOG "|foo.bar binkd%Y%m.log"

ml> where the log output is fed to foo.bar and the binkd&Y%m.log is
ml> passed as a command line option so that foo.bar knows what file to
ml> write to...

)\/(ark

[Jame Clay]

Hi mark!

25 Sep 10 14:36, you wrote to all:

ml> no one has any ideas or comments on how to handle this??? i'm using
ml> binkd/1.0a-446/OS2 at this time...

It's not something I've looked at since I do all log file maintenance in
regular (daily/weekly/monthly) maintenance scripts and all of the other log
files are all handled in the same way (previous days log gets renamed from
*.log to *.Day, then copied to *.day_of_week. Weekly; daily logs get cat'ed to
a *.Week log file. Other setups, depending on the system), so having such a
capability in BinkD hasn't been needed...


Jame

[Stas Degteff]

Hello mark.

25 Sep 10 14:36, you wrote to all:

ml> no one has any ideas or comments on how to handle this??? i'm using
ml> binkd/1.0a-446/OS2 at this time...


you may use "logrotate" or another log rotate utility. Or you may user RAR
archiver for compress log with archive's name generated via template (or You
may user another archiver).

ml>> call it a st00pid question but...

ml>> does binkd recognize log filenames like

ml>> bd%Y%m

ml>> so that it will automatically roll over the log files when the
ml>> month and/or year changes?


Stas
Jabber-ID: ***@grumbler.org
GPG key 0x72186DB9 (keyserver: hkp://wwwkeys.eu.pgp.net)
... Golded+, Husky & RNTrack maintainer, Binkd developer&webmaster

[Andrew Leary]

Hello Stas!

Monday September 27 2010 04:16, Stas Degteff wrote to mark lewis:

SD> you may use "logrotate" or another log rotate utility. Or you may user
SD> RAR archiver for compress log with archive's name generated via
SD> template (or You may user another archiver).

On a related thought... Does BinkD support a semaphore file to shut down?

Andrew

[Stas Degteff]

Hello Andrew.

26 Sep 10 20:40, you wrote to me:


SD>> you may use "logrotate" or another log rotate utility. Or you may
SD>> user RAR archiver for compress log with archive's name generated
SD>> via template (or You may user another archiver).

AL> On a related thought... Does BinkD support a semaphore file to shut
AL> down?

No. But for log maintance is not need restart binkd. because binkd open log
file before write line and close it after.


Stas
Jabber-ID: ***@grumbler.org
GPG key 0x72186DB9 (keyserver: hkp://wwwkeys.eu.pgp.net)
... Golded+, Husky & RNTrack maintainer, Binkd developer&webmaster

[Andrew Leary]

Hello Stas.

27 Sep 10 13:05, you wrote to me:

SD> No. But for log maintance is not need restart binkd. because binkd
SD> open log file before write line and close it after.

OK, so the only potential problem is if BinkD tries to make a log entry while
the archiver is compressing the logfile. That should be easy to work around;
I'll just move the logfile somewhere else and compress it from there.

Regards,

Andrew

[mark lewis]

SD>> you may use "logrotate" or another log rotate utility. Or you may
SD>> user RAR archiver for compress log with archive's name generated
SD>> via template (or You may user another archiver).

AL> On a related thought... Does BinkD support a semaphore file to shut
AL> down?

SD> No.

that was something i've been wondering, too... it would be nice to have a way
to signal binkd to exit via an external source... in my case, i'm on OS/2 and
have thought about the times that i need to shutdown from remote and can do
that to most everything except binkd...

SD> But for log maintance is not need restart binkd. because binkd
SD> open log file before write line and close it after.

that answers my other questions :)

i've had some apps that, if a 5Meg file is snatched from under them, will
create a 5Meg blank one and then append their entries... something to do with
keeping a count of the line they are one or some such...

)\/(ark

[Stas Degteff]

Hello mark.

29 Sep 10 18:03, you wrote to me:

ml> that was something i've been wondering, too... it would be nice to
ml> have a way to signal binkd to exit via an external source... in my
ml> case, i'm on OS/2 and have thought about the times that i need to
ml> shutdown from remote and can do that to most everything except
ml> binkd...

You may use OS/2 system semaphores to tell binkd to exit.


Stas
Jabber-ID: ***@grumbler.org
GPG key 0x72186DB9 (keyserver: hkp://wwwkeys.eu.pgp.net)
... Golded+, Husky & RNTrack maintainer, Binkd developer&webmaster

[mark lewis]

ml> that was something i've been wondering, too... it would be nice to
ml> have a way to signal binkd to exit via an external source... in my
ml> case, i'm on OS/2 and have thought about the times that i need to
ml> shutdown from remote and can do that to most everything except
ml> binkd...

SD> You may use OS/2 system semaphores to tell binkd to exit.

ahh! that sounds like something i might be able to use... on Warp3?? can you
provide a few more details, please?

)\/(ark

[mark lewis]

ml> that was something i've been wondering, too... it would be nice to
ml> have a way to signal binkd to exit via an external source... in my
ml> case, i'm on OS/2 and have thought about the times that i need to
ml> shutdown from remote and can do that to most everything except
ml> binkd...

SD> You may use OS/2 system semaphores to tell binkd to exit.

ml> ahh! that sounds like something i might be able to use... on
ml> Warp3?? can you provide a few more details, please?

i've looked a little bit and not found any binkd specific semaphores listed :?
i only want binkd to exit when one is triggered...

i am also happy to report that i have figured out the logging thing that
brought us the recent discussion :) it seems to work quite well when done
manually... i just need a way to know if binkd is in a session or not before
completely automating it... that and the above will enable me to shutdown binkd
a few minutes before midnight so that there's no danger of having a session
crossing the midnight boundary... that will enable me to have daily and\or
monthly stats that are as accurate as can be done without loosing data counts
for sessions that cross the day or month boundary :D

)\/(ark

[Gert Koefoed Andersen]

Hello mark!

Fri Oct 01 2010, mark lewis wrote to Stas Degteff:

ml>> that was something i've been wondering, too... it would be nice to
ml>> have a way to signal binkd to exit via an external source... in my
ml>> case, i'm on OS/2 and have thought about the times that i need to
ml>> shutdown from remote and can do that to most everything except
ml>> binkd...

SD>> You may use OS/2 system semaphores to tell binkd to exit.

ml>> ahh! that sounds like something i might be able to use... on
ml>> Warp3?? can you provide a few more details, please?

ml>i've looked a little bit and not found any binkd specific semaphores
ml>listed :? i only want binkd to exit when one is triggered...

ml>i am also happy to report that i have figured out the logging thing
ml>that brought us the recent discussion :) it seems to work quite well
ml>when done manually... i just need a way to know if binkd is in a
ml>session or not before completely automating it... that and the above
ml>will enable me to shutdown binkd a few minutes before midnight so that
ml>there's no danger of having a session crossing the midnight boundary...
ml>that will enable me to have daily and\or monthly stats that are as
ml>accurate as can be done without loosing data counts for sessions that
ml>cross the day or month boundary :D

Have you tried on think to make binkd exit after incoming mail and execute some
script files for mail processing.
It can to be triggered by file request file as .req
Try use the exec functions

Take care,
Gert

- Get the best with linux -

[Ross Cassell]

Hello Gert!

04 Oct 10 18:07, you wrote to mark lewis:

GA> Have you tried on think to make binkd exit after incoming mail and
GA> execute some script files for mail processing. It can to be triggered
GA> by file request file as .req Try use the exec functions

exec will launch a separate process.

==
Ross
Fidonet Feeds Or Fidonet In Your Newsreader: http://www.easternstar.info
E-mail: ross(at)cassell(dot)us | Other Places: http://links.cassell.us

I can see November from my House!

And so, my fellow Americans: ask not what your country can do for you -
ask what you can do for your country.. JFK (Right Wing Propoganda)

... The opinions expressed are not approved by the DNC, ACLU or the NAACP!

[Gert Koefoed Andersen]

* Reply to message originally in area CarbonArea

Hello Ross!

Mon Oct 04 2010, Ross Cassell wrote to Gert Koefoed Andersen:

Yes and I have my linux binkd to launch process for
incoming .pkt files
incoming zipped mail pack
incoming game files

GA>> Have you tried on think to make binkd exit after incoming mail and
GA>> execute some script files for mail processing. It can to be triggered
GA>> by file request file as .req Try use the exec functions

RC>exec will launch a separate process.

RC>http://www.easternstar.info
RC>E-mail: ross(at)cassell(dot)us | Other Places: http://links.cassell.us

RC>I can see November from my House!

RC>And so, my fellow Americans: ask not what your country can do for you -
RC>ask what you can do for your country.. JFK (Right Wing Propoganda)

RC>... The opinions expressed are not approved by the DNC, ACLU or the
RC>NAACP!
RC>-+- GoldED+/LNX 1.1.5-b20060121
RC> + Origin: The Eastern Star - Spartanburg, SC USA (1:123/456)


Take care,
Gert

- Get the best with linux -

[mark lewis]

GKA> Have you tried on think to make binkd exit after incoming mail and
GKA> execute some script files for mail processing.
GKA> It can to be triggered by file request file as .req
GKA> Try use the exec functions

no, i haven't thought about that... all of my processing is done in the
background on this hybrid FD/binkd system ;) binkd is loaded as a server daemon
and waits for inbound connections or mail waiting in an outbox to send... other
than that, it sleeps its time away...

)\/(ark

[Gert Koefoed Andersen]

* Reply to message originally in area CarbonArea

Hello mark!

Mon Oct 04 2010, mark lewis wrote to Gert Koefoed Andersen:

GKA>> Have you tried on think to make binkd exit after incoming mail and
GKA>> execute some script files for mail processing.
GKA>> It can to be triggered by file request file as .req
GKA>> Try use the exec functions

ml>no, i haven't thought about that... all of my processing is done in the
ml>background on this hybrid FD/binkd system ;) binkd is loaded as a
ml>server daemon and waits for inbound connections or mail waiting in an
ml>outbox to send... other than that, it sleeps its time away...

exec i binkd kan trigger to perform and run script files for you.
Trigger with a delay og incoming mail, both of .pkt and zipped mail packs as
.tu0 types
It can too trigger with incming league game files

Take care,
Gert

- Get the best with linux -

[mark lewis]

GKA>> Have you tried on think to make binkd exit after incoming mail and
GKA>> execute some script files for mail processing.
GKA>> It can to be triggered by file request file as .req
GKA>> Try use the exec functions

ml>no, i haven't thought about that... all of my processing is done in the
ml>background on this hybrid FD/binkd system ;) binkd is loaded as a
ml>server daemon and waits for inbound connections or mail waiting in an
ml>outbox to send... other than that, it sleeps its time away...

GKA> exec i binkd kan trigger to perform and run script files for you.
GKA> Trigger with a delay og incoming mail, both of .pkt and zipped
GKA> mail packs as .tu0 types
GKA> It can too trigger with incming league game files

yes, but i do not need to use that capability... i only need to create a "flag
file" to indicate that mail files have arrived and then my background processes
take over from there...

binkd gets loaded and runs continously without exiting until the system has to
shutdown or reboot for some reason ;)

)\/(ark

[Ross Cassell]

Hello mark!

05 Oct 10 19:53, you wrote to Gert Koefoed Andersen:

ml> yes, but i do not need to use that capability... i only need to create
ml> a "flag file" to indicate that mail files have arrived and then my
ml> background processes take over from there...

ml> binkd gets loaded and runs continously without exiting until the
ml> system has to shutdown or reboot for some reason ;)

you can use the flag keyword:

flag d:\\fidonet\\flags\\newmail.flg *.su? *.mo? *.tu? *.we? *.th? *.fr? *.sa?
*.pkt *.tic

under Os/2, I believe you still have to use the double backslashes..

I dont do this anymore but I used to do this under Windows, using a program
called Robotask that had a task I could use to monitor for the creation or
update of a semaphore file, in this case, see above, it would then run the
batch file to toss the mail.

The reason I dont do this anymore is I had too many occasions to find process
collisions going on, in which I would get mail pkts from different links within
seconds of each other, the older tasks would run and subsequent tasks would
have the tosser sitting idle because it detected the older task, in some cases
I had 20 or so instances of 4nt.exe sitting idle.. (Robotask forks these into
the background) So now I simply execute a timed event, every five minutes that
runs a batch file that has some "if exist ..... goto this .... goto end"
statements.

Now on my linux box, for the jamnntpd server, I run incron that detects a
semaphore file updated my jamnntpd to detect when a message was posted, then
incron runs the script to have a scan run... When its copy of binkd receives
mail, I do use the flag keyword, which will have incron execute a script to
toss.

This isnt so much a problem for the jamnntpd node, as it would be for the mail
hub node.

==
Ross
Fidonet Feeds Or Fidonet In Your Newsreader: http://www.easternstar.info
E-mail: ross(at)cassell(dot)us | Other Places: http://links.cassell.us

I can see November from my House!

And so, my fellow Americans: ask not what your country can do for you -
ask what you can do for your country.. JFK (Right Wing Propoganda)

... Hope and Change, how is that working out for you?

[mark lewis]

ml> yes, but i do not need to use that capability... i only need to create
ml> a "flag file" to indicate that mail files have arrived and then my
ml> background processes take over from there...

ml> binkd gets loaded and runs continously without exiting until the
ml> system has to shutdown or reboot for some reason ;)

RC> you can use the flag keyword:

i do exactly that... i don't know how this thread has gotten changed from
rotating logs to exiting to process mail, either :?

RC> under Os/2, I believe you still have to use the double
RC> backslashes..

yes...

RC> I dont do this anymore but I used to do this under Windows, using a
RC> program called Robotask that had a task I could use to monitor for
RC> the creation or update of a semaphore file, in this case, see
RC> above, it would then run the batch file to toss the mail.

my system has a cron that runs a job every X minutes to check for inbound FTN
mail... another one that runs every Y minutes for outbound FTN mail and two
others that do the same for inbound and outbound internet and gated FTN mail ;)

RC> The reason I dont do this anymore is I had too many occasions to
RC> find process collisions going on, in which I would get mail pkts
RC> from different links within seconds of each other, the older tasks
RC> would run and subsequent tasks would have the tosser sitting idle
RC> because it detected the older task, in some cases I had 20 or so
RC> instances of 4nt.exe sitting idle.. (Robotask forks these into the
RC> background) So now I simply execute a timed event, every five
RC> minutes that runs a batch file that has some "if exist ..... goto
RC> this .... goto end" statements.

yep... i had the same early in my setup... now those tasks create special
semaphores that the others look for... if they exist, they exit and try again
later... only the task that creates the "i'm busy" semaphore can remove it...

RC> Now on my linux box, for the jamnntpd server, I run incron that
RC> detects a semaphore file updated my jamnntpd to detect when a
RC> message was posted, then incron runs the script to have a scan
RC> run... When its copy of binkd receives mail, I do use the flag
RC> keyword, which will have incron execute a script to toss.

yeah, my jamnntpd is working with the same message base files as my BBS, mailer
and tosser... it also creates the same indicator files as they do when new
messages are posted... the above mentioned outbound FTN mail scanning task
handles scanning the new messages out to send on to other FTN systems ;)

RC> This isnt so much a problem for the jamnntpd node, as it would be
RC> for the mail hub node.

i can see that :)

)\/(ark

[Jame Clay]

Ross,

Post by Ross Cassell
Now on my linux box, for the jamnntpd server, I run incron that detects a
semaphore file updated my jamnntpd to detect when a message was posted, then
incron runs the script to have a scan run... When its copy of binkd receives
mail, I do use the flag keyword, which will have incron execute a script to
toss.

Since I prefer 'On Demand' type processing, I've always used the BinkD
"exec" keyword for inbound mail processing on my Linux systems. (Wasn't using
BinkD back when I was running OS/2...) Have also used it for tic processing,
file requests, & such processing...



Jame

[Gert Koefoed Andersen]

* Reply to message originally in area CarbonArea

Hello mark!

Tue Oct 05 2010, mark lewis wrote to Gert Koefoed Andersen:

GKA>>> Have you tried on think to make binkd exit after incoming mail and
GKA>>> execute some script files for mail processing.
GKA>>> It can to be triggered by file request file as .req
GKA>>> Try use the exec functions

ml>>no, i haven't thought about that... all of my processing is done in the
ml>>background on this hybrid FD/binkd system ;) binkd is loaded as a
ml>>server daemon and waits for inbound connections or mail waiting in an
ml>>outbox to send... other than that, it sleeps its time away...

GKA>> exec i binkd kan trigger to perform and run script files for you.
GKA>> Trigger with a delay og incoming mail, both of .pkt and zipped
GKA>> mail packs as .tu0 types
GKA>> It can too trigger with incming league game files

ml>yes, but i do not need to use that capability... i only need to create
ml>a "flag file" to indicate that mail files have arrived and then my
ml>background processes take over from there...

ml>binkd gets loaded and runs continously without exiting until the system
ml>has to shutdown or reboot for some reason ;)

The first thing in binkd.cfg before using exec commands is use of make bindk to
create a file named toss.now
This can be set in binkd.cfg do do.


Take care,
Gert

- Get the best with linux -

[mark lewis]

ml>yes, but i do not need to use that capability... i only need to
ml>create a "flag file" to indicate that mail files have arrived and
ml>then my background processes take over from there...

ml>binkd gets loaded and runs continously without exiting until the system
ml>has to shutdown or reboot for some reason ;)

GKA> The first thing in binkd.cfg before using exec commands is use of
GKA> make bindk to create a file named toss.now
GKA> This can be set in binkd.cfg do do.

you don't understand... i'm already doing all of this! i do not need help to
exit or otherwise process incoming mail!

i was looking for was a way to have binkd exit for LOG FILE processing to avoid
loss of data in the stats... i have this covered and taken care of now that a
few hints were given ;)

thanks anyway! :)

)\/(ark

[Gert Koefoed Andersen]

Hello Gert Koefoed Andersen!

Wednesday October 06 2010 13:00, you wrote to me:

ml>> yes, but i do not need to use that capability... i only need to
ml>> create a "flag file" to indicate that mail files have arrived and
ml>> then my background processes take over from there...

ml>> binkd gets loaded and runs continously without exiting until the
ml>> system has to shutdown or reboot for some reason ;)

GKA>> The first thing in binkd.cfg before using exec commands is use
GKA>> of make bindk to create a file named toss.now This can be set in
GKA>> binkd.cfg do do.

ml> you don't understand... i'm already doing all of this! i do not need
ml> help to exit or otherwise process incoming mail!

ml> i was looking for was a way to have binkd exit for LOG FILE processing
ml> to avoid loss of data in the stats... i have this covered and taken
ml> care of now that a few hints were given ;)

ml> thanks anyway! :)

You're welcome.
Yo could have a script to do a copy binkd.log to a work directory and let you
stat processing for binkd be done on the directory and after the process is
finish delete the log files in the work directory then will you not loss
anything in the binkd.log file, it will still be used.

Take care
Gert Andersen



----------------------------------------------------------------------

[Gert Koefoed Andersen]

*** Answering a msg posted in area Carbon.Area (Carbons).

Hello Gert Koefoed Andersen!

Wednesday October 06 2010 13:00, you wrote to me:


ml>> yes, but i do not need to use that capability... i only need to
ml>> create a "flag file" to indicate that mail files have arrived and
ml>> then my background processes take over from there...

ml>> binkd gets loaded and runs continously without exiting until the
ml>> system has to shutdown or reboot for some reason ;)

GKA>> The first thing in binkd.cfg before using exec commands is use
GKA>> of make bindk to create a file named toss.now This can be set in
GKA>> binkd.cfg do do.

ml> you don't understand... i'm already doing all of this! i do not need
ml> help to exit or otherwise process incoming mail!

ml> i was looking for was a way to have binkd exit for LOG FILE processing
ml> to avoid loss of data in the stats... i have this covered and taken
ml> care of now that a few hints were given ;)

Welcome :)

A way on do it without not loosing any thing in the log file coudl be copy the
log file to a work place and do the stat process on this copied log and delete
the log when finish stat.

Take care
Gert Andersen



----------------------------------------------------------------------

[Jerry Schwartz]

Hello, mark...

Oct 06, 2010 at 13:00, mark lewis wrote to Gert Koefoed Andersen:


ml> i was looking for was a way to have binkd exit for LOG FILE
ml> processing to avoid loss of data in the stats... i have this covered
ml> and taken care of now that a few hints were given ;)

I use a Binkley event to roll the logs by renaming them. What works is a matter
of how your OS handles things, and I don't know what OS/2 does.

You need to find something that is an atomic operation, that is the key.

Regards,

Jerry Schwartz

mailto:***@comfortable.com
http://www.writebynight.com

[mark lewis]

ml> i was looking for was a way to have binkd exit for LOG FILE
ml> processing to avoid loss of data in the stats... i have this covered
ml> and taken care of now that a few hints were given ;)

JS> I use a Binkley event to roll the logs by renaming them.

right... the problem, on the surface, is that binkd doesn't have events and so
doesn't exit unless on receipt of mail...

JS> What works is a matter of how your OS handles things, and I don't
JS> know what OS/2 does.

i have found that i can snatch the log file right out from under binkd and get
the job done... now it is just a matter of timing...

JS> You need to find something that is an atomic operation, that is the
JS> key.

actually, i'm waiting on stas to remind me/us what the semaphores are that
binkd listens to on OS/2... that should allow me to knock binkd down a couple
of minutes before midnight and do what i want to do...

)\/(ark

[Paul Quinn]

Hi! mark,

On 29/09/10 17:03, you wrote to Stas Degteff:

AL>> On a related thought... Does BinkD support a semaphore file to shut
AL>> down?

SD>> No.

ml> that was something i've been wondering, too... it would be nice to
ml> have a way to signal binkd to exit via an external source... in my
ml> case, i'm on OS/2 and have thought about the times that i need to
ml> shutdown from remote and can do that to most everything except binkd...

That notion brought a stabbing pain to my backend. I recalled that it was
possible to do something like a shutdown from a command-line option, and found
this in an old version's doco file...

-----8<-----C-U-T--H-E-R-E----->8-----
-C
Binkd running with this option will exit with return code 3 when
configuration file is changed. Configuration file is checked on initiation of
an incoming connection.

[bug] binkd/OS2 compiled for EMX environment will not quit until all active
connections are closed.
-----8<-----C-U-T--H-E-R-E----->8-----

If you substitute a totally different (i.e., contents thereof) file for the
config file specified at startup then you may also substitute this notion as
the use of a semaphore file, c'est n'est pas?!?

However, I have to wonder at the utility of such an option's effect at -that-
particular point of operation of the server. At first glance it appears the
effect will be to refuse an incoming connection. (Yuck!)

If you do accept the mission... the timing of your actions to shutdown a
particular server would have to be impeccable, e.g. filecopy/touch the
configuration file and attempt a telnet to that server & port nearly
instantaneously. Caveat emptor. =:)

Cheers,
Paul.

.... Multi-tasking: Crashing both hard drives at once.

[mark lewis]

ml> no one has any ideas or comments on how to handle this??? i'm using
ml> binkd/1.0a-446/OS2 at this time...

SD> you may use "logrotate" or another log rotate utility. Or you may
SD> user RAR archiver for compress log with archive's name generated
SD> via template (or You may user another archiver).

does binkd need to be "bounced" after the log is snatched out from under it?

do i need to create a blank file of the same name or will binkd recreate it?

thanks!

)\/(ark