Re: [leafnode-list] Fetchnews: Falling back and regrouping.

[Matthias Andree <ma@xxxxxxxxxxxxxxxxxxxxxxxxxxxx>]

"Michael O'Quinn" <michael@xxxxxxxxxxx> writes:

> On Tue, 2 Apr 2002, Matthias Andree wrote:
>
>> Joerg Dietrich schrieb am Montag, den 01. April 2002:
>> 
>> > On Sat, Mar 30, 2002 at 08:40:38PM +0100, Matthias Andree wrote:
>> > > How do we fix the "downloaded again" then without introducing additional
>> > > dependencies on Berkeley DB or gdbm? I cannot rewrite SERVERINFO for
>> > > each article downloaded.
>> > 
>> > Write SERVERINFO after any group is fetched. Or am I missing
>> > something?
>> 
>> I'm doing that in 1.9.21pre1, but it does not help if fetchnews aborts
>> before the group fetch is complete and articles on the leafnode machine
>> expire earlier than on the upstream, because we won't detect duplicates
>> in that case and refetch. That's why I am currently clamping maxage to
>> the groupexpire or expire if they are lower than the actual maxage.
>
> IHMO refetching is the lesser of two evils.

>From 1.9.21.rc1 on, you will be able to choose which evil you
prefer.

The default will be the new approach (limiting the maxage to the
expire), with "clamp_maxage=0" in your config file, leafnode will
instead log a warning and possibly refetch excessively after a crash.

-- 
Matthias Andree

-- 
leafnode-list@xxxxxxxxxxxxxxxxxxxxxxxxxxxx -- mailing list for leafnode
To unsubscribe, send mail with "unsubscribe" in the subject to the list