[leafnode-list] Re: leafnode 2.0.0.alpha20060711a: cannot parse reply...

[Martin <virenfang@xxxxxxxx>]

On Sat, Aug 12, 2006 at 12:51:26PM +0200, Matthias Andree wrote:
> Martin <virenfang@xxxxxxxx> writes:
> 
> > Next "fetchnews"-run I got following output:
> >
> > | news.gmane.org: cannot parse reply to "GROUP
> > | gmane.linux.gentoo.web-user": "220 27322
> > | <200607271403.28703.ext-dirk.heinrichs@xxxxxxxxx> article"
> >
> > After this output, fetchnews quit.
> 
> Probably improper escaping of leading dots on a line in some earlier
> article.

After "GROUP"ing not even one article was fetched. Therefore there can't
be improper escaping of leading dots, I think.

> > Right after this, I retried with -vvv. There was no error given, so I
> > can't paste the output.
> 
> Try "fetchnews -vvvex 500". (Or perhaps more if said newsgroup is really
> high-traffic). If that doesn't reproduce it, one of the articles
> downloaded previously will probably be incomplete - dig out its
> Message-ID and post the ID here.

Having 3 or 4 servers in my leafnode/config, I appended "-S
news.gmane.org". The output is quite more strange than the above:

|gmane.editors.vim: 52 articles fetched (to 7175), 0 killed
|news.gmane.org: backing up gmane.linux.gentoo.user.german from 26933 to
|27433
|gmane.linux.gentoo.user.german: considering 516 articles 26933 - 27448,
|using XOVER
|gmane.linux.gentoo.user.german: XOVER: 516 seen, 388 I have, 0 filtered,
|128 to get
|gmane.linux.gentoo.user.german: will fetch 128 articles
|sent ARTICLE 27321 command, in pipe: 1
|sent ARTICLE 27322 command, in pipe: 2
|sent ARTICLE 27323 command, in pipe: 3
|sent ARTICLE 27324 command, in pipe: 4
|sent ARTICLE 27325 command, in pipe: 5
|Wrong reply to ARTICLE command: "423 Bad article number"
|gmane.linux.gentoo.user.german: 0 articles fetched (to 2804), 0 killed
|news.gmane.org: cannot parse reply to "GROUP
|gmane.linux.gentoo.web-user": "220 27322
|<200607271403.28703.ext-dirk.heinrichs@xxxxxxxxx> article"
|ERROR: FETCHNEWS MUST REFETCH THE WHOLE ACTIVE FILE NEXT RUN.
|REASON: could not successfully talk to all servers.
|wrote groupinfo with 8702 lines.
|fetchnews: 52 articles and 0 headers fetched, 1058 killed, 0 posted, in
|126 seconds

Using netcat I found out, that 2 of these article numbers are "wrong".

|# cat news.gmane.org
|GROUP gmane.linux.gentoo.user.german
|ARTICLE 27321
|ARTICLE 27323
|QUIT
|# netcat news.gmane.org nntp < news.gmane.org
|200 news.gmane.org InterNetNews NNRP server INN 2.4.1 ready (posting
|ok).
|211 27317 1 27448 gmane.linux.gentoo.user.german
|423 Bad article number
|423 Bad article number
|205 .

Articles 27320, 27319, 27322, 27324 and 27325 are sent as expected.

The error occurs also while sending just *one* "ARTICLE 27321" without
any more text after. Even without "QUIT" (manually killing of netcat
necessary) the same output from the server occurs.

According to RFC 977 an expected answer to "ARTICLE" is 423 (no such
article in this group). The text being sent by Gmane may not be as
precise as suggested by RFC 977, but the text should not be parsed by
the client. So the output seen in the log is not really correct: 

|Wrong reply to ARTICLE command: "423 Bad article number"

> > What more information is needed? Was this just an ordinary accident or
> > is there something wrong (not enough time for waiting)?
> 
> Probably the server sending garbage.

I suspected this, but I'm not sure any more.

> The log: what happened before that failure?

The servers before were without any special notice. ("store: no valid
newsgroups" not counted)

Then fetchnews connected to news.gmane.org. After reloading the
newsgroups list (8681 newsgroups) and complaining about name conflict
(gmane.comp.gnome.apps.Dia vs. gmane.comp.gnome.apps.dia) it got the
descriptions without any further notice. fetchnews loaded some
control.newgroup (store: no valid newsgroup), got some "real" groups and
then ...

|Aug 12 06:46:50 [fetchnews] gmane.linux.gentoo.user.german: considering
|117 articles 27316 - 27432, using XOVER
|Aug 12 06:46:52 [fetchnews] gmane.linux.gentoo.user.german: XOVER: 117
|seen, 0 I have, 0 filtered, 117 to get
|Aug 12 06:46:52 [fetchnews] gmane.linux.gentoo.user.german: will fetch
|117 articles
|Aug 12 06:46:53 [fetchnews] Wrong reply to ARTICLE command: "423 Bad
|article number"
|Aug 12 06:46:53 [fetchnews] gmane.linux.gentoo.user.german: 5 articles
|fetched (to 2804), 0 killed
|Aug 12 06:46:53 [fetchnews] news.gmane.org: cannot parse reply to "GROUP
|gmane.linux.gentoo.web-user": "220 27322
|<200607271403.28703.ext-dirk.heinrichs@xxxxxxxxx> article"
|Aug 12 06:46:53 [fetchnews] nntp.perl.org: connecting to port nntp

Hope this helps...

Martin
-- 
_______________________________________________
leafnode-list mailing list
leafnode-list@xxxxxxxxxxxxxxxxxxxxxxxxxxxx
https://www.dt.e-technik.uni-dortmund.de/mailman/listinfo/leafnode-list
http://leafnode.sourceforge.net/