Newsbin Gets Behind With Importing Headers

Technical support and discussion of Newsbin Version 6 series.

Newsbin Gets Behind With Importing Headers

Postby Lee Thompson » Sun Jun 14, 2020 8:58 pm

Been having this problem on and off for some time but the past week it's been really annoying.

Newsbin Pro 6.82 - Build 5142
Windows 10.0.19041.329 (Enterprise)

USP: giganews

I have roughly 400 groups, and newsbin is set to update headers every 81 minutes.

Issue detail

The issue is the headers in the Import folder will sometimes stack up, sometimes with the oldest are more than 20 hours old. There's nothing wrong with them, if I exit Newsbin, move all the files from Import to a temporary folder and feed them back in, it will read them all fine.

So I'm not sure what's going wrong, I have debug logging on and no errors appear (it does very little logging for importing headers, however).

I originally had it updating headers every 41 minutes but moved it to 81 minutes thinking that part of the problem was it didn't have enough time to process but that hasn't helped.
User avatar
Lee Thompson
Occasional Contributor
Occasional Contributor
 
Posts: 39
Joined: Tue Apr 01, 2003 8:11 pm

Registered Newsbin User since: 04/01/03

Re: Newsbin Gets Behind With Importing Headers

Postby Quade » Mon Jun 15, 2020 9:15 am

What virus scanner are you using? I wonder if it's causing Newsbin to fail to load these files and then when you add them back, the scanner ignores them, the second time so Newsbin can process them?

Newsbin doesn't have any sort of cache to prevent load. After it feeds a file, it should be re-scanning the folder and picking up these file again, as it does when you add them back.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44999
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Newsbin Gets Behind With Importing Headers

Postby Lee Thompson » Mon Jun 15, 2020 5:44 pm

Windows defender but the folder newsbin is using for Temp is excluded. Realtime scanning is off; I have it to scans as things are downloaded by a download manager.

(I don't download binaries from usenet.)
User avatar
Lee Thompson
Occasional Contributor
Occasional Contributor
 
Posts: 39
Joined: Tue Apr 01, 2003 8:11 pm

Registered Newsbin User since: 04/01/03

Re: Newsbin Gets Behind With Importing Headers

Postby Quade » Tue Jun 16, 2020 11:51 am

I've never seen defender get in the way. It's the other V scanners that can be problematic. I'm not sure at this point. As long as the files end in ".txt". Newsbin should be picking them up.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 44999
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Newsbin Gets Behind With Importing Headers

Postby Lee Thompson » Tue Jun 16, 2020 2:25 pm

Most of the time, it does but sometimes it seems to get behind or stuck on one, not sure why.
User avatar
Lee Thompson
Occasional Contributor
Occasional Contributor
 
Posts: 39
Joined: Tue Apr 01, 2003 8:11 pm

Registered Newsbin User since: 04/01/03

Re: Newsbin Gets Behind With Importing Headers

Postby Lee Thompson » Tue Jun 30, 2020 5:04 pm

Today, after many days of no issues it decided to backlog header importing again.

I still can't find any good reason why not.

Would it be possible to put some debug messages when it imports headers?

When it fails, it does keep the handle on the .txt file open (I have to exit newsbin to move the file out of Import.)
User avatar
Lee Thompson
Occasional Contributor
Occasional Contributor
 
Posts: 39
Joined: Tue Apr 01, 2003 8:11 pm

Registered Newsbin User since: 04/01/03


Return to V6 Technical Support

Who is online

Users browsing this forum: Majestic-12 [Bot] and 5 guests