6.80B8/9, questions about new header filter logic

This is the place to help test and discuss Version 6 Beta releases.

6.80B8/9, questions about new header filter logic

Postby stavros » Wed Sep 27, 2017 1:56 pm

Hi,

Re: New logic to automatically filter out headers with posting styles that Newsbin cannot make use of. These files can only be downloaded if you have an NZB file created by the original poster.

I'm curious about how the new logic works and what criteria are used to filter out headers.

I have in place a header filter, via the Group -> Header Filter option, gleaned from posts here, that seems to stop some of the rubbish headers that spammed usenet earleir this year.

\[[0-9a-f]{10}\] \\[0-9a-f]{10}\\::[0-9a-f]{14}\.[0-9a-f]{30}\.[0-9a-f]{8}::/[0-9a-f]{12}/ \[([0-9a-f]{10}|newzNZB)\]

My understanding of how this works is that:
1) All headers are downloaded to the Import folder
2) The filter is applied as part of the import processing before the headers are loaded into the appropriate DB
3) The headers not loaded/filtered out are discarded

Do I still need my spam filter, or is the new logic currently equivalent to the above filter?
Will it hurt to leave my filter in there - e.g. duplicate or unnecessary processing?

Thanks
Stavros.
stavros
Seasoned User
Seasoned User
 
Posts: 125
Joined: Wed Dec 24, 2003 2:07 am

Registered Newsbin User since: 12/24/03

Re: 6.80B8/9, questions about new header filter logic

Postby Quade » Wed Sep 27, 2017 2:54 pm

I think they new filter catches that. It doesn't hurt much to keep it though.

I do believe your sequence is correct too.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 45009
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: 6.80B8/9, questions about new header filter logic

Postby mkrubsack » Thu Sep 28, 2017 3:59 pm

I like this. Helps filter out all the obfuscation that's creeping in.
mkrubsack
Active Participant
Active Participant
 
Posts: 61
Joined: Sat Aug 25, 2012 5:39 pm
Location: California

Registered Newsbin User since: 08/25/12

Re: 6.80B8/9, questions about new header filter logic

Postby RayMark » Thu Sep 28, 2017 5:13 pm

I hope it catches only that but not more.

I'm not sure about filtering out "all the obfuscation" especially if I cannot switch that filtering out off.
Some of obfuscation is easily handled by NewsBin (minus name matching/ un-obfuscating), so if I am willing to download something like 8d8be3a8e9c64d8b8f5eed49592fbec5.mkv - I can.
Still, some nzb indexers are able to match those to real names, perhaps NewsBin's own internet search will one day too.

BTW, speaking about this style with …\…\::….….…::/…/ [newsNZB]
- there is a certain forum or indexer where nzb files are (supposed to be) provided but the mandatory captcha field is (always?) missing when attempting to register.
I wonder, is this their way to keep the forum closed or what. Even the closed status itself is obfuscated?
RayMark
Seasoned User
Seasoned User
 
Posts: 468
Joined: Sat Jul 21, 2007 10:40 pm

Registered Newsbin User since: 07/21/07

Re: 6.80B8/9, questions about new header filter logic

Postby Quade » Thu Sep 28, 2017 11:17 pm

I'm not sure about filtering out "all the obfuscation" especially if I cannot switch that filtering out off.


It only filters out a specific kind that can't be combined into files.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 45009
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97


Return to Newsbin Version 6 Beta Support

Who is online

Users browsing this forum: No registered users and 25 guests