DEBUG Feeder: Stalling Disk Reader....

[syshog]

I've started to get "DEBUG Feeder: Stalling Disk Reader...."

How do I figure out where the problem is coming from and how do II fix it?

Also
how do I turn off the "Periodic Search?" I don't use a watch list and wish to disable that feature.
Periodic Search: Waiting for next Period 1757420 SecsPeriodic Search: Waiting for next Period 1757420 Secs


This problem has started with the Final release 6.90 build I've tried to use older build and the problem has continued
I use an m.2 Nvme ssd for my import folder and used the junction feature of mklink to link to the folder
inside the Newsbin data folder. I have moved the import data between a 1TB, 512GB, and 2TB m.2 drives and the problem continues. I had this problem in windows 7 originally so I also upgraded the system too windows 10 and reinistalled NB 6.90 to see if the problem would go a way. When NB is stuck on DEBUG Feeder: Stalling Disk Reader.... the problem goes away for a little while if I close NB via the file>>>exit menu.
I use resmon.exe too see if any of the dbb3 files are being accessed during DEBUG Feeder: Stalling Disk Reader and they are not. the groups it starts to stall on changes each time, but once it starts it does not stop. Even if I leave the system running for days. I have been playing with this problem since the 15th of August. I figure I would report it.

Code: Select all

[09/03 13:39:54]  DEBUG Feeder: Waiting for last block to finish....alt.binaries.font
[09/03 13:39:54]  DEBUG CNNTPDbImportThread alt.binaries.font
[09/03 13:39:54]  DEBUG eweka alt.binaries.bloaf XOVER: alt.binaries.bloaf 27957658335:27957858335
[09/03 13:39:54]  DEBUG CNNTPDbProcessingThread - Importing Compacts Finished
[09/03 13:39:54]  DEBUG CNNTPDbProcessingThread - Importing Compacts
[09/03 13:39:56]  DEBUG Periodic Search: Waiting for next Period 1758200 Secs
[09/03 13:39:56]  DEBUG Feeder: Waiting for last block to finish....alt.binaries.font
[09/03 13:39:56]  DEBUG CNNTPDbImportThread alt.binaries.ftd
[09/03 13:39:56]  DEBUG CNNTPDbProcessingThread - Importing Compacts
[09/03 13:39:56]  DEBUG CNNTPDbProcessingThread - Importing Compacts
[09/03 13:39:56]  DEBUG CNNTPDbProcessingThread - Importing Compacts
[09/03 13:39:56]  DEBUG CNNTPDbProcessingThread - Importing Compacts
[09/03 13:39:58]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:00]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:02]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:04]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:06]  DEBUG Periodic Search: Waiting for next Period 1758190 Secs
[09/03 13:40:06]  DEBUG NZB File Load Checking
[09/03 13:40:06]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:08]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:10]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:12]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:14]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:16]  DEBUG Periodic Search: Waiting for next Period 1758180 Secs
[09/03 13:40:16]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:18]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:20]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:22]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:24]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:26]  DEBUG Periodic Search: Waiting for next Period 1758170 Secs
[09/03 13:40:26]  DEBUG NZB File Load Checking
[09/03 13:40:26]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:28]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:30]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:32]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:34]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:36]  DEBUG Periodic Search: Waiting for next Period 1758160 Secs
[09/03 13:40:36]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:38]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:40]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:42]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:44]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:46]  DEBUG Periodic Search: Waiting for next Period 1758150 Secs
[09/03 13:40:46]  DEBUG NZB File Load Checking
[09/03 13:40:46]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:48]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:50]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:52]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:53]  DEBUG XOVER Numbers: alt.binaries.ath Min: 30992295025 Max: 30992495025 eweka
[09/03 13:40:54]  DEBUG eweka alt.binaries.ath XOVER: alt.binaries.ath 30992295025:30992495025
[09/03 13:40:54]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:56]  DEBUG Periodic Search: Waiting for next Period 1758140 Secs
[09/03 13:40:56]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:40:58]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:00]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:02]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:04]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:06]  DEBUG Periodic Search: Waiting for next Period 1758130 Secs
[09/03 13:41:06]  DEBUG NZB File Load Checking
[09/03 13:41:06]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:09]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:11]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:13]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:15]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:16]  DEBUG Periodic Search: Waiting for next Period 1758120 Secs
[09/03 13:41:17]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:19]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:21]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:23]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:25]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:26]  DEBUG Periodic Search: Waiting for next Period 1758110 Secs
[09/03 13:41:26]  DEBUG NZB File Load Checking
[09/03 13:41:27]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:29]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:31]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:33]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:35]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:36]  DEBUG Periodic Search: Waiting for next Period 1758100 Secs
[09/03 13:41:37]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:39]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:41]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:42]  DEBUG XOVER Numbers: alt.binaries.etc Min: 7147850502 Max: 7148050502 eweka
[09/03 13:41:43]  DEBUG eweka alt.binaries.etc XOVER: alt.binaries.etc 7147850502:7148050502
[09/03 13:41:43]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:45]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:46]  DEBUG Periodic Search: Waiting for next Period 1758090 Secs
[09/03 13:41:46]  DEBUG NZB File Load Checking
[09/03 13:41:47]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:49]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:51]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:53]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:55]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:56]  DEBUG Periodic Search: Waiting for next Period 1758080 Secs
[09/03 13:41:57]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:41:59]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:01]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:03]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:05]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:06]  DEBUG Periodic Search: Waiting for next Period 1758070 Secs
[09/03 13:42:07]  DEBUG NZB File Load Checking
[09/03 13:42:07]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:09]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:11]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:13]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:15]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:16]  DEBUG Periodic Search: Waiting for next Period 1758060 Secs
[09/03 13:42:17]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:19]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:21]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:23]  DEBUG XOVER Numbers: alt.binaries.warez Min: 12340790390 Max: 12340990390 eweka
[09/03 13:42:23]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:23]  DEBUG eweka alt.binaries.warez XOVER: alt.binaries.warez 12340790390:12340990390
[09/03 13:42:25]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:26]  DEBUG Periodic Search: Waiting for next Period 1758050 Secs
[09/03 13:42:27]  DEBUG NZB File Load Checking
[09/03 13:42:27]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:29]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:31]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:33]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:35]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:37]  DEBUG Periodic Search: Waiting for next Period 1758040 Secs
[09/03 13:42:37]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:39]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:41]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:42]  DEBUG XOVER Numbers: alt.binaries.ath Min: 30992495025 Max: 30992695025 eweka
[09/03 13:42:43]  DEBUG eweka alt.binaries.ath XOVER: alt.binaries.ath 30992495025:30992695025
[09/03 13:42:43]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:43]  DEBUG XOVER Numbers: alt.binaries.boneless Min: 55618851940 Max: 55619051940 eweka
[09/03 13:42:44]  DEBUG eweka alt.binaries.boneless XOVER: alt.binaries.boneless 55618851940:55619051940
[09/03 13:42:45]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:47]  DEBUG Periodic Search: Waiting for next Period 1758030 Secs
[09/03 13:42:47]  DEBUG NZB File Load Checking
[09/03 13:42:47]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:49]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:51]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:53]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:54]  DEBUG XOVER Numbers: alt.binaries.bloaf Min: 27957858335 Max: 27958058335 eweka
[09/03 13:42:55]  DEBUG eweka alt.binaries.bloaf XOVER: alt.binaries.bloaf 27957858335:27958058335
[09/03 13:42:55]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:57]  DEBUG Periodic Search: Waiting for next Period 1758020 Secs
[09/03 13:42:57]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:42:59]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:01]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:03]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:05]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:07]  DEBUG Periodic Search: Waiting for next Period 1758010 Secs
[09/03 13:43:07]  DEBUG NZB File Load Checking
[09/03 13:43:07]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:09]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:11]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:13]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:15]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:17]  DEBUG Periodic Search: Waiting for next Period 1758000 Secs
[09/03 13:43:17]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:19]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:21]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:23]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:25]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:27]  DEBUG Periodic Search: Waiting for next Period 1757990 Secs
[09/03 13:43:27]  DEBUG NZB File Load Checking
[09/03 13:43:27]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:29]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:31]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:33]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:35]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:37]  DEBUG Periodic Search: Waiting for next Period 1757980 Secs
[09/03 13:43:37]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:39]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:41]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:43]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:45]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:47]  DEBUG Periodic Search: Waiting for next Period 1757970 Secs
[09/03 13:43:47]  DEBUG NZB File Load Checking
[09/03 13:43:47]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:49]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:51]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:54]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:56]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:43:57]  DEBUG Periodic Search: Waiting for next Period 1757960 Secs
[09/03 13:43:58]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:00]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:02]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:04]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:06]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:07]  DEBUG Periodic Search: Waiting for next Period 1757950 Secs
[09/03 13:44:07]  DEBUG NZB File Load Checking
[09/03 13:44:08]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:10]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:12]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:13]  DEBUG XOVER Numbers: alt.binaries.etc Min: 7148050502 Max: 7148250502 eweka
[09/03 13:44:13]  DEBUG eweka alt.binaries.etc XOVER: alt.binaries.etc 7148050502:7148250502
[09/03 13:44:14]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:16]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:17]  DEBUG Periodic Search: Waiting for next Period 1757940 Secs
[09/03 13:44:18]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:20]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:22]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:24]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:26]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:27]  DEBUG Periodic Search: Waiting for next Period 1757930 Secs
[09/03 13:44:27]  DEBUG NZB File Load Checking
[09/03 13:44:28]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:30]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:32]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:34]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:36]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:37]  DEBUG Periodic Search: Waiting for next Period 1757920 Secs
[09/03 13:44:38]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:40]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:42]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:44]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:46]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:47]  DEBUG Periodic Search: Waiting for next Period 1757910 Secs
[09/03 13:44:47]  DEBUG NZB File Load Checking
[09/03 13:44:48]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:50]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:52]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:54]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:54]  DEBUG XOVER Numbers: alt.binaries.warez Min: 12340990390 Max: 12341190390 eweka
[09/03 13:44:55]  DEBUG XOVER Numbers: alt.binaries.bloaf Min: 27958058335 Max: 27958258335 eweka
[09/03 13:44:55]  DEBUG eweka alt.binaries.warez XOVER: alt.binaries.warez 12340990390:12341190390
[09/03 13:44:55]  DEBUG eweka alt.binaries.bloaf XOVER: alt.binaries.bloaf 27958058335:27958258335
[09/03 13:44:56]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:57]  DEBUG Periodic Search: Waiting for next Period 1757900 Secs
[09/03 13:44:58]  DEBUG XOVER Numbers: alt.binaries.ath Min: 30992695025 Max: 30992895025 eweka
[09/03 13:44:58]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:44:58]  DEBUG eweka alt.binaries.ath XOVER: alt.binaries.ath 30992695025:30992895025
[09/03 13:45:00]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:45:02]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:45:04]  DEBUG Feeder: Stalling Disk Reader....
[09/03 13:45:06]  DEBUG Feeder: Stalling Disk Reader....

[Quade]

These are all normal messages. If you don't want to see them you can turn down the logging so it doesn't show debug messages anymore.

If you don't have any periodic searches defined then it's not doing periodic searches. The message is from the worker simply telling you it's still alive and waiting for someone to define a periodic search.

I'm pretty sure "bloaf" and "Warez" are useless groups to header downloads these days. You might want to consider disabling/deleting them. You're downloading gigs of headers you can't use.

[syshog]

The import folder is not being processed and the headers are not showing up in the 7 day window I have set they are days behind what the import folder has. The import folder has 10,990 files compressed down to 235GB using windows drive compression since gz compression is no longer available. Resmon.exe shows 0 activity even on the system when the stalling happens. I don't mind about the headers taking up space as everything is running off SSDs (m.2, SAS, and sata) ~10TB of headers. Let me know when you get multi threaded header processing working so I can be clear of this problem. Thanks for your quick reply.

[Quade]

The message you're complained about "stalling", is the multi-threaded loader. "Stalling" is telling you that the thread that reads from disk has paused because the thread that feeds the DB can't keep up.

The problem is that "bloaf" and other garbage groups aren't getting recognizable files anymore. They're just getting random obscured posts that don't group anymore. They're still usable if you have the NZB but if you don't, you can't download anything. Since the posts don't group into files anymore, the header databases are getting filled with unusable garbage which is slow to feed. The more junk you have, the slower everything runs.

so I can be clear of this problem.

if you want to "clear the problem" I'd suggest deleting the garbage groups header files out of the import folder.

You can download however you want though.

[syshog]

I understand that. What I don't understand is why the pipeline stops processing anything for an hour or longer and then the same group it processes everything like there was not a problem in less than on hour. The files range from 49-69KB, what is the confusion if it processing every file the same? Are there hardcoded limits somewhere like inside sqlite its' self? Is there a way to restart the stalled pipeline? the biggest confusion I have is during this time NB stops all processing rather than work on a different group since each group has their own db. This was the first time in years I've had log messages saying the Disk reader was stalling usually it does not say anything even when I turn on DEBUG. I'm already down to 2466 remaining where a day before it was above 10k. I have my own way of using the obscured posts sometimes I run into missing files in a given NZB and I can uses my own headers to track them down when search engines fail me. I'm aware that I could make the over all spool folder smaller. Thanks for clear this up for me as to the why.

[Quade]

The answer to your question is "I don't know". I'm not really clear what you mean. Newsbin doesn't process headers in sequence. if you load a group, it should prioritize the headers for that group for example. You might have corrupted DB's. It shouldn't happen but with PC's anything is possible. You might want to use one of the many sqlite tools to verify the DB's on some of these groups.

I guess the question is why you ended up with a flood of obscured group posts when you were keeping up with header downloads before? It almost sounds like you added a group or manual downloaded a bunch of headers from one of these dump groups and Newsbin is now simply working through this flood. Maybe what's happened is another change in posting format so, there's even less logical compression so what was working doesn't work anymore.

DB's for headers works because of logical compression. Meaning the grouping of posts into files and into groups of files. It means a single entry in the DB might represent 60,000 posts. It's one reason large file groups actually work better than image groups. Because an image group is 1:1 whereas a large group can be 1:60,000.

Now with obscured posting, you don't get logical compression anymore. So, what was one entry in the DB is now 60,000 new entries in these dump groups.