Excessive memory usage causing system crashing

Technical support and discussion of Newsbin Version 6 series.

Excessive memory usage causing system crashing

Postby alfke » Tue Apr 09, 2019 1:21 pm

Hello all,

When downloading, Newsbin continues to use memory and will continue to use until my system crashes. Never had trouble before but this just started happening. Doesnt matter how large the file sizes are, or how many I download, the memory usage continues to accumulate ONLY when downloading. Once the download is complete, the memory does not clear up. The only way to clear memory usage it is to restart Newsbin. I tried turning off autopar/rar but the problem persists. Any ideas?

Version: 6.82B3: 00 E2 F7 3F ED 92

Windows 10 Pro, 8 GB RAM

Thanks

Alfke
alfke
Occasional Contributor
Occasional Contributor
 
Posts: 12
Joined: Thu Jan 12, 2017 1:16 am

Registered Newsbin User since: 08/02/15

Re: Excessive memory usage causing system crashing

Postby Quade » Wed Apr 10, 2019 12:22 am

Down where it says "Cache" there are some numbers. What do the numbers show?
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 45006
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Excessive memory usage causing system crashing

Postby alfke » Wed Apr 10, 2019 12:12 pm

Quade wrote:Down where it says "Cache" there are some numbers. What do the numbers show?

It says Cache: 4000/4000 (0)

Here are my performance settings:

[PERFORMANCE]
ChunkCacheSize=4000
MemcacheLimit=0
PauseDownload=1
PreallocateFiles=0
RepairPriority=0
RepairThreads=0
SaveChunksMode=0

I tried changing memcachelimit, savechunksmode but they make no difference. It seems like newsbin writes everything to memory in a temporary file. As soon as I close newsbin, I immediately get the memory back. My down speed is awesome, no issues there (780mbps). Server commands is off as well.
alfke
Occasional Contributor
Occasional Contributor
 
Posts: 12
Joined: Thu Jan 12, 2017 1:16 am

Registered Newsbin User since: 08/02/15

Re: Excessive memory usage causing system crashing

Postby itimpi » Wed Apr 10, 2019 12:46 pm

You could try reducing the ChunkCacheSize value. That is the one that defines how many RAM buffers Newsbin can allocate to hold chunks before they need to be flushed to disk. I think the default is more like 400 than the 4000 you have set up.
The Newsbin Online documentation
The Usenettools for tutorials, useful information and links
User avatar
itimpi
Elite NewsBin User
Elite NewsBin User
 
Posts: 12607
Joined: Sat Mar 16, 2002 7:11 am
Location: UK

Registered Newsbin User since: 03/28/03

Re: Excessive memory usage causing system crashing

Postby alfke » Wed Apr 10, 2019 1:40 pm

itimpi wrote:You could try reducing the ChunkCacheSize value. That is the one that defines how many RAM buffers Newsbin can allocate to hold chunks before they need to be flushed to disk. I think the default is more like 400 than the 4000 you have set up.


That worked! I reduced to 400 from 4000, and memory usage never went above 1.6GB while retaining my speed.

Thanks all!

Alfke
alfke
Occasional Contributor
Occasional Contributor
 
Posts: 12
Joined: Thu Jan 12, 2017 1:16 am

Registered Newsbin User since: 08/02/15

Re: Excessive memory usage causing system crashing

Postby Quade » Wed Apr 10, 2019 1:49 pm

That's what I expected. I think what's happening is people are posting larger chunk sized nowadays.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 45006
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Excessive memory usage causing system crashing

Postby milarepa » Mon Dec 02, 2019 9:20 pm

Quade wrote:Down where it says "Cache" there are some numbers. What do the numbers show?


Is this found in Options/ Performance?? I cannot find a Cache reference in v. 6.8 and this issue has plagued me also.

edit- Okay, opened the .nbi with textpad and found a [Performance] list similar to regedit & tweaked.
milarepa
Occasional Contributor
Occasional Contributor
 
Posts: 22
Joined: Sun Jan 11, 2004 1:19 pm

Registered Newsbin User since: 09/30/03

Re: Excessive memory usage causing system crashing

Postby Quade » Tue Dec 03, 2019 1:27 pm

Make sure you exit Newsbin before changing it or it won't take.
User avatar
Quade
Eternal n00b
Eternal n00b
 
Posts: 45006
Joined: Sat May 19, 2001 12:41 am
Location: Virginia, US

Registered Newsbin User since: 10/24/97

Re: Excessive memory usage causing system crashing

Postby milarepa » Sat Dec 07, 2019 4:48 pm

Quade wrote:Make sure you exit Newsbin before changing it or it won't take.


Ah, thanks. I wondered why it hadn't taken after repeating the fix. 4.7 gigs RAM, 50% CPU usage. erk.
milarepa
Occasional Contributor
Occasional Contributor
 
Posts: 22
Joined: Sun Jan 11, 2004 1:19 pm

Registered Newsbin User since: 09/30/03


Return to V6 Technical Support

Who is online

Users browsing this forum: Google [Bot] and 30 guests