[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Memory limits?

From: Thomas Worthington
Subject: Re: Memory limits?
Date: Mon, 21 Sep 2020 14:24:16 +0100
User-agent: mu4e 1.1.0; emacs 26.3

I'm on the master branch (updated Sat Mar 10 06:12:43 2018) and I built using


So I assume that it picked up the fact that this is a 64bit machine (Gentoo 
Linux). All the checks pass.

"file" gives

ELF 64-bit LSB pie executable, x86-64, version 1 (SYSV), dynamically linked, 
interpreter /lib64/, for GNU/Linux 3.2.0, with debug_info, 
not stripped


stes@PANDORA.BE writes:

> I'm new to GNU st so I don't know the answer, but when reading your message, 
> some questions arise.
> Actually first of all I wonder myself whether GNU gst 3.2.91 is the latest 
> version,
> and whether any development is still going on ?
> (version from 2015
> How exactly was GNU st configured and built ?
> What's the version and operating system ?
> Did you build a 32bit or a 64bit gst ?
> For example:
> #smalltalk-3.2.91$ file gst
> gst:      ELF 64-bit LSB executable AMD64 Version 1, dynamically linked, not 
> stripped, no debugging information available
> Was 'gmake check' reporting any failed checks ?
> David Stes
> ----- Op 21 sep 2020 om 12:19 schreef Thomas Worthington 
>> I'm testing a bit of code intended for analysing Apache Logs and hitting a
>> memory limit. The log I'm using has a million lines with 18 fields each, so
>> it's not completely trivial (I've already tested it on a 300 line snippet) 
>> but
>> it is still an extract of the full-sized logs I want to run it on.
>> When the code runs I initially get a load of
>> "Global garbage collection... done"
>> "Global garbage collection... done, heap grown"
>> "Global garbage collection... done, heap grown"
>> "Global garbage collection... done, heap grown"
>> "Global garbage collection... done, heap grown"
>> "Global garbage collection... done, heap compacted"
>> "Global garbage collection... done, heap grown"
>> Which is expected, but once gst has about a gig of RAM allocated to it I get
>> [Memory allocation failure]
>> Can't allocate enough memory to continue.
>> done"
>> "Global garbage collection...
>> which repeats over and over (I think once per line in the log file from that
>> point on). pidstat on gst at that point gives me
>> 11:01:36      UID       PID  minflt/s  majflt/s     VSZ     RSS   %MEM  
>> Command
>> 11:01:36     1000     18064      0.06      0.00  989144  813120   9.96  gst
>> The test box has 8G of RAM and the system I want to run it on has 680GB of 
>> RAM,
>> so it would be nice to be able to use it. Is there some hard-coded limit in 
>> the
>> source which I can lift or am I stuck? Or just missing something?
>> Thanks,
>> Thomas

reply via email to

[Prev in Thread] Current Thread [Next in Thread]