Comments (5)
Great! Stay tuned for updates! There might be a possibility of an on-disk option in the future.
from goaccess.
If you're looking to reduce some RAM usage, here are a few things you could try out. First off, do you know if your requests are timestamped? If so, you might want to consider passing -q
. Also, are you currently using the legacy GeoIP? If yes, give -g
a shot. Another option is to SSH into the remote machine and parse the log locally on your own laptop/desktop machine (assuming it's got more RAM), e.g.,
ssh -n root@server 'tail -F -n +0 /var/log/apache2/access.log' | goaccess - --log-format=COMBINED -o report.html --real-time-html
Note: SSH requires -n
so GoAccess can read from stdin. Also, make sure to use SSH keys for authentication as it won't work if a passphrase is required.
from goaccess.
thanks, for your reply
locally parsing is OK, that works, but i want to have this completely on server, ofcourse only if it will be possible
if your requests are timestamped
i am not sure what you mean by timestamped
my log record look like this:
31.30.175.177 - - [12/May/2022:02:19:02 +0000] "GET /api/radio/programme/playingnow/?_nc=1652321942&device=desktop HTTP/2.0" 200 485 "https://radiopunctum.cz/archive/20220426_chaosfera" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/101.0.4951.54 Safari/537.36"
so this is probably not timestamp, only date/time of request
i forgot to put --geoip-database ../geoip/GeoLite2-City_20240412/GeoLite2-City.mmdb
in my example
so i am using mmdb instead of legacy GeoIP
mainly what i asked for, is this part of man:
STORAGE
There are three storage options that can be used with GoAccess. Choosing one will depend on your environment and needs.
Default Hash Tables
In-memory storage provides better performance at the cost of limiting the dataset size to the amount of available physical memory. GoAccess uses in-memory hash tables. It has very good memory usage and pretty good performance. This storage has support for on-disk persistence.
i cannot find what are that three options and how to tell goaccess
which storage to use.
from goaccess.
I'm not certain how that text managed to stick around from an older version that stored data on disk, but I've gone ahead and updated the documentation to match the current versions. Did using -q
make a difference? In your situation, using -g
won't be beneficial since you're utilizing the newer geodb.
from goaccess.
thanks for reply
i decide to do some log filtering before i send it to goaccess
, i think this will be enough to solve memory usage
from goaccess.
Related Issues (20)
- Token '- [03/Apr/2024' doesn't match specifier '%d' HOT 1
- Docker - build development binary in isolated container: error while loading shared libraries: libcrypto.so.1.1 HOT 4
- Restore the capability to modify log/date/time formats in the TUI format dialog HOT 1
- How to hide paths duplicated based on protocol HOT 7
- Feature request: Report should contain histogram of countries requests are comming from HOT 1
- Visitors geolocation map in v.1.9.2: numbers format on the scale bar under the map HOT 4
- How to respect Licensing terms of db-ip.com? HOT 1
- TX and Requests wrong with incremental processing HOT 26
- Question about --enable-panel HOT 5
- 'Error opening terminal: xterm' using docker image HOT 2
- Incremental processing of piped data HOT 4
- Unique AppPrefs for different html files
- Trying to figure out " Token for '%s' specifier is NULL."
- deb.goaccess.io for Ubuntu 24.04 noble fails HOT 2
- Nginx log format not working in Goaccess HOT 3
- Can't implement GoAccess with Zeek. Wrong format. HOT 2
- Logging Format Question - HAProxy
- Browsers an operating systems aren't recognized HOT 2
- Plans to track other search engines such as Yahoo, Bing, Duckduckguo etc. in addition to Google? HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from goaccess.