Comments (5)
What version are you using? If you add -vv
you should get some extra debug information and should see something like this once a minute:
2023-09-14 04:23:10 TRACE evebox::sqlite::retention: Deleting events older than 7 days
2023-09-14 04:23:10 DEBUG evebox::sqlite::retention: Deleted 39 events older than 2023-09-07 4:23:10.810783427 +00:00:00 (7 days) in 9 ms
from evebox.
I'm running version 0.17.2 in a docker container, I see
INFO evebox::sqlite::retention: Database retention settings: days=7, size=0
DEBUG evebox::sqlite::retention: Deleted 1000 events older than 2023-09-07 7:40:22.656996778 +00:00:00 in 2661 ms
I assume my config file is not being read because the size constraint that I put is not there and was probably just matched by chance when I checked, but in the web page I still see older events, aswell as some alerts dating more than 7 days
Thanks for the help
from evebox.
For the config file, make sure your Docker volumes are correct and you are specifying the path to the configuration file. if you still run into issues there, let me know. But this is how I run EveBox as well.
It may take a while to delete all the old events. Write activity in SQLite locks the database, so we only delete 1000 events at a time. If 1000 events were actually deleted, we reschedule the next purge in 1 second rather than 1 minute. So if you are dropping from a retention of 30 days to 7, in can take a while. There is also an issue if you happen to be ingesting more than 1000 events per second.
from evebox.
I specified the config file in a better way and it's now working properly
I went into the debug logs to see and it seems like it is now slowly deleting old events, but since I get more than 1000 per second at some times they still showed up
I'm also experiencing some lag (evebox loads events very slowly and falls behind compared to the suricata logs), could those be related?
Thanks :)
from evebox.
Looks like this issue is resolvd. Detecting lag would be a good to add tho.
from evebox.
Related Issues (20)
- Unable to negate a phrase in the query string HOT 2
- SQList Corruption Issues HOT 6
- sqlite/fts: disk space failed to be returned HOT 2
- Fails to import AWS Network Firewall netflow logs HOT 2
- Using additional-fields as filters ? HOT 4
- Rule modification feature HOT 4
- How to enable login function with SQLite? HOT 10
- Empty events list (No events found) HOT 3
- Add links for rule references
- sensorname filter drop-down HOT 1
- OpenSearch "version_conflict_engine_exception", document already exists HOT 2
- /stats page data is empty HOT 3
- a lot of messages display "Authentication required but no session found." HOT 1
- I want to add 1month range for search.
- Connect to elasticsearch with HTTPS HOT 1
- /reports/alerts search signature content HOT 3
- Rethink time selector, in particular the "All" option
- Where do users log out of the system? HOT 1
- sqlite: Save state in database dump
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from evebox.