Historical data over 47 GB – any way to enfore a retention policy?

[zkvvoob]

Historical data over 47 GB – any way to enfore a retention policy?

[ruslandoga]

👋 @zkvvoob

These look like ClickHouse parts. Depending on your config, some of these can be logs and can be safely dropped (in SQL terms). You can disable logs storage by mounting these config: https://github.com/plausible/hosting/tree/master/clickhouse

[ruslandoga]

More info: https://kb.altinity.com/altinity-kb-setup-and-maintenance/altinity-kb-system-tables-eat-my-disk/

[ruslandoga]

You can check if it's indeed query_log with something like this

$ cd hosting
$ docker compose exec plausible_events_db clickhouse-client

:) select count(*) from system.query_log;

[ruslandoga]

And I just found this query to list the biggest tables

SELECT table, formatReadableSize(sum(bytes)) AS size FROM system.parts GROUP BY table

You can use it to check if the data on disk is actually the app data or if it's from the system tables.

source: https://gist.github.com/sanchezzzhak/511fd140e8809857f8f1d84ddb937015