Generalise the directory cleaning rules

[smol-ai]

Generalise the directory cleaning rules

[swyxio]

very cool idea! PR welcome, not sure what library to use to do this (maybe its not needed)?

[Smit-Parmar]

@swyxio I can work on this but i'm seeing 3 different function for cleaning and 2 of them have different number of extension to skip. Should we generalize those to single function and add extension to skip in smol-ignore use it ?

or create one constant.py and declare extension to ignore as constant and use it everywhere.

We can define common function like clean_dir() in utils.py