hokgroup / hok.elastic Goto Github PK

7.0 7.0 0.0 454 KB

.NET Library for crawling filesystem and ingesting into Elasticsearch. Includes Events API for file change watching in cloud file storage applications (i.e. Nasuni)

License: MIT License

C# 99.60% HTML 0.40%

hok.elastic's People

Contributors

Stargazers

Watchers

hok.elastic's Issues

Make settings regexes optional

We pull office, project (name and number), and category fields from files using 3 settings fields:

OfficeSiteExtractRegex
ProjectExtractRegex
PipeCategorizationRegex

If they are not present, we get a fatal error. I think we should both allow these to not be set (and either not set the field or include a default value) and to allow the user to set a static value for project/office, possibly with a separate options settings key.

Add example JSON files

The README mentions appsettings.example.json and jobsettings.example.json, but they're not in the repo. They need to be added (with comments, so maybe jsonc files)

Add ability to manually specify credentials in some way

If an Elastic cluster is not using Kerberos, they can't make use of NetworkCredentials, so it would be good to allow the user to set up a crawl using effectively Basic auth or ApiKey auth, potentially in appsettings.json

Recommend Projects