Comments (2)
要搞懂precision ,recall的计算,需要先去了解一下兰德系数。这是一个通用性的聚类结果评价指标,简单来说,如果两条日志事实上属于同一个模板,在你的分类结果里也属于同一个模板,那precision就高。你可以结合logparser/utils/evaluator.py中的实现理解一下。这个指标对于日志解析事实上过于宽松了,所以大家用更严格的Group Accuracy。最近还有些更强大的算法用更更严格的Message Level Accuracy,那就是后话了。
In order to understand how to calculate precision and recall, it's important to first understand the Rand Index. This is a commonly used evaluation metric for clustering results. Simply put, if two log entries belong to the same template and are classified into the same template in your classification results, then the precision is high. You can refer to the implementation in logparser/utils/evaluator.py for a better understanding of how this works. However, this metric is too lenient for log parsing, so most people use the more stringent Group Accuracy metric. Recently, even more powerful algorithms have used the even stricter Message Level Accuracy, but that's a topic for another time. (English version translated by chatgpt)
from logparser.
Thanks for your explanation! @zzkluck
from logparser.
Related Issues (20)
- The difference in number of records between raw data and parsed data HOT 1
- logrevised和log_corrected区别
- Support for multiline HOT 1
- How does the logpai/Drain3 repository compare to the implementation in this repository? HOT 1
- Controlling verbosity of output HOT 1
- Known log formats in benchmarks HOT 2
- Use Spell to parser HDFS have some question HOT 1
- There are too many log templates, and the encoding is abnormal.
- raise KeyError in Drain HOT 2
- How to define log_format and regex[] for each dataset? HOT 1
- df_log always empty HOT 1
- bad escape \s in Drain.py HOT 7
- The regex is different HOT 3
- EventId in HDFS_template.csv
- Spell optimization in python using multiprocessing HOT 1
- Configure logparser with python2.7
- I think there is a misspelling in '/logs/Andriod' HOT 1
- Unable to figure out how to use the logparser HOT 2
- running python Drain_demo.py , An error occurred
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from logparser.