Tune similarity

[azhe825]

Tune similarity

[timm]

dont get this. what were the similarity scores B4 tuning?

pause

oh- the IQRs are way down .13 to .03 or even 0.06

Q: does that mean know you now how to select which method for reuse?

[timm]

and how long did tuning take?

[azhe825]

• how long did tuning take?

  • about 30 hours on 10 cores, so 300 hours on single core.

• does that mean know you now how to select which method for reuse?

  • no, same reason as before

• what does it solve?

  • we no longer get similarity scores with variances.
  • Before: first time we get a similarity score, second time we may get a different one if order of docs changes.
  • Now: the similarity score is stable after tuning.