Comments (2)
congqixia
commented on July 16, 2024
2
@bigsheeper after some confirmation with Knowhere team. It's possible to get an empty bucket when doing KMeans clustering but the chance is extremely low. It is almost impossible to meet 32 buckets having only 9 candidates. Even then situation is met, Knowhere would skip empty buckets. It looks that some bug still exists here.
/cc @XuanYang-cn
from milvus.
bigsheeper
commented on July 16, 2024
1
I think this case is normal. This case inserted 6000 entries, then built an ivfpq index (nlist=128), search with nprob=32, and top 10. When ivf clustering is uneven, getting only 9 results is possible.
from milvus.
Related Issues (20)
- [Bug]: data recovered after removing all the data in the collection for a while HOT 15
- How to modify the maximum length of the milvus field 'max_length'? HOT 4
- [Bug]: import segments will not be cleared in segmentManager HOT 1
- [Enhancement]: Support upsert/delete with partitionkey + pk HOT 1
- [Bug]: connect to etcd failed HOT 3
- [Bug]: policy related metadataCache got removed and lead to permission denied errors HOT 3
- [Bug]: Fail to get the correct primary key values if upsert with auto_id=True HOT 1
- [Bug]: L0 compaction cannot keep up with upsert of one billion data HOT 1
- [Bug]: collection fail to load HOT 2
- [Bug]: milvus-querynode memory leak HOT 6
- [Bug]: golang lint fails HOT 2
- [Bug]: l0 compaction saveSegmentMeta may lost set segments HOT 1
- [Enhancement]: new knowhere param `range_search_k` for RangeSearch to early terminate iterator.
- [Feature]: Data migration from one partition to another
- [Bug]: [major] The datanode is continously restarted for OOM after major compaction for 50M (768) dataset HOT 1
- [Bug]: [benchmark]Proxy memory doesn't drop when nothing is done to milvus HOT 2
- [Bug]: The version in the log is not v2.3.19 after v2.3.19 image installed HOT 1
- [Bug]: index type not match: invalid parameter[expected=STL_SORT][actual=Ascending] HOT 2
- [Bug]: GrowingRawData of test groupby failed HOT 4
- [Enhancement]: Skip update collection next target if segment/channel list doesn't change HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from milvus.