Comments (6)
As I noted on your PR, perhaps it would make sense to allow sorting objects across buckets. @frankyn, WDYT?
from python-storage.
Hi @bboe,
Apologies on the delay. How many objects do you have in your bucket? I'd prefer we not support this in the GCS library because list_blobs()
may be called on a bucket with millions of objects. I think this is better suited in external project code rather than in the Python library.
I'm open to discussing this more, but want to be careful with what the library supports long-term.
from python-storage.
@frankyn thanks for the response. Yes, sorting millions of objects wouldn't be ideal.
Would it be possible to update the documentation to mention that list_blobs is guaranteed to return items sorted by key (assuming that's actually true)?
from python-storage.
Reaching out to the backend service teams and will get back to you.
As long as I've used GCS, objects are listed in lexicographical order, but want to confirm because it's a strong statement and want to be careful.
from python-storage.
Hi @bboe, confirmed with backend team that this is true and not documented appropriately.
This is being resolved by Technical Writers internally and closing this issue.
Thanks for your patience @bboe!
from python-storage.
Thanks for following up @frankyn. I appreciate it.
from python-storage.
Related Issues (20)
- tests.system.test_transfer_manager: test_upload_chunks_concurrently_with_content_encoding failed HOT 1
- tests.system.test_transfer_manager: test_upload_chunks_concurrently_with_encryption_key failed HOT 1
- Resumable file uploads crashes with 400 error from API HOT 1
- utcnow is deprecated in python3.12
- Add support for object retention
- Support custom endpoints for SignURL and PostPolicy
- Add a system test to ensure the "google" namespace isn't clobbered HOT 1
- Blob client 'from_string' method regex does not allow bucket root HOT 6
- ReadTimeout errors HOT 5
- Blob.upload_from_file fails with non-seekable stream HOT 3
- `ResourceWarning` in build log when running tests - `unclosed file`
- `DeprecationWarning` warning in build log for python 3.12 `datetime.datetime.utcnow() is deprecated` HOT 1
- Remove warnings in samples which appear in the Kokoro logs
- bucket.list_blobs is missing page_size arg (present in client.list_blobs)
- Add Support for includeFolders option in ListObjects HOT 2
- Support for parallel composite upload HOT 1
- A weird behavior when uploading files HOT 1
- 503 when uploading a lot of small files through transfer_manager.upload_many_from_filenames() HOT 5
- tests.system.test_transfer_manager: many tests failed HOT 3
- Listing Subdirectories not working with list_blobs and delimiter HOT 4
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from python-storage.