ENH: filter with slicing

[bluesky]

ENH: filter with slicing

[sbillinge]

I also want this behavior, but I also want db[-1] to return the latest dataset regardless of filter settings. In other words, I would like the fact that the slicing is being done on filtered data to be explicit to the user. I

I see big problems otherwise, where some filter is set and users are not getting data that they are expecting and going nutso.

[danielballan]

I see big problems otherwise, where some filter is set and users are not getting data that they are expecting and going nutso.

We saw the same problem. Filters do not affect slicing, and in order to avoid said "nutso" feeling, it is impossible to make them. Can't have cake and eat it too in this case.

[danielballan]

P.S. Of course, can always do:

db.add_filter(bt_piLast='Billinge')
db()[-1]

[CJ-Wright]

Is it possible to get back all the records as a generator? That way we don't look at everything at once.

[danielballan]

I realized no one answer your last question here. It is not currently possible using the public API, but a separate query method could be added. We chose to be non-lazy here to make the common case (fetching a normal number of headers) more accessible. A compromise that shows the difficulty of building a library and a "user friendly" CLI into the same package.