Comments (4)
@cczhu - but GSB can have missing data blocks, which would be noticed from the timestamp file. Still, since currently we do not do anything with it, I guess we might as well remove it for now.
from baseband.
@mhvk that's true, but since payload-timestamp connections are inferred rather than embedded within the GSB file, is it even safe to keep reading after hitting a missing timestamp? It could be that the payload kept writing, or was partly written. I suppose we could do a complete file integrity check at the beginning to make sure the payload file sizes add up to the number of header lines, and then assume missing data only if everything does check out (which still leaves the possibility for some forms of time offsets to go unchecked)?
from baseband.
"Needs clarification" since I think there is a decision to be made here: my current sense is that fill_value
should be passed in at file opening time rather than for reading, since it is very unlikely one would want to change it half-way through (see #146). An advantage of that method is that fh.read()
starts to become completely independent of what the underlying stream is. If we go that route, then for gsb
the conclusion is simply to remove fill_value
from its read
method.
from baseband.
fixed by #163 (by removing the fill_value
for now).
from baseband.
Related Issues (20)
- Baseband doesn't properly support file paths in all cases HOT 5
- `baseband.open()` does not support keyword arguments it should HOT 1
- Allow passing in header0 to stream readers? HOT 3
- Inconsistent sample_shape between VDIF StreamReader and header? HOT 3
- Guaranteed Attributes/Methods for headers? HOT 3
- Replace entrypoints by importlib.metadata HOT 1
- Dtype in Info object (and other useful attributes to have?) HOT 1
- Support psrfits baseband format
- Problem reading VDIF files with frame rate of 1 Hz
- Add CHIME HDF5 Gated format HOT 1
- Error raised when one seeks to bad spot in file and then reads
- Deal with files with large numbers of invalid frames HOT 1
- Write gapped vdif problem HOT 4
- Idea: allow time jumps in writing streams?
- Maybe support other data types?
- Task modules cannot be imported
- Some DADA headers are missing END
- Support VSSP format?
- ANN: Please migrate away from pytest-openfiles HOT 1
- Documentation for encode_2bit_base swaps encodings 1 and 2 HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from baseband.