Giter Site home page Giter Site logo

byte-buffer's Introduction

ByteBuffer

Version Node Version MIT License Checks Maintainability Test Coverage

Wrapper for JavaScript's ArrayBuffer/DataView maintaining index and default endianness. Supports arbitrary reading/writing, implicit growth, clipping, cloning and reversing as well as UTF-8 characters and NULL-terminated C-strings.

Installation

ByteBuffer is available via npm:

npm install byte-buffer

Or for usage in the browser:

  • dist/byte-buffer.js
  • dist/byte-buffer.min.js

Usage

As an ECMAScript module:

import ByteBuffer from 'byte-buffer';

const b = new ByteBuffer();

In CommonJS environments:

const ByteBuffer = require('byte-buffer');

const b = new ByteBuffer();

Available in the global scope when included in browser environments:

const b = new ByteBuffer();

API

ByteBuffer's API borrows heavily from Adobe's IDataInput and IDataOutput as well as David Flanagan's BufferView.

The concept of separate buffers and views - as outlined in MDN's JavaScript typed arrays - is not used. ByteBuffer handles this separation for you.

Constants

Use the following constants to indicate endianness:

ByteBuffer.BIG_ENDIAN
ByteBuffer.LITTLE_ENDIAN

Construction

new ByteBuffer(1) // Buffer of one byte with big-endian byte order
new ByteBuffer(1, ByteBuffer.LITTLE_ENDIAN) // Little-endian byte order instead

ByteBuffers may also be constructed from other byte-aware sources:

new ByteBuffer(new ArrayBuffer(2))
new ByteBuffer(new Uint8Array(3))
new ByteBuffer(new DataView(new ArrayBuffer(4)))
new ByteBuffer(new ByteBuffer(5))

Or from generic sequences:

new ByteBuffer([0, 1, 2, 3])

After construction a ByteBuffer's read/write index is always at the front of the buffer. Hereafter b is assumed to be an instance of ByteBuffer.

Properties

b.buffer // Reference to internal ArrayBuffer
b.buffer = new ArrayBuffer(3) // Sets new buffer
b.raw // Reference to raw buffer (read-only)
b.view // Reference to internal DataView (read-only)
b.length // Number of bytes in the buffer (read-only)
b.byteLength // Alias
b.order // Buffer's current default byte order
b.order = ByteBuffer.BIG_ENDIAN // Sets byte order
b.available // Number of available bytes (read-only)

Index Manipulation

ByteBuffer maintains a read/write index to simplify usage.

b.index // Current read/write index
b.index = 4 // Sets index

If the index is out of bounds, a RangeError will be thrown.

b.front() // Sets index to front of the buffer
b.end() // Sets index to end of the buffer
b.seek(10) // Forwards ten bytes
b.seek(-2) // Backs two bytes

These methods may be chained:

b.front().seek(2)

Read API

All read methods default to the ByteBuffer's byte order if not given.

b.readByte()
b.readUnsignedByte()
b.readShort() // Buffer's default byte order
b.readShort(ByteBuffer.LITTLE_ENDIAN) // Explicit byte order
b.readUnsignedShort()
b.readInt()
b.readUnsignedInt()
b.readFloat()
b.readDouble()
b.read(6) // Reads 6 bytes
b.read() // Reads all remaining bytes
b.readString(5) // Reads 5 bytes as a string
b.readString() // Reads all remaining bytes as a string
b.readUTFChars() // Alias
b.readCString() // Reads string up to NULL-byte or end of buffer

Write API

All write methods default to the ByteBuffer's byte order if not given.

b.writeByte(10)
b.writeUnsignedByte(-10)
b.writeShort(-2048)
b.writeShort(-2048, ByteBuffer.LITTLE_ENDIAN) // Explicit byte order
b.writeUnsignedShort(4096)
b.writeInt(-524288)
b.writeUnsignedInt(1048576)
b.writeFloat(13.37)
b.writeDouble(1048576.89)
b.write([1, 2, 3])
b.write(new ArrayBuffer(2))
b.write(new Uint8Array(3))
b.write(new ByteBuffer(5))

Additionally, all the above write methods may be chained:

b.writeShort(0x2020).write([1, 2, 3])

The following string related methods do not return the buffer itself, but rather provide the number of bytes that were written to it. More on this under implicit growth strategy a bit further down.

b.writeString('ByteBuffer') // Writes given string and returns number of bytes
b.writeUTFChars('ByteBuffer') // Alias
b.writeCString('ByteBuffer') // Writes given string and returns number of bytes (including NULL-byte)

Size Manipulation

Growth

The buffer may be grown at the front or at the end. When prepending, the buffer's index is adjusted accordingly.

b.prepend(2) // Prepends given number of bytes
b.append(2) // Appends given number of bytes

Implicit Growth

This feature allows a ByteBuffer to grow implicitly when writing arbitrary data. Since every implicit growth requires the buffer to be rebuilt from scratch, care must be taken when using this feature. Writing low byte-length pieces of data in rapid succession is not recommended.

To protect the unaware from harm, this feature needs to be explicitly enabled:

b = new ByteBuffer(2, ByteBuffer.BIG_ENDIAN, true) // Last argument indicates implicit growth strategy
b.writeUnsignedInt(2345102) // Implicitly makes room for 4 bytes - by growing with 2 - prior to writing

The implicit growth strategy can also be enabled and disabled after construction:

b.implicitGrowth = true/false

Implicit growth is a must when dealing with UTF-8 encoded strings, as dealing with arbitrary user data - e.g. names or addresses - may include various characters that require to be encoded in multiple bytes, which would be relatively verbose to calculate beforehand.

Clipping

The buffer may be truncated at the front, end or both. Both arguments are optional and may be negative in which case the offsets are calculated from the respective boundaries of the buffer. The begin-argument defaults to the current index, allowing efficient clipping in various scenarios, e.g. when used in combination with network sockets to shift off read data. The end-argument defaults to the end of the buffer.

b.clip(2, -2)
b.clip(-2, 4)

Miscellaneous

b.slice(2, 4) // Independent clone of given slice of the buffer
b.clone() // Independent clone of the entire buffer
b.reverse() // Reverses buffer in place
b.toArray() // Changes to this array are not backed
b.toHex() // Hexadecimal representation of this buffer, e.g: 42 79 74 65 42 75 66 66 65 72
b.toASCII() // ASCII representation of this buffer, e.g:  B  y  t  e  B  u  f  f  e  r

Development & Contribution

ByteBuffer is written in ES2015+, modularized using ECMAScript Modules, compiled by Babel, bundled with rollup and tested through Jest.

Getting this toolchain up and running, is easy and straight-forward:

  1. Get the code:

    git clone git://github.com/timkurvers/byte-buffer.git
  2. Download and install Node.js – including npm – for your platform.

  3. Install dependencies:

    npm install
  4. Run npm test:watch which will run tests when source files change.

When contributing, please:

  • Fork the repository
  • Accompany each logical unit of operation with at least one test
  • Open a pull request
  • Do not include any distribution files (such as dist/byte-buffer.js)

Alternative Comparisons

Christopher Chedeau's jDataView

  • Maintains read-index and supports seeking
  • Various string/char utilities (may support UTF-8)
  • Does not support writing values
  • Does not support NULL-terminated C-strings
  • Does not support growing, clipping, cloning and reversing
  • Supports a wide range of browsers/setups

David Flanagan's BufferView

  • Supports reading/writing values
  • Maintains index and supports seeking
  • Supports UTF-8 characters
  • Does not support NULL-terminated C-strings
  • Does not support growing, clipping, cloning and reversing as view and buffer are immutable

byte-buffer's People

Contributors

dependabot[bot] avatar timkurvers avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

byte-buffer's Issues

Is this equivalent to AS3's IDataInput/Output?

I'd like to translate some AS3 code into Javascript.
Since my AS3 code heavily depends on IDataInput and IDataOutput to read/write binary files, I'd like to know if this library is a solid equivalent for my use case.

the length of the buffer should grow double times than previous

the worsest scenario is that, append 1 byte repeatly.
if total buffer size finally is 1MBtye, write 1 byte one by one
then the waste memory is that ((1M-1) + 1)(1M-1) / 2 ≈ 0.5TByte, if total buffer size is N Byte, the waste memory is almost equal N^2/2,
the memory leak is scary

the best way to increse buffer size is use doule times increase,
so if total buffer size finally is 1MBtye+1, write bytes free of hands.
then the waste memory is that (1MByte-1) + 1Mbyte*2 -1(the unused memory + 1b+11b+111b+1111b+...+1M) ≈ 3MByte

the waste uint8array class instatiate calculate is the same

ref: https://github.com/openjdk-mirror/jdk/blob/jdk8u/jdk8u/master/src/share/classes/java/io/ByteArrayOutputStream.java#L113
java use double times buffer size increase

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.