Improve speed

[bnaya]

Improve speed

[Bnaya]

Hey Vladislav!
Thanks for your feedback!

Can you share some code?
I want to try and figure if there's any specific slowdown cause in your use case
Currently the object is implement using simple linked list, and there's inherit overhead of working with arraybuffer that way, but it can be improved

[darky]

import * as objectbufferModule from "@bnaya/objectbuffer";
import { job, start, stop } from "microjob";

(async () => {
  await start({ maxWorkers: 1 });
  // cache require
  await job(() => {
    require("@bnaya/objectbuffer");
  });

  console.time("buffer");
  const externalArgs: objectbufferModule.ExternalArgs = {
    textEncoder: new TextEncoder(),
    textDecoder: new TextDecoder(),
    arrayAdditionalAllocation: 20,
    minimumStringAllocation: 0
  };

  const myObjectBufferOnMainThread = objectbufferModule.createObjectBuffer(
    externalArgs,
    1024,
    {
      some: {
        nested: [
          {
            thing: "im the value to follow"
          }
        ]
      }
    },
    { useSharedArrayBuffer: true }
  );

  const shared = objectbufferModule.getUnderlyingArrayBuffer(
    myObjectBufferOnMainThread
  );

  await job(
    async () => {
      const objectbufferModule = require("@bnaya/objectbuffer");
      const myObjectBufferOnMainThread = objectbufferModule.loadObjectBuffer(
        {
          textEncoder: new TextEncoder(),
          textDecoder: new TextDecoder(),
          arrayAdditionalAllocation: 20,
          minimumStringAllocation: 0
        },
        shared
      );
      myObjectBufferOnMainThread.some.nested.push(13);
    },
    { shared }
  );
  console.log(myObjectBufferOnMainThread.some.nested[1]);
  console.timeEnd("buffer");

  console.time("simple");
  let data = {
    some: {
      nested: [
        {
          thing: "im the value to follow"
        }
      ]
    }
  };
  const newData = await job(
    async data => {
      data.some.nested.push(13);
      return data;
    },
    { data }
  );
  console.log(newData.some.nested[1]);
  console.timeEnd("simple");

  // stop();
})();

Please, install microjob from here: darky/microjob#a00474ef0e833c3d09435f080b6ff9aae9b342f8
Shared memory support not merged at this moment

[Bnaya]

For small objects, the speed of serialize + deserialize is expected to always be faster than using that library.
The overhead of writing all the logic in javascript, has it price.

But for example, if you want to sort big array on a worker,
that serialize + deserialize will be expensive from CPU and memory wise.

A side note: you are not using locks, you might get data races.

[darky]

Ok, thanks! I try to benchmark on larger data later :)