[BUG] Embeddings not showing from brain key

[AlanBlanchet]

[BUG] Embeddings not showing from brain key

[MLRadfys]

Hi Benjamin and thanks for the reply!

Unfortunately not. Reloading the dataset does not help.

Kind regards,

M

[benjaminpkane]

I confirm that reloading the dataset doesn't help. For PCA which works I'm also not able to colorby the ground_truth label. Don't know if it's a distinct bug or if it is linked.

That is a separate issue likely. I have created #4324 which should resolve the original issue report

[benjaminpkane]

Hi @AlanBlanchet. I'm not sure we will be able to reproduce the issue you are seeing without a full script.

Part of the issue may be you are reusing (and not creating a new dataset) noting this output you shared

Loading existing dataset 'coco-2017'. To reload from disk, either delete the existing dataset or provide a custom `dataset_name` to use

To create a new dataset, you can use dataset.clone("cloned-dataset"), or give the zoo dataset a unique dataset_name when using foz.load_zoo_dataset()

[AlanBlanchet]

Hello and thanks for the reply @benjaminpkane .

Yes I'm using a dataset from the zoo. But it should be supported in the viewer ? Right ?
I tried to investigate further and managed to get an error from the backend.

The error is simply that we can't dump a numpy array to json when trying to access the API through http://localhost:5151/embeddings/plot.

It returns this error :

Traceback (most recent call last):
  File \"/home/alan/.cache/pypoetry/virtualenvs/fiftyone-test-KI_-E3R8-py3.10/lib/python3.10/site-packages/fiftyone/server/decorators.py\", line 34, in wrapper
    await run_sync_task(lambda: json_util.dumps(response))
  File \"/home/alan/.cache/pypoetry/virtualenvs/fiftyone-test-KI_-E3R8-py3.10/lib/python3.10/site-packages/fiftyone/core/utils.py\", line 2317, in run_sync_task
    return await loop.run_in_executor(_get_sync_task_executor(), func, *args)
  File \"/home/alan/.pyenv/versions/3.10.13/lib/python3.10/concurrent/futures/thread.py\", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File \"/home/alan/.cache/pypoetry/virtualenvs/fiftyone-test-KI_-E3R8-py3.10/lib/python3.10/site-packages/fiftyone/server/decorators.py\", line 34, in <lambda>
    await run_sync_task(lambda: json_util.dumps(response))
  File \"/home/alan/.cache/pypoetry/virtualenvs/fiftyone-test-KI_-E3R8-py3.10/lib/python3.10/site-packages/bson/json_util.py\", line 472, in dumps
    return json.dumps(_json_convert(obj, json_options), *args, **kwargs)
  File \"/home/alan/.pyenv/versions/3.10.13/lib/python3.10/json/__init__.py\", line 231, in dumps
    return _default_encoder.encode(obj)
  File \"/home/alan/.pyenv/versions/3.10.13/lib/python3.10/json/encoder.py\", line 199, in encode
    chunks = self.iterencode(o, _one_shot=True)
  File \"/home/alan/.pyenv/versions/3.10.13/lib/python3.10/json/encoder.py\", line 257, in iterencode
    return _iterencode(o, 0)
  File \"/home/alan/.pyenv/versions/3.10.13/lib/python3.10/json/encoder.py\", line 179, in default
    raise TypeError(f'Object of type {o.__class__.__name__} '
TypeError: Object of type float32 is not JSON serializable

I haven't had time to investigate why but :

• I made a github repo to reproduce the issue
• I also made a youtube video showing how I ran the env

I changed the main.py file to drop the dataset and re-download it if it already exists.

I don't really know how data flows back to the frontend but I guess a fix would be to add a .tolist() if the data is an instance of np.array. I just don't know where...

[MLRadfys]

Hi,

Iam encountering the same issue. For UMAP and TSNE no visualizations are shown when using the brain plugins.. I noticed though that PCA works.

regards,

M

[benjaminpkane]

This may be a caching issue. Running the reload_dataset operator may resolve the issue when encountered

Screen.Recording.2024-04-25.at.2.57.19.PM.mov

[AlanBlanchet]

I confirm that reloading the dataset doesn't help.
For PCA which works I'm also not able to colorby the ground_truth label. Don't know if it's a distinct bug or if it is linked.

[MLRadfys]

Awesome, thanks Benjamin!