patelneel55/memoree

patelneel55.github.io

memoree's Issues

Analyzed JSON files >1gb results in a memory overflow error

This occurs due to the memory restrictions of Firebase Functions and limitations in NodeJs string parsing.

A fix would be to replace loading the entire json file into memory with a json stream or analyzing in chunks.

Identify video timestamps during upload

When uploading videos to the GCP buckets, extract possible timestamps from file metadata and add metadata fields on the GCP entry. This entry is extracted by the processJson function and passed onto the search engine instance for data access and/or search optimization. Will need to update search engine schema to add a new timestamp field.

Documentation Structure

Start with providing a quick introduction of the project along with program requirements.
Provide different options of implementing the needed services (eg. Algolia vs TypeSense, Docker vs Firebase Hosting etc.)

Create wiki page for each individual service to cover setup info and debugging info:

• Firebase Functions
• Firebase Hosting
• GCP/Cloud Instance
• Algolia
• TypeSense
• Docker
• Flutter

Collect video entity tags to display in UI

Update the search engine schema to incorporate the file_name entry as a facet field so that it can be directly searchable and collect the individual entries and its identifiable entities. This can be used to provide the list of tags in the info section of a video and can also be utilized to optimize searches. Will work in conjunction with issue #3