zackakil/video-intelligence-api-visualiser

A simple app that lets you visualise annotations from the Google Cloud Video Intelligence API using your local files.

Video Intelligence API Visualiser (try now)

An app that visualises annotations from the Google Cloud Video Intelligence API.

Use this script to generate your own json outputs.

Uses

• See all of the capabilities of the Video Intelligence API.
• Upload your own data files to quickly visulise your own annotations.
• Play with the interactive confidence threshold to find the right one for your usecase.

Google Analytics Tracking

This demo uses Google Analytics to track user activity. By using this demo, you are consenting to the collection of your data by Google Analytics. To learn more about Google Analytics and how it collects and uses data, please visit the Google Analytics privacy policy.

video-intelligence-api-visualiser's Issues

add more example videos

How to get PERSON_DETECTION attributes?

Currently "result" does not generate attributes of person like:

UpperCloth:Yellow 0.0027923339512199163
UpperCloth:White 0.003149580443277955
UpperCloth:TankTop 0.0005836356431245804
UpperCloth:T-Shirt 0.04742685332894325
UpperCloth:Sweater 0.032353583723306656
UpperCloth:Suit 0.00021243176888674498
UpperCloth:Striped 0.006438440643250942
UpperCloth:Spotted 0.0006699545192532241
UpperCloth:ShortSleeve 0.03521478921175003
UpperCloth:Shirt 0.02210160531103611
UpperCloth:Red 0.0031773068476468325
UpperCloth:Purple 0.0076485988683998585
UpperCloth:Plain 0.9111855030059814
UpperCloth:Plaid 0.00020911525643896312
UpperCloth:Orange 4.279583299648948e-05
UpperCloth:NoSleeve 0.00027835002401843667
UpperCloth:MultiColor 0.04962644726037979
UpperCloth:LongSleeve 0.9889023303985596
UpperCloth:Jacket 0.6971068382263184
UpperCloth:Green 0.025935975834727287
UpperCloth:Gray 0.007227590307593346
UpperCloth:Graphics 0.04814588651061058
UpperCloth:Floral 0.0022292593494057655
UpperCloth:Dress 0.0045667728409171104
UpperCloth:Coat 0.015692155808210373
UpperCloth:Brown 0.00029499069205485284
UpperCloth:Blue 0.2514462172985077
UpperCloth:Black 0.833584189414978
LowerCloth:ShortSkirt 0.0067656803876161575
LowerCloth:ShortPants 0.10137072205543518
LowerCloth:LongSkirt 0.001374957268126309
LowerCloth:LongPants 0.9604998230934143

I have set "include_attributes=True"

person_config = videointelligence.PersonDetectionConfig(
include_bounding_boxes=False,
include_attributes=True,
include_pose_landmarks=False,
)

Any way to get this?

added frame label detection

add json view

Browser get stuck on large files (1hr video and its JSON)

Hi Zack,

First of all, thanks for your awesome work. UI works great on smaller duration videos (~10min) and JSON to visualize the output in UI. But I faced issues on large duration videos as mentioned below:

I generated couple of JSON from Video Intelligence API on two videos of 30 mins and 60 mins duration. Once I upload video and Json in UI, browser gets freeze and stuck to load and visualize JSON output in browser. For your reference, I have 64GB RAM and 8 core of CPU in my laptop. Kindly help me to resolve this issue and any other suggestions/alternative approach to fix it.
Thanks :)

Add celebrity recognition

I know this is a restricted API.

I'd be happy to work on this if you're accepting PRs.

BTW this is an amazingly useful project! Thank you.

No label data in JSON

Hi!

The json file from this Qwik Start doesnt work : https://www.cloudskillsboost.google/focuses/603?parent=catalog&qlcampaign=77-18-gcpd-921&utm_source=gcp&utm_campaign=vintelligence&utm_medium=documentation

Any hints please?

Here's my Json file
{ "@type": "type.googleapis.com/google.cloud.videointelligence.v1.AnnotateVideoResponse", "annotationResults": [ { "input_uri": "/video-ai-zap/test.mp4", "segment": { "endTimeOffset": "93.343250s", "start_time_offset": "0s" }, "segmentLabelAnnotations": [ { "categoryEntities": [ { "description": "car", "entityId": "/m/0k4j", "languageCode": "en-US" } ], "entity": { "description": "off road vehicle", "entityId": "/m/035f_j", "languageCode": "en-US" }, "segments": [ { "confidence": 0.61001694, "segment": { "endTimeOffset": "93.343250s", "startTimeOffset": "0s" } } ] }....,

allow url to specific specific feature tab to jump to

so that it can be directly linked to from feature doc pages.

how to solve the below errors?

the video-intelligence has been working perfect for me until today. I am getting this error when i run the python script, any tips how to solve this?

`Traceback (most recent call last):
File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/google/api_core/grpc_helpers.py", line 66, in error_remapped_callable
return callable_(*args, **kwargs)
File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/grpc/_channel.py", line 946, in call
return _end_unary_response_blocking(state, call, False, None)
File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/grpc/_channel.py", line 849, in _end_unary_response_blocking
raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
status = StatusCode.NOT_FOUND
details = "Requested entity was not found."
debug_error_string = "{"created":"@1666866950.739890000","description":"Error received from peer ipv6:[2a00:1450:400e:80e::200a]:443","file":"src/core/lib/surface/call.cc","file_line":1064,"grpc_message":"Requested entity was not found.","grpc_status":5}"

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "run_video_intelligence.py", line 44, in
operation = video_client.annotate_video(
File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/google/cloud/videointelligence_v1/services/video_intelligence_service/client.py", line 428, in annotate_video
response = rpc(request, retry=retry, timeout=timeout, metadata=metadata,)
File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/google/api_core/gapic_v1/method.py", line 154, in call
return wrapped_func(*args, **kwargs)
File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/google/api_core/retry.py", line 283, in retry_wrapped_func
return retry_target(
File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/google/api_core/retry.py", line 190, in retry_target
return target()
File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/site-packages/google/api_core/grpc_helpers.py", line 68, in error_remapped_callable
raise exceptions.from_grpc_error(exc) from exc
google.api_core.exceptions.NotFound: 404 Requested entity was not found.`

Necesito atrapar a esta loka

#15 _

VID-20240506-WA0031.mp4

Necesito atrapar a esta ###

@loka****

License?

Hi, thanks for the great project! What license is this released under? Also, do you know if Google has plans to sunset the video intelligence api now that vertex is their focus?

Add support for Vertex AI?

I've trained a model to track objects in video. I would love to be able to upload a video file and see my predictions overlaid on the video? Can send example .mp4 and JSON if helpful.

Installation guide

Hi Zack,
can you please provide an installation guide or the VUE project with all the dependencies that you created when building this application?
When I pull your repo and launch index.html on my local pc, it does not work properly and it just plays the test video.

Thank you in advance

allow for remote file and "share analysis" via url

allow users to specify a url to share link that directs to publicly hosted videos and annotations

hello, I have a question, so adding it to the issue.

I read the source code carefully. thank you.

I fork the repository, configure the web front rendering with http, and then upload the video, the json file will not come out automatically. How can I automate this?

Should I configure these environments automatically?

Thanks!