assembly-101/assembly101-download-scripts

Python scripts to download Assembly101 from Google Drive

assembly101-download-scripts's Issues

What is the joint Annotation format?

I couldn't find what joints the keypoints in expressed in the pose@60fps folder referred to.

Unable to authenticate: this app is blocked

I have seen the info in #12 but I can't find a solution.
Here is what I have done:

1. get the latest github https://github.com/assembly-101/assembly101-download-scripts
2. edit the file client_secrets.json
3. update the line to set the right key given in your email "client_secret":"the-right-key"
4. run

python authenticate.py

6. The browser is opening asking me to tell which account to use.
7. I select my account
8. I received "this app is blocked", and I don't have acces to the "advanced link" to force passing the authentification process

Can you give us a step by step procedure to get your dataset?

Thank you

Correspondence between actual hand joints to row index of per-frame hand pose

Hi. For the per-frame pose labels provided in the poses@60fps folder, I wonder what is the correspondence between actual hand joints and the row index for "0" and "1" in per-frame landmarks, as well as which of the "0" and "1" represents the right hand?

Thanks.

Size of the dataset

Is it possible to know the size on disk of the entire dataset?

Camera Intrinsics for the 12 views

Hi. I wonder whether the camera intrinsics for the 12 views can be provided, so that I can project the provided 3D hand pose into images of respective views.

Thanks for your help!

Best regards,
Frances

Access blocked: This app’s request is invalid

Hi,

Thanks for sharing the scripts!

When I tried to run authentic.py I got this error "This app is blocked. This app tried to access sensitive info in your Google Account. To keep your account safe, Google blocked this access."
I followed the instructions in #12 and created a client_secret_id.json, I renamed it to client_secrets.json and tried download.py, then I got a different error: "Access blocked: This app’s request is invalid"

Any help will be appreciated. Thanks!

How to get all mano parameters for all the 12 views?

Hi, The mano parameters are available for all views？

Error when downloading video file (QuotaExceeded)

Hello, when i try to download the file in a new environment, I find that I failed to down any of them. While i was tracking the execusion of the download.py, I found the following exception:

Traceback (most recent call last):
File "/ghome/l5/ylwen/anaconda3/envs/hand39/lib/python3.9/site-packages/pydrive2/files.py", line 338, in GetContentFile
download(
File "/ghome/l5/ylwen/anaconda3/envs/hand39/lib/python3.9/site-packages/pydrive2/files.py", line 328, in download
status, done = downloader.next_chunk()
File "/ghome/l5/ylwen/anaconda3/envs/hand39/lib/python3.9/site-packages/googleapiclient/_helpers.py", line 130, in positional_wrapper
return wrapped(*args, **kwargs)
File "/ghome/l5/ylwen/anaconda3/envs/hand39/lib/python3.9/site-packages/googleapiclient/http.py", line 780, in next_chunk
raise HttpError(resp, content, uri=self._uri)
googleapiclient.errors.HttpError: <HttpError 403 when requesting https://www.googleapis.com/drive/v2/files/1L4_EzFtZr1zaEjUE_gwn3_NqjXkxf2jU?acknowledgeAbuse=false&alt=media returned "The download quota for this file has been exceeded". Details: "[{'domain': 'usageLimits', 'reason': 'quotaExceeded', 'message': 'The download quota for this file has been exceeded', 'locationType': 'other', 'location': 'quota.download'}]">

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/ghome/l5/ylwen/HOA/ass101/download-scripts/download.py", line 139, in
download_file(out_path, video_name, video_file)
File "/ghome/l5/ylwen/HOA/ass101/download-scripts/download.py", line 79, in download_file
file.GetContentFile(file['title'])
File "/ghome/l5/ylwen/anaconda3/envs/hand39/lib/python3.9/site-packages/pydrive2/auth.py", line 84, in _decorated
return decoratee(self, *args, **kwargs)
File "/ghome/l5/ylwen/anaconda3/envs/hand39/lib/python3.9/site-packages/pydrive2/files.py", line 350, in GetContentFile
raise exc
pydrive2.files.ApiRequestError: <HttpError 403 when requesting https://www.googleapis.com/drive/v2/files/1L4_EzFtZr1zaEjUE_gwn3_NqjXkxf2jU?acknowledgeAbuse=false&alt=media returned "The download quota for this file has been exceeded". Details: "[{'domain': 'usageLimits', 'reason': 'quotaExceeded', 'message': 'The download quota for this file has been exceeded', 'locationType': 'other', 'location': 'quota.download'}]">

Therefore I write to seek your help. Thank you so much for your valuable time and help.

Best regards,
Frances

TSM features

Hi, I have a question about the TSM features. Is it trained on assembly101 or other datasets?

"TSM_features: containing per-frame visual features extracted by TSM."

Intrinsic Calibration

Is it possible to get the intrinsic calibration of the 8 fixed cameras?

account error

此应用试图访问您 Google 帐号中的敏感信息。为确保您的帐号安全，Google 阻止了此次访问。

Download issues

Hi, trying to download (only the egocentric view) the code stops without downloading the videos and without reporting any error. How to fix?

Google Drive Issue

Hi, I get an access code and write it into the client_secrets.json. Run authenticate.py will lead me to browser and I authenticate the app "download". After that, it tells me "The authentication flow has completed". Nothing happened then and I can't do anything. How can I solve this problem?

Issues when downloading file to different file system (and other potential issues)

Hey. I would first like to thank you all for the dataset!

I had a suggestion for the video download process. In the following lines -

        try:
		file.GetContentFile(file['title'])
		os.rename(f'{file_name}', f'{out_path}/{file_name}')
	except:
		# if any video fails to download completely, its name will be stored in error_downloading.txt
		with open('./error_downloading.txt', 'a') as f:
			f.write(f'{out_path}/{file_name}\n')
		os.remove(f'{file_name}')

when you add the name to error_downloading.txt, can you also save the exception that we get? It would greatly help to debug why the dataset is not being downloaded.

I tried to download it, and after removing the except, I was able to figure out that I was getting OSError: [Errno 18] Invalid cross-device link because I was trying to store the data on another drive!

Thanks again!

TSM_features download

Hi, is it possible to download only the TSM_features using these scripts? Arguments taken from the download.py script make no reference to downloading features.

Failure to generate the credentials.json with authenticate.py

Hi.

When I execute the authenticate.py, I cannot generate the credentials.json: The localhost:8080 in my local chrome browser shows the message "The authentication flow has completed", but the console of my terminal reports bugs, as shown in the attached image.

And therefore I write to seek your help.
Thanks a lot.

Best regards,
Frances

Unable to authenticate

I'd like to download the data and at first tried authenticate.py.

It gave the url and I logged in my account to which you gave permission to access a Google Drive of the project. However, it gave an error that said "This app is blocked. This app tried to access sensitive info in your Google Account. To keep your account safe, Google blocked this access."

I found out that this might be related to this article (https://support.google.com/accounts/answer/6010255) but I couldn't turn on "Less secure app access".

Camera calibration files

Dear Assembly-101-team,

thank you for providing us with this dataset!

I wasn't able to find calibration files for all cameras. Just the head-mounted one but when I want to know the 3D-data of the hand coordinates, I need to be able to translate the ground truth from the head-mounted camera to the side cameras (as these are the relevant perspectives for me). Is it possible to get these calibration files?

This app is blocked

how to download metadata, camera intrinsics, poses@60fps, etc with PyDrive

Hi! I'm hoping to use the download.py script to download more than just the videos.

I tried extracting the names of files in the GDrive and searching for them but it seems none of the files contain .jsons from the poses@60fps folder.

Any help would be appreciated and/or I'll post how I figure it out if I do.