google-research/android_world

AndroidWorld is an environment and benchmark for autonomous agents

Google Research

This repository contains code released by Google Research.

All datasets in this repository are released under the CC BY 4.0 International license, which can be found here: https://creativecommons.org/licenses/by/4.0/legalcode. All source files in this repository are released under the Apache 2.0 license, the text of which can be found in the LICENSE file.

---

Because the repo is large, we recommend you download only the subdirectory of interest:

• Use GitHub editor to open the project. To open the editor change the url from github.com to github.dev in the address bar.
• In the left navigation panel, right-click on the folder of interest and select download.

If you'd like to submit a pull request, you'll need to clone the repository; we recommend making a shallow clone (without history).

git clone [email protected]:google-research/google-research.git --depth=1

---

Disclaimer: This is not an official Google product.

Updated in 2023.

android_world's Issues

Is MarkorTranscribeVideo a valid task?

Hello!

I got this FileNotFoundError when runing 'MarkorTranscribeVideo':

  File "/Users/username/PycharmProjects/android_world/android_world/suite_utils.py", line 229, in _run_task
    task.initialize_task(env)
  File "/Users/username/PycharmProjects/android_world/android_world/task_evals/single/markor.py", line 859, in initialize_task
    user_data_generation.write_video_file_to_device(
  File "/Users/username/PycharmProjects/android_world/android_world/task_evals/utils/user_data_generation.py", line 283, in write_video_file_to_device
    file_utils.copy_data_to_device(
  File "/Users/username/PycharmProjects/android_world/android_world/utils/file_utils.py", line 398, in copy_data_to_device
    raise FileNotFoundError(f"{local_path} does not exist.")
FileNotFoundError: /tmp/ZwUN_moment_70_.mp4 does not exist.
agent_nameîå	m3a_gpt4vîua.

Is this task actually valid or NaN? and btw, in the paper's reported score, whether NaN is counted as failure or not?

Add new task

Hi, thanks for the outstanding work.
Now, I want to add more tasks, (for example, add new tasks of Simple Calendar Pro App), and how can I achieve the goal? Do I need to make changes to the android_env package?
Thanks. :-)

Where is "task" and "joplin"?

Thank you for this excellent project. I have a question: you mentioned "task" and "joplin" in the papers, task_app_utils, and joplin_app_utils, but why are they not appearing in the registry?