Comments (3)
Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in run_code
File "C:\Users\37620\miniconda3\Scripts\img2dataset.exe_main.py", line 7, in
File "C:\Users\37620\miniconda3\Lib\site-packages\img2dataset\main.py", line 270, in main
fire.Fire(download)
File "C:\Users\37620\miniconda3\Lib\site-packages\fire\core.py", line 141, in Fire
component_trace = _Fire(component, args, parsed_flag_args, context, name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\37620\miniconda3\Lib\site-packages\fire\core.py", line 475, in _Fire
component, remaining_args = _CallAndUpdateTrace(
^^^^^^^^^^^^^^^^^^^^
File "C:\Users\37620\miniconda3\Lib\site-packages\fire\core.py", line 691, in _CallAndUpdateTrace
component = fn(*varargs, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\37620\miniconda3\Lib\site-packages\img2dataset\main.py", line 179, in download
reader = Reader(
^^^^^^^
File "C:\Users\37620\miniconda3\Lib\site-packages\img2dataset\reader.py", line 68, in init
self.column_list = self.column_list + ["caption"]
~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~
TypeError: can only concatenate str (not "list") to str
wandb: (1) Private W&B dashboard, no account required
wandb: (2) Create a W&B account
wandb: (3) Use an existing W&B account
wandb: (4) Don't visualize my results
wandb: Enter your choice: Traceback (most recent call last):
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\sdk\wandb_init.py", line 1172, in init
wi.setup(kwargs)
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\sdk\wandb_init.py", line 306, in setup
wandb_login._login(
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\sdk\wandb_login.py", line 317, in _login
wlogin.prompt_api_key()
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\sdk\wandb_login.py", line 240, in prompt_api_key
key, status = self._prompt_api_key()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\sdk\wandb_login.py", line 220, in _prompt_api_key
key = apikey.prompt_api_key(
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\sdk\lib\apikey.py", line 114, in prompt_api_key
result = prompt_choices(
^^^^^^^^^^^^^^^
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\util.py", line 1265, in prompt_choices
choice = _prompt_choice(input_timeout=input_timeout, jupyter=jupyter)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\util.py", line 1248, in _prompt_choice
choice = input_fn(text)
^^^^^^^^^^^^^^
EOFError: EOF when reading a line
Process LoggerProcess-1:
Traceback (most recent call last):
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\sdk\wandb_init.py", line 1172, in init
wi.setup(kwargs)
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\sdk\wandb_init.py", line 306, in setup
wandb_login._login(
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\sdk\wandb_login.py", line 317, in _login
wlogin.prompt_api_key()
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\sdk\wandb_login.py", line 240, in prompt_api_key
key, status = self._prompt_api_key()
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\sdk\wandb_login.py", line 220, in _prompt_api_key
key = apikey.prompt_api_key(
^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\sdk\lib\apikey.py", line 114, in prompt_api_key
result = prompt_choices(
^^^^^^^^^^^^^^^
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\util.py", line 1265, in prompt_choices
choice = _prompt_choice(input_timeout=input_timeout, jupyter=jupyter)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\util.py", line 1248, in _prompt_choice
choice = input_fn(text)
^^^^^^^^^^^^^^
EOFError: EOF when reading a line
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "C:\Users\37620\miniconda3\Lib\multiprocessing\process.py", line 314, in _bootstrap
self.run()
File "C:\Users\37620\miniconda3\Lib\site-packages\img2dataset\logger.py", line 217, in run
self.current_run = wandb.init(project=self.wandb_project, config=self.config_parameters, anonymous="allow")
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\37620\miniconda3\Lib\site-packages\wandb\sdk\wandb_init.py", line 1214, in init
raise Error("An unexpected error occurred") from error_seen
wandb.errors.Error: An unexpected error occurred
from img2dataset.
Hey @SomnusQue Have a look at this: https://lightning.ai/lightning-ai/studios/download-stream-400m-images-text~01hg0zg8fyybp7p1sma6g9dkzm
from img2dataset.
That's a windows problem with escaping the columns
Try another terminal
from img2dataset.
Related Issues (20)
- parallelize tests with gh action containers
- cannot download laion-high-resolution HOT 2
- LAION-Aesthetic Huggingface Error: Access to this resource is disabled. HOT 1
- custom dataset HOT 1
- cc3m dataset HOT 3
- pyarrow.lib.ArrowInvalid: Empty CSV file
- Implement mode to retry failed urls of all shards HOT 1
- Low success rate on donwloading laion400m HOT 26
- laion-coco is not available
- Download hangs at End
- GCS url_path either not recognized as directory or mangled glob HOT 1
- Is the field 'similarity' in Parquet file referring to the cosine similarity of the feature representations of image-text pairs? How is this metric computed?
- placekitten.com example in README fails to download images HOT 1
- The success rate when downloading the sbu data set is extremely low at 0 HOT 1
- Question about LAION-400M
- s3 paths in url_list are not supported HOT 1
- Decompressing the downloaded tar file is very slow HOT 1
- pyarrow.lib.ArrowInvalid: No match for FieldRef.Name(URL) in sample_id: double HOT 1
- Support read image from local path HOT 2
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from img2dataset.