I followed the howto, pulled the current docker image from "depositame/rvc_runpod_serverless/general" and deployed the image on my runpod console. Deplyoment ran smoothly on runpod.
When creating a request for the endpoint on runpod with an adjusted input_json (the audio_url and model_name given in the howto don not exist any longer), i run into an python error which is visible in the runpod logs. For input paramters i used an mp3 file (small 3min song) and another model from "sail-rvc".
Here is the error i am getting:
AttributeError: 'NoneType' object has no attribute 'tobytes'
temp_dir = Path(dir) / self.hash_bytes(data.tobytes())
More context to the log/trace:
2024-06-28 19:18:26.620
[ocmtv88uo73xas]
[info]
INFO | 68a8cde3-c7ec-4ba3-80e3-3a8cf59b1c44-e1 | Finished
2024-06-28 19:18:26.466
[ocmtv88uo73xas]
[info]
}
2024-06-28 19:18:26.466
[ocmtv88uo73xas]
[info]
"pod_id": "ocmtv88uo73xas"
2024-06-28 19:18:26.466
[ocmtv88uo73xas]
[info]
"host_name": "ocmtv88uo73xas-64411128",
2024-06-28 19:18:26.466
[ocmtv88uo73xas]
[info]
"error_traceback": "Traceback (most recent call last):\n File "/opt/conda/lib/python3.10/site-packages/runpod/serverless/modules/job.py", line 85, in run_job\n job_output = handler(job)\n File "/rvc_serverless/main.py", line 283, in handler\n return self.infer(request)\n File "/rvc_serverless/main.py", line 229, in infer\n result = client.predict(\n File "/opt/conda/lib/python3.10/site-packages/gradio_client/client.py", line 285, in predict\n return self.submit(*args, api_name=api_name, fn_index=fn_index).result()\n File "/opt/conda/lib/python3.10/site-packages/gradio_client/client.py", line 982, in result\n raise self.future._exception # type: ignore\n File "/opt/conda/lib/python3.10/concurrent/futures/thread.py", line 58, in run\n result = self.fn(*self.args, **self.kwargs)\n File "/opt/conda/lib/python3.10/site-packages/gradio_client/client.py", line 645, in _inner\n predictions = _predict(*data)\n File "/opt/conda/lib/python3.10/site-packages/gradio_client/client.py", line 676, in _predict\n raise ValueError(result["error"])\nValueError: None\n",
2024-06-28 19:18:26.466
[ocmtv88uo73xas]
[info]
"error_message": "None",
2024-06-28 19:18:26.466
[ocmtv88uo73xas]
[info]
"error_type": "<class 'ValueError'>",
2024-06-28 19:18:26.466
[ocmtv88uo73xas]
[error]
ERROR | {
2024-06-28 19:18:26.466
[ocmtv88uo73xas]
[error]
ERROR | 68a8cde3-c7ec-4ba3-80e3-3a8cf59b1c44-e1 | Captured Handler Exception
2024-06-28 19:18:26.457
[ocmtv88uo73xas]
[info]
AttributeError: 'NoneType' object has no attribute 'tobytes'
2024-06-28 19:18:26.457
[ocmtv88uo73xas]
[info]
temp_dir = Path(dir) / self.hash_bytes(data.tobytes())
2024-06-28 19:18:26.457
[ocmtv88uo73xas]
[info]
File "/opt/conda/lib/python3.10/site-packages/gradio/components/base.py", line 321, in audio_to_temp_file
2024-06-28 19:18:26.457
[ocmtv88uo73xas]
[info]
file_path = self.audio_to_temp_file(
2024-06-28 19:18:26.457
[ocmtv88uo73xas]
[info]
prediction_value = block.postprocess(prediction_value)
2024-06-28 19:18:26.457
[ocmtv88uo73xas]
[info]
File "/opt/conda/lib/python3.10/site-packages/gradio/blocks.py", line 1321, in postprocess_data
2024-06-28 19:18:26.457
[ocmtv88uo73xas]
[info]
data = self.postprocess_data(fn_index, result["prediction"], state)
2024-06-28 19:18:26.457
[ocmtv88uo73xas]
[info]
File "/opt/conda/lib/python3.10/site-packages/gradio/blocks.py", line 1387, in process_api
2024-06-28 19:18:26.457
[ocmtv88uo73xas]
[info]
output = await app.get_blocks().process_api(
2024-06-28 19:18:26.457
[ocmtv88uo73xas]
[info]
File "/opt/conda/lib/python3.10/site-packages/gradio/routes.py", line 439, in run_predict
2024-06-28 19:18:26.457
[ocmtv88uo73xas]
[info]
Traceback (most recent call last):
2024-06-28 19:18:25.221
[ocmtv88uo73xas]
[info]
Downloading model.index: 0%| | 0.00/373M [00:00<?, ?B/s] Downloading model.index: 3%|โ | 10.5M/373M [00:00<00:04, 76.9MB/s] Downloading model.index: 6%|โ | 21.0M/373M [00:00<00:04, 78.7MB/s] Downloading model.index: 8%|โ | 31.5M/373M [00:00<00:04, 79.2MB/s] Downloading model.index: 11%|โ | 41.9M/373M [00:00<00:04, 79.5MB/s] Downloading model.index: 14%|โโ | 52.4M/373M [00:00<00:04, 79.6MB/s] Downloading model.index: 17%|โโ | 62.9M/373M [00:00<00:03, 79.7MB/s] Downloading model.index: 20%|โโ | 73.4M/373M [00:00<00:03, 79.8MB/s] Downloading model.index: 22%|โโโ | 83.9M/373M [00:01<00:03, 79.7MB/s] Downloading model.index: 25%|โโโ | 94.4M/373M [00:01<00:03, 79.8MB/s] Downloading model.index: 28%|โโโ | 105M/373M [00:01<00:03, 79.8MB/s] Downloading model.index: 31%|โโโ | 115M/373M [00:01<00:03, 79.7MB/s] Downloading model.index: 34%|โโโโ | 126M/373M [00:01<00:03, 79.8MB/s] Downloading model.index: 37%|โโโโ | 136M/373M [00:01<00:03, 65.0MB/s] Downloading model.index: 39%|โโโโ | 147M/373M [00:01<00:03, 67.3MB/s] Downloading model.index: 42%|โโโโโ | 157M/373M [00:02<00:03, 70.6MB/s] Downloading model.index: 45%|โโโโโ | 168M/373M [00:02<00:02, 70.5MB/s] Downloading model.index: 48%|โโโโโ | 178M/373M [00:02<00:02, 68.4MB/s] Downloading model.index: 51%|โโโโโ | 189M/373M [00:02<00:02, 71.0MB/s] Downloading model.index: 53%|โโโโโโ | 199M/373M [00:02<00:02, 67.2MB/s] Downloading model.index: 56%|โโโโโโ | 210M/373M [00:02<00:02, 69.7MB/s] Downloading model.index: 59%|โโโโโโ | 220M/373M [00:03<00:02, 67.2MB/s] Downloading model.index: 62%|โโโโโโโ | 231M/373M [00:03<00:02, 68.6MB/s] Downloading model.index: 65%|โโโโโโโ | 241M/373M [00:03<00:01, 71.2MB/s] Downloading model.index: 67%|โโโโโโโ | 252M/373M [00:03<00:01, 73.5MB/s] Downloading model.index: 70%|โโโโโโโ | 262M/373M [00:03<00:01, 75.2MB/s] Downloading model.index: 73%|โโโโโโโโ | 273M/373M [00:03<00:01, 76.6MB/s] Downloading model.index: 76%|โโโโโโโโ | 283M/373M [00:03<00:01, 77.5MB/s] Downloading model.index: 79%|โโโโโโโโ | 294M/373M [00:04<00:01, 70.2MB/s] Downloading model.index: 82%|โโโโโโโโโ | 304M/373M [00:04<00:00, 72.4MB/s] Downloading model.index: 84%|โโโโโโโโโ | 315M/373M [00:04<00:00, 74.3MB/s] Downloading model.index: 87%|โโโโโโโโโ | 325M/373M [00:04<00:00, 75.9MB/s] Downloading model.index: 90%|โโโโโโโโโ | 336M/373M [00:04<00:00, 76.9MB/s] Downloading model.index: 93%|โโโโโโโโโโ| 346M/373M [00:04<00:00, 77.7MB/s] Downloading model.index: 96%|โโโโโโโโโโ| 357M/373M [00:04<00:00, 78.3MB/s] Downloading model.index: 98%|โโโโโโโโโโ| 367M/373M [00:04<00:00, 78.6MB/s] Downloading model.index: 100%|โโโโโโโโโโ| 373M/373M [00:05<00:00, 74.5MB/s]
2024-06-28 19:18:22.713
[ocmtv88uo73xas]
[info]
Downloading model.pth: 0%| | 0.00/55.2M [00:00<?, ?B/s] Downloading model.pth: 19%|โโ | 10.5M/55.2M [00:00<00:01, 30.1MB/s] Downloading model.pth: 38%|โโโโ | 21.0M/55.2M [00:00<00:00, 47.1MB/s] Downloading model.pth: 57%|โโโโโโ | 31.5M/55.2M [00:00<00:00, 57.3MB/s] Downloading model.pth: 76%|โโโโโโโโ | 41.9M/55.2M [00:00<00:00, 64.0MB/s] Downloading model.pth: 95%|โโโโโโโโโโ| 52.4M/55.2M [00:00<00:00, 68.9MB/s] Downloading model.pth: 100%|โโโโโโโโโโ| 55.2M/55.2M [00:00<00:00, 59.9MB/s]
2024-06-28 19:18:22.713
[ocmtv88uo73xas]
[info]
Downloading config.json: 0%| | 0.00/130 [00:00<?, ?B/s] Downloading config.json: 100%|โโโโโโโโโโ| 130/130 [00:00<00:00, 688kB/s]
2024-06-28 19:18:22.713
[ocmtv88uo73xas]
[info]
INFO | 68a8cde3-c7ec-4ba3-80e3-3a8cf59b1c44-e1 | Started
2024-06-28 19:18:22.713
[ocmtv88uo73xas]