my-other-github-account/llm-humaneval-benchmarks

llm-humaneval-benchmarks's Issues

Authentication failed when trying to benchmark Bing Chat

Hello,

I'm trying to do some benchmarks for Bing Chat and receive this error:

BingChat|DEBUG   |2023-07-24T08:29:17+0000|Importing cookies from: bing_cookies_1.json

DEBUG:BingChat:Importing cookies from: bing_cookies_1.json


---------------------------------------------------------------------------

JSONDecodeError                           Traceback (most recent call last)

[/usr/local/lib/python3.10/dist-packages/EdgeGPT/conversation.py](https://localhost:8080/#) in create(proxy, cookies)
    113         try:
--> 114             self.struct = response.json()
    115         except (json.decoder.JSONDecodeError, NotAllowedToAccess) as exc:

14 frames

JSONDecodeError: Expecting value: line 1 column 1 (char 0)


The above exception was the direct cause of the following exception:

Exception                                 Traceback (most recent call last)

[/usr/local/lib/python3.10/dist-packages/EdgeGPT/conversation.py](https://localhost:8080/#) in create(proxy, cookies)
    115         except (json.decoder.JSONDecodeError, NotAllowedToAccess) as exc:
    116             print(response.text)
--> 117             raise Exception(
    118                 "Authentication failed. You have not been accepted into the beta.",
    119             ) from exc

Exception: Authentication failed. You have not been accepted into the beta.

I've provided cookies, which do work when I run locally underlying EdgeGPT.
Please, pay attention that Query requires cookie_files not cookie_file in a new version of EdgeGPT:

answer = Query(
              prompt,
              style="precise",  # or: 'balanced', 'precise'
              # cookie_file="bing_cookies_*.json"
              cookie_files="/content/bing_cookies_1.json"
            )