Strange issue with long prompts

[hc20k]

Strange issue with long prompts

[lameTookan]

got an error message after maybe 5 minutes this time formatted like an error message the code before was just within the actual response. It seemed like it actually was starting to respond at the begining?

`Gateway timeout. {"error":{"code":524,"message":"Gateway timeout.","param":null,"type":"cf_gateway_timeout"}} 524 {'error': {'code': 524, 'message': 'Gateway timeout.', 'param': None, 'type': 'cf_gateway_timeout'}} <CIMultiDictProxy('Date': 'Thu, 20 Apr 2023 09:44:37 GMT', 'Content-Type': 'application/json', 'Content-Length': '92', 'Connection': 'keep-alive', 'X-Frame-Options': 'SAMEORIGIN', 'Referrer-Policy': 'same-origin', 'Cache-Control': 'private, max-age=0, no-store, no-cache, must-revalidate, post-check=0, pre-check=0', 'Expires': 'Thu, 01 Jan 1970 00:00:01 GMT', 'Server': 'cloudflare', 'CF-RAY': '7bac647c093e968e-SJC')>

Retry
[2:44 AM]
`

[hc20k]

Hmm that's very weird, what model are you using?

[lameTookan]

GPT-4

[hc20k]

Interesting, I’ve never ran into something like that using gpt-4, can you send me the prompt that was used to generate this? It could also be the temperature/frequency penalty/presence penalty settings

[hc20k]

Closing this for now, let me know if this happens again :)

[lameTookan]

Forgot about this but I by mistake had been running two instances of the same bot with nohub (before I learned about screen) and I guess it was trying to work with the same files and either code was included in the response or sent to the API causing the really weird responses.