Greatwork! Can we also support coding block in the UI for it to output code?

[getumbrel]

Greatwork! Can we also support coding block in the UI for it to output code?

[samuellukudu]

I think this capability should be coming in the next version of Llama

[greatbody]

I think this capability should be coming in the next version of Llama

That would be wonderful.

[nmfretz]

Thanks for the suggestion @greatbody! We noticed during testing that getting Llama 2 + Chatbot UI to output code blocks is difficult out-of-the-box. It is possible, but this needs to be the default behaviour:

This may be as easy as modifying the markdown logic in the Chatbot UI code.

[afyounie]

I just setup the 13B container in podman on RHEL 9. Tested to see if the code block worked correctly and this is what I get:

The code is stated before the code block. I asked a second time with a prompt I used on OpenAI's chat and it gave a similar response to ChatGPT 3.5, but it again put the code before the code block and then put the description for the code inside the code block. Still usable output, but the description is difficult to read because it is put on a single line inside the code block window.

Looking forward to using llama-gpt. Easy setup and works very well straight out of the box.