System Message not being sent to llama.cpp

[CambridgeComputing]

System Message not being sent to llama.cpp

[CambridgeComputing]

I cut the system_message out of the model section and put it in the main "ContinueConfig" and it seems to be working now! I thought I had tried that but it looks like I forgot to save the config before trying again. I also now see in the GUI where the system message can be changed - great feature that I totally overlooked. I was going to close this issue but figured I'd leave it to you in case there is an issue in the config parser that was still in the works. Thanks again for pointing me in the right direction!

[sestinj]

@CambridgeComputing I believe we must be overriding the system_message that you set for the individual model with the system message from top-level config settings (system_message=None in you config.py). Can you try setting the system message there? (you can also do this from the settings UI)

It does make sense that the behavior would be to preference the model system_message first, so I'll update for this.

[sestinj]

glad it's working! going to close this issue now that I've made the update to how the config is parsed (though I won't push that particular update til later tomorrow). Then you'd be able to set a specific system_message per model, which shouldn't get overwritten by the main system_message