Feature Request: Transformer Debugger - Debugging and controlling the behavior of transformer based LLM models.

[abhaskumarsinha]

Feature Request: Transformer Debugger - Debugging and controlling the behavior of transformer based LLM models.

[SamanehSaadat]

Hi @abhaskumarsinha

Thanks for the suggestion! How do you envision Transformer Debugger to be incorporated into KerasNLP. Does it require the integration with a tool in our library? Or do we just need to create a guide?

[SamanehSaadat]

Note that there is an on-going effort to integrate Learning Interpretability Tool (LIT) with KerasNLP. #1521 is an example of adding the .score() function for interpretability use cases.

[abhaskumarsinha]

Hello @SamanehSaadat

Thanks for the suggestion! How do you envision Transformer Debugger to be incorporated into KerasNLP. Does it require the integration with a tool in our library? Or do we just need to create a guide?

I believe we should reserve one whole directory for interpretability tools here: https://github.com/keras-team/keras-nlp/tree/master/keras_nlp we would need to incorporate the whole thing but that's a time-consuming goal.

Here's a one-minute video on how that works: https://www.youtube.com/watch?v=5D_GiJv7O-M

Note that there is an ongoing effort to integrate Learning Interpretability Tool (LIT) with KerasNLP. #1521 is an example of adding the .score() function for interpretability use cases.

Thank you for pointing that out. I'm not an expert here, but LIT sounds like a very general approach while TDB is a very specific LLM approach. TDB could be a very long and lengthy feature to implement, so I'm all up to contribute in case there is any need.