BUG: Unexpected Styler.format behavior

[quangngd]

BUG: Unexpected Styler.format behavior

[attack68]

This is not a bug. It is as documented. escaping is done before formatter.

This is actually a feature by design and was implemented this way after careful consideration.

Achieving the result you want is possible. It is simply to design your own formatter that performs escaping after it has formatted your text. Then you do not add anything to the esacpe argument directly.

[rhshadrach]

This is actually a feature by design and was implemented this way after careful consideration.

Just curious - what is the benefit of escaping prior?

[attack68]

To be honest I can't remember exactly, we are going back a few years.
It may be that in the way it is designed you can achieve both, whilst that might be trickier with the reverse.
It seems more natural that if you:

• Turned on escape and added a formatter your formatter is applied to the strings that have been pre-escaped.
• Turned off escape and added a formatter that formatter will operate directly on the strings unchanged (and then can include your own escaping function if you so choose).

[rhshadrach]

To be honest I can't remember exactly, we are going back a few years.

Makes sense, no problem. The trouble I'm having is I can't envision a use case where you wouldn't want escaping to be the very last step.

It is simply to design your own formatter that performs escaping after it has formatted your text.

What would the code for this look like? At a glance, it sounds intricate in the general case.

[attack68]

OK I think it came to me.
Setup a DF and show it (you have to escape this to see the <div>):

df = DataFrame(["ab&%<div>"])
df.style.format(escape="html")

Since Styler is a display tool one can use the formatter to hack elements into HTML or LaTeX, for specific rows, columns or even cells, with native HTML or LaTeX commands. Something like this:

df.style.format('<span style="color:red;">{}</span>', escape="html")

This will not work if you escape after the fact. You can simulate escaping after as follows:

from pandas.io.formats.style_render import _str_escape
def custom_formatter(s):
    s = '<span style="color:red;">{}</span>'.format(s)
    return _str_escape(s, "html")
df.style.format(custom_formatter)

Thus with the current system you can do everything if you know the various mechanisms.

You could of course argue that one could write a customer formatter to escape first and then format, but I do also think there were possibly some other reasons when mixing the other things that the format function did, e.g. hyperlinks, which shouldn't be escaped.