Wraps long URLs

[alir3z4]

Wraps long URLs

[Alir3z4]

I label this as bug.

@stefanor Thanks for follow up on this. Please feel free to open up/forward issues/bugs from
https://github.com/aaronsw/html2text/.

[jacobsvante]

Took me a while to find that html2text indirectly caused the %0A (newline in URL encoding) occurring in my links. I've temporarily disabled body_width wrapping in my code to prevent it.

parser = HTML2Text()
parser.body_width = 0
parser.handle(value)

[Alir3z4]

Hey @jmagnusson @stefanor
I see these two hacks trying to fix the issue:

• leonardoo/django-userena@4b5dd73
• emencia/emencia-django-newsletter@a9adff7

Do you think we can apply the same into htmltext without explicitly set body_width=0 ?

[theSage21]

@stefanor does this fix help?

[stefanor]

Yeah, combined with --reference-links that seems to do the right thing.

[theSage21]

@stefanor @Alir3z4 Consider closed?

[Alir3z4]

I'm going to close this then, thanks for your awesome collaboration on this ;)

[nguyenl95]

This issue still happens to me when the link contains special characters like "-".

Are there anyway to rebuild this package with BODY_WIDTH = 0 (config.py) ?

[Alir3z4]

@nguyenl95 have you consider --reference-links ?

[nguyenl95]

@Alir3z4 I intend to use html2text as lib instead of command-line.
Btw I just read your /tests and it is really useful.

I use this lib for my crawler (this case seems popular), and I think body_width=0 or protect_links=True and skip_internal_links=False should be default. Baseurl is really good one that need to be exposed for readers btw.

def html2md(raw):
  h = html2text.HTML2Text()
  h.body_width = 0
  h.baseurl = "https://example.org" # this is hidden
  return h.handle(raw)

[Alir3z4]

@nguyenl95 Thanks for mentioning.
I didn't noticed you were referring to use of of the lib itself and not he CLI.

I'd love to see a pull request for updating the documentation so other can see and use it.
You would be modifying:

• https://github.com/Alir3z4/html2text/blob/master/docs/how_it_works.md
• https://github.com/Alir3z4/html2text/blob/master/docs/usage.md

Let me know if I can help you with anything else.

[nguyenl95]

@Alir3z4 Actually there is one feature I think of.

It is the limit of output, my forum platform doesn't allow my crawler to post the content over 32000 characters.

[Alir3z4]

@nguyenl95 Great, feel free to make a feature request or even better a pull request, I would love to know more about it.