gautamdhameja/medium-2-md

A CLI tool that converts exported Medium posts (html) to Jekyll/Hugo compatible markdown with front matter.

medium-2-md's Issues

Image Captions

Exported Medium files have Image captions under a figcaption tag.

<figcaption class="imageCaption">Some Caption Goes Here </figcaption>

At present, the conversion renders this caption as part of the all the other text present in the post. I'm aware of the markdown limitation for ![](http://image.url). But it would be nice to have ![Some Caption Goes Here](http://image.url)

Saving Images from medium posts

Would it be possible to save images from medium posts to an images folder while executing medium2md

Error converting file

Error converting file: 2016-06-03_Payette-Brewing--Idaho-Will-Be-Known-for-More-Than-Potatoes-9ac8792a37f5.html. Skipping.
internal/streams/legacy.js:59
      throw er; // Unhandled stream error in pipe.
      ^

Error: socket hang up
    at createHangUpError (_http_client.js:329:15)
    at TLSSocket.socketOnEnd (_http_client.js:421:23)
    at emitNone (events.js:110:20)
    at TLSSocket.emit (events.js:207:7)
    at endReadableNT (_stream_readable.js:1057:12)
    at _combinedTickCallback (internal/process/next_tick.js:138:11)
    at process._tickCallback (internal/process/next_tick.js:180:9)

---

P.S. Thanks for making such a great tool!

Trying to get in touch regarding a security issue

Hey there!

I'd like to report a security issue but cannot find contact instructions on your repository.

If not a hassle, might you kindly add a SECURITY.md file with an email, or another contact method? GitHub recommends this best practice to ensure security issues are responsibly disclosed, and it would serve as a simple instruction for security researchers in the future.

Thank you for your consideration, and I look forward to hearing from you!

(cc @huntr-helper)

Medium now has rate-limiting on image downloads

Currently, the script has no delay on image downloads. The first few article's images will fetch correctly, after which Medium rate limits and the next couple will fail.

Proposed solution is an extra argument timeout which delays every image fetch by a specified number of milliseconds. A default timeout of something like 100 milliseconds should fix the problem.

(I'd be happy to make this change as an open source contribution)

Parameter order on macOS

Hello, Thanks for your work on this cli tool!

It seems that adding the flags after the directory(like in the examples) does not work on macOS.
medium-2-md covertLocal ./medium-export/posts -dfi does not work for me
while
medium-2-md convertLocal -dfi ./medium-export/posts does

Tested on MacOS Catalina v10.15.2

Add support for "page bundles"?

Hi,

I am interested in using this to export my medium blog to a hugo blog.
I really want to use the page bundle system in the hugo system. Could it be possible to add some support so that the exported md/images go into seperate folders?

Error converting file when using --images parameter (for stories under publications)

Hi, first of all, thanks for this cool tool 👍

When I try to convert with the command:

medium-2-md convertLocal posts/ -i this story: Lucky 7 new tools and plugins for Android developers & designers

I got only

Error converting file: 2018-09-25_Lucky-7-new-tools-and-plugins-for-Android-developers---designers-1545e5c59f27.html. Skipping.

What is interesting, my story 50 Android Studio Tips, Tricks & Resources you should be familiar with, as an Android Developer is successfully converted with all images and gifs.

Completed: 2016-11-07_50-Android-Studio-Tips--Tricks---Resources-you-should-be-familiar-with--as-an-Android-Developer-af86e7cf56d2.md

The only difference I noticed is that tips and tricks are not under any publication, however other stories are.

Please let me know where could be a problem.

Cheers 🍻

Option to embed images with base64

It would be nice if there would be an option to embed images with base64.

Error on converting

Hi am getting an error. Any idea? I tried with single quotes around the directory (and with \\ instead of \) and same error. My files are in the posts folder. The arrows are pointing at the async command - there should be a comma after that... I would assume but maybe the error not did put one there?

C:\Users\danzen>medium-2-md convertLocal E:\Downloads\medium-export\posts -dfi
C:\Users\danzen\AppData\Roaming\npm\node_modules\medium-2-md\lib\workflow.js:26
            fs.readdirSync(inputPath).forEach(async file => {
                                              ^^^^^
SyntaxError: missing ) after argument list
    at createScript (vm.js:56:10)
    at Object.runInThisContext (vm.js:97:10)
    at Module._compile (module.js:542:28)
    at Object.Module._extensions..js (module.js:579:10)
    at Module.load (module.js:487:32)
    at tryModuleLoad (module.js:446:12)
    at Function.Module._load (module.js:438:3)
    at Module.require (module.js:497:17)
    at require (internal/module.js:20:19)
    at Object.<anonymous> (C:\Users\danzen\AppData\Roaming\npm\node_modules\medium-2-md\index.js:5:18)

Get parameters are breaking file name generation

I just copied an URL from medium that contains a (weird) GET parameter:

https://medium.com/@benlaurie_18378/how-to-ruin-a-perfectly-good-container-d33250fca595?source=---------2------------------

When trying to archive it:

$ medium-2-md convertUrl 'https://medium.com/@benlaurie_18378/how-to-ruin-a-perfectly-good-container-d33250fca595?source=---------2------------------' -o .

The file will be called .md (and therefore hidden on *NIX systems).

PS: Maybe it could be fixed together with #4

all images are 13kb and not valid

Using docker to run...

docker run --rm -it -v $PWD:/src node:latest /bin/bash -c 'npm install -g mediumexporter && npm i -g medium-2-md && mkdir /src/medium/output && medium-2-md convertLocal /src/medium/posts --path /src/medium/output -dfi'

output looks good:

drew@drews-MBP drewkhoury-website % docker run --rm -it -v $PWD:/src node:latest /bin/bash -c 'npm install -g mediumexporter && npm i -g medium-2-md && mkdir /src/medium/output && medium-2-md convertLocal /src/medium/posts --path /src/medium/output -dfi'
npm WARN deprecated [email protected]: Please upgrade  to version 7 or higher.  Older versions may use Math.random() in certain circumstances, which is known to be problematic.  See https://v8.dev/blog/math-random for details.
npm WARN deprecated [email protected]: this library is no longer supported
npm WARN deprecated [email protected]: request has been deprecated, see https://github.com/request/request/issues/3142

added 50 packages, and audited 51 packages in 2s

2 packages are looking for funding
  run `npm fund` for details

4 moderate severity vulnerabilities

To address all issues, run:
  npm audit fix

Run `npm audit` for details.
npm notice
npm notice New patch version of npm available! 8.1.2 -> 8.1.4
npm notice Changelog: https://github.com/npm/cli/releases/tag/v8.1.4
npm notice Run npm install -g [email protected] to update!
npm notice

added 27 packages, and audited 28 packages in 2s

11 packages are looking for funding
  run `npm fund` for details

found 0 vulnerabilities
Completed: 2019-11-09_Something-6b1e95c9f09.md
Completed: 2020-01-05_Teaching-DevOps-in-one-afternoon-e85f02ef036b.md
Completed: 2021-08-27_AWS-2021-Highlights-b16b6c59b4fe.md
...
Output path: /src/medium/output
...
Completed: 2019-11-23_One-DevOps-Please---Part-2-57aff9ad8595.md
Completed: draft_What-is-Good-Software-Delivery--48929b586c4d.md

the md files look great, but the images seem broken.

Script ignores github gist code snippets

Excellent code! Congrats! Only what I noticed that it ignores github gists. It would be wonderful if you would add it. Thanks!

Incorporating Medium tags into Frontmatter

It would be wonderful if the tags that are present in a medium post could be incorporated in the front matter.

including speaking url in file name

It would be nice if filenames would be converted into the 'speaking' urls instead article identifier.

So, for example if I want to archive an article with

$ medium-2-md convertUrl https://medium.com/@watzon/doing-crystal-2-501daaf8390d -o . -fi

it is resulting in 501daaf8390d.md. By looking at it's filename I'm not able to understand anymore what the article was about.

Maybe something like watzon_-_doing-crystal-2-501daaf8390d.md would be more speaking and recognizable?

What do you think @gautamdhameja?

Convert from url is not working anymore.

It seems the HTML/CSS class and attributes names have been changed in Medium posts and the reader is not able to extract the article content from the html body.