stupeter/sougou_dict_spider

搜狗词库爬虫，全类目下载，自动分类，scel转txt

sougou_dict_spider's Issues

Large files are getting stuck in commit history

It seems that there are huge amounts of Sougou's corpora that had been committed by accident (potentially relics from the time that this script was being debugged). And got "removed" in the later commit by simply another git push.

However, this is never a true remove as git stores relative changes rather than a faithful snapshot of source-tree. Resulting an oversized repository (I got around 250MB of data downloaded when cloning this repository)

Some solutions that have come across my mind, just for reference:

1. Cherry-pick your commit into an orphaned branch, and purge the old branch entirely.
2. Just duplicate your source-tree into an orphaned branch
3. Doing an interactive rebase and amending the commit where large files getting committed into by rm it from git cache. (refer to: https://stackoverflow.com/a/2158271)

我想只下载一类词库

然后我改了Categories = ['医学医药']，他还是在下载城市词库。

默认是F盘，怎么更改下载路径？

太棒了，这不是一个issue

非常强大！ 再配合上一个shell scripts， 一个for循环就能把所有的合成一个词库了
马上动起来哈

太棒了，我一下午折腾的很爽