songtianyi/laosj

golang light-weight image crawler

laosj(老司机)

基于goquery的轻量级爬图工具。

展示

CLI

go install github.com/songtianyi/laosj/cmds/laosj

图片源

• aiss(已不可用)

  ./laosj help aiss
  ./laosj aiss 

• douban相册

  # help
  ./laosj help douban
  # 测试用
  ./laosj douban
  # 火力全开
  ./laosj --all --dir /your/local/disk/path douban --sp 1 --lp 254
  # 随意开火
  ./laosj --all --dir /your/local/disk/path douban --album_id 105181925 --sp 1 --lp 23

• 妹子图

  ./laosj help mzitu
  # 测试用
  ./laosj mzitu
  # 火力全开
  ./laosj --all --dir /your/local/disk/path mzitu --sg 15850 --eg 15900

• 妹子图自拍(待重构)

• javlibrary(待重构)

代码上手

下载

go get -u -v github.com/songtianyi/laosj

安装redis

略，使用redis作为下载队列需安装

golang.org/x依赖安装

mkdir $GOPATH/src/golang.org/x
cd $GOPATH/src/golang.org/x
git clone https://github.com/golang/net.git

编译并运行

cd cmds/laosj/ && go build .
./laosj douban --sp 1

laosj's Issues

x509: certificate signed by unknown authority

如题，下载https的图片的时候报这个错误

报错了

liuxu:~$ go install github.com/songtianyi/laosj/cmds/laosj
go: downloading gopkg.in/mattn/go-colorable.v0 v0.1.2
go: downloading gopkg.in/mattn/go-isatty.v0 v0.0.8
build github.com/songtianyi/laosj/cmds/laosj: cannot load gopkg.in/mattn/go-colorable.v0: cannot find module providing package gopkg.in/mattn/go-colorable.v0

meet "too many errors"