shikigit Goto Github PK

anti-anti-spider

越来越多的网站具有反爬虫特性，有的用图片隐藏关键数据，有的使用反人类的验证码，建立反反爬虫的代码仓库，通过与不同特性的网站做斗争（无恶意）提高技术。（欢迎提交难以采集的网站）

applied-deep-learning-resources

A collection of research articles, blog posts, slides and code snippets about deep learning in applied settings.

awesome-web-scraping

List of libraries, tools and APIs for web scraping and data processing.

brisque

c++ demo for Blind/Referenceless Image Spatial Quality Evaluator

browsh

A fully-modern text-based browser, rendering to TTY and browsers

captcha

Breaking captchas using torch

captcha-breaking

DataCastle验证码识别大赛

captcha-decoder

ch2r_ood_understanding

chinese_conversation_sentiment

A Chinese sentiment dataset may be useful for sentiment analysis.

chinesewordsegmentation

Chinese word segmentation algorithm without corpus（无需语料库的中文分词）

cola

A high-level distributed crawling framework.

config

crawler

淘宝爬虫原型，基于gevent

crawlers

darts-java

Java porting of Darts (Double ARray Trie System)

deepqa

My tensorflow implementation of "A neural conversational model", a Deep learning based chatbot

dhtcrawler

dl

Http Downloader for golang

docker_library

ebloom

A NIF wrapper around a basic bloom filter.

etc

常用配置和工具

etcd

Distributed reliable key-value store for the most critical data of a distributed system

gbdt

A simple GBDT in Python

genshin-impact-helper

Automatically get Genshin Impact daily check-in rewards from HoYoLAB Community by GitHub Actions. 米游社原神自动每日签到+微博活动提醒+微博超话签到+礼包领取推送

gnosis-contracts

Collection of smart contracts for the Gnosis prediction market platform.

gnosisdb

Gnosis Core Database Layer

gosimhash

中文文档simhash值计算

grampusspider

A web-spider that can run JS based V8 and get AJAX contents, command line mode

headlessbrowsers

A list of (almost) all headless web browsers in existence