Giter Site home page Giter Site logo

Han Wang's Projects

-java-python-protobuf- icon -java-python-protobuf-

解决java和python互联时python接收java信息时,使用protobuf的半包、粘包问题。场景:java开启new ProtobufVarint32LengthFieldPrepender()

alchemy icon alchemy

给flink开发的web系统。支持页面上定义udf,进行sql和jar任务的提交;支持source、sink、job的管理;可以管理openshift上的flink集群

aswan icon aswan

陌陌风控系统静态规则引擎,零基础简易便捷的配置多种复杂规则,实时高效管控用户异常行为。

big-data icon big-data

金融风控系统(springboot+drools)、flink流计算、mongodb

brainsuck icon brainsuck

A simple optimizing Brainfuck compiler (used as the demo for my QCon Beijing 2015 talk)

c-ocr icon c-ocr

C-OCR是携程自研的OCR项目,主要包括身份证、护照、火车票、签证等旅游相关证件、材料的识别。 项目包含4个部分,拒识、检测、识别、后处理。

cninfodistributedspider icon cninfodistributedspider

针对巨潮资讯网上市公司公告的分布式爬虫,采用scrapy和kafka的分布式架构。可以爬取爬取指定上市公司列表、指定时间段内的所有公告并保存PDF。后续会加入搜索引擎功能

discovery icon discovery

🐳 Nepxion Discovery is an enhancement for Spring Cloud Discovery with gray release, router, weight, limitation, circuit breaker, degrade, isolation, monitor, tracing 灰度发布、路由、权重、限流、熔断、降级、隔离、监控、追踪

durineage icon durineage

解析SQL语句,分析血缘。不是table-table的关系,是column-column关系。

filesqlforspark icon filesqlforspark

FileSQLForSpark解决了Spark输入文件不够灵活的痛点,其可以让程序员使用一种类似SQL的语句让spark同时读取HDFS目录和本地目录上的不同数据源文件并合并成一个dataframe

flink-learning icon flink-learning

flink learning blog. http://www.54tianzhisheng.cn 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例,还有 Flink 落地应用的大型项目案例(PVUV、日志存储、百亿数据实时去重、监控告警)分享。欢迎大家支持我的专栏《大数据实时计算引擎 Flink 实战与性能优化》

flink-simpleapi icon flink-simpleapi

由于笔者觉得flink的一些api太难记了,就写了这个工具包,将一些常用函数放在一块方便调用。

flinkx icon flinkx

基于flink的分布式数据同步工具

forkreduce icon forkreduce

玩具项目ForkReduce是模仿MapReduce的shuffle过程用线程池和protobuf实现的单机多线程版本,可以自定义线程数量

hadooplink icon hadooplink

HadoopLink是基于Hadoop及BaseMR进一步封装而来的工作链框架。该框架省去了您生成Job,JobControl,ContrlledJob的繁杂重复代码。同时您可以非常便捷的通过注释设置MapReduce任务之间的依赖关系。HadoopLink支持多个任务链并行运行,不同任务链的可以进行定时执行设置。

hhconvertor icon hhconvertor

HHConvertor是在HadoopLink1.0.0基础上(后续升级到1.1.1)设计的具有一键互转Hive的ORC文件格式表格和HBase表格功能的通用jar包。 HHConvertor is a universal jar package for conversion between Hive ORC table and HBase table

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.