tilakpatidar Goto Github PK

500lines

500 Lines or Less

airflow-gpg-plugin

Airflow plugin with hooks and operators to work with GPG encryption and decryption.

ambari-hue-service

Ambari stack service for easily installing and managing Hue on HDP cluster

bot-marvin

Highly scalable crawler with best features.

cdh5

Docker image for Cloudera Hadoop components (CDH5)

cdh5_hive_postgres

Hadoop 2.6.0 | Hive 1.1.0 | Postgres 9.5 docker image

checklist

common-crawl

This is a python tool to crawl data from common crawl dumps.

compose

Define and run multi-container applications with Docker

coreutils

Cross-platform Rust rewrite of the GNU coreutils

dask-ingest

A basic JDBC to Parquet data pipeline using dask.

delta-merge

A pyspark tool to merge frequently ingested DELTA or FULL files into a SNAPSHOT.

exceptions_in_scala

Demo scripts for handling exceptions in Scala

exercism

Exercism exercises for Pathshala

fibber

Generate fake data from production databases and copy to other databases.

formcrawl

A java project for crawling deep web forms.

hackerrank

Contains all the hackkerank submissions

hadoop-base-project

Base mvn project to write any hadoop application

hindi-news-crawler

Fetches RSS feeds to collect news for search engines.

incubator-gobblin

Gobblin is a distributed big data integration framework (ingestion, replication, compliance, retention) for batch and streaming systems. Gobblin features integrations with Apache Hadoop, Apache Kafka, Salesforce, S3, MySQL, Google etc.

jenkins-poc

jepsen

A framework for distributed systems verification, with fault injection

kafka-connect-transform

This project contains kafka-connect related custom transformation.

keyextract

Python software in progress to extract key words from html pages.

liquibase-snowflake-poc

Run migrations against snowflake using liquibase

moby

Moby Project - a collaborative project for the container ecosystem to assemble container-based systems

parquet-mr

Mirror of Apache Parquet

postgres

Mirror of the official PostgreSQL GIT repository. Note that this is just a *mirror* - we don't work with pull requests on github. To contribute, please see http://wiki.postgresql.org/wiki/Submitting_a_Patch

puppet-manifest-example

pytest-snowflake_bdd

Setup test data and run tests on snowflake in BDD style!