bjdas Goto Github PK

amazon-redshift-utils

The Amazon Redshift Column Encoding Utility will apply optimal Column Encoding to existing Tables on an Amazon Redshift Database cluster

autoscaling

These are codes to build a system that is capable of handling the large volume of data generated by the Load Generator. Also, the instance tagging for all those steps above is done in my code, and not manually through the AWS web console. Besides, I created a security group with all ports opened with code for my load generator and all my data centers.

awesome-bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

awesome-docker

:whale: A curated list of Docker resources and projects

awesome-scala

A community driven list of useful Scala libraries, frameworks and software.

aws-tasks

ant tasks for amazon web services

awscala

Using AWS SDK on the Scala REPL

blog-spark-streaming-log-aggregation

Example of use of Spark Streaming with Kafka

data-algorithms-book

MapReduce and Spark Source Code and Scripts for Data Algorithms Book

drone

Drone is a Continuous Delivery platform built on Docker, written in Go

extendedset

Bitmap compression using the CONCISE algorithm

fpinscala

Code, exercises, answers, and hints to go along with the book "Functional Programming in Scala"

franz

Better Api for using SQS with Scala

hadoop-docker

Hadoop docker image

jmx_exporter

A process for exposing JMX Beans via HTTP for Prometheus consumption

kafkaoffsetmonitor

A little app to monitor the progress of kafka consumers and their lag wrt the queue.

links

Just a bunch of useful links

marathon

Deploy and manage containers (including Docker) on top of Apache Mesos at scale.

marathon-client

Java API client for Mesosphere's Marathon.

mycroft

parquet-flinktacular

How to use Parquet in Flink

pivot

An interactive data exploration UI for Druid

s3-spray

Support for calling the S3 Rest API via spray-client

scala-twitter-api

spark

Lightning-fast cluster computing in Java, Scala and Python.

spark-csv

CSV data source for Spark SQL and DataFrames

spark-jobserver

REST job server for Apache Spark

spark-redshift

Spark and Redshift integration

sparkinternals

Notes talking about the design and implementation of Apache Spark

sparklearning

Learning to write Spark examples