dorina-sada Goto Github PK

airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

auto-data-tokenize

Identify and tokenize sensitive data automatically using Cloud DLP and Dataflow

beam

Apache Beam is a unified programming model for Batch and Streaming

big-data-rosetta-code

Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code

bigdataios

Comparing Bigdata IOs

case-app

Type-level & seamless command-line argument parsing for Scala

cloud-code-samples

Code templates to make working with Kubernetes feel like editing and debugging local code.

cloud-flower

Batch ETL using Cloud Environment which is GCP by utilizing Cloud Composer + Google Cloud Storage + Dataflow + Cloud Build

composer_gcf

Calling Cloud Composer > GCF > Composer securely

data-engineering-on-gcp-cheatsheet

data-science-on-gcp

Source code accompanying book: Data Science on the Google Cloud Platform, Valliappa Lakshmanan, O'Reilly 2017

dataflowexamples

Dataflow Examples Repo

df-ml-anomaly-detection

Streaming Anomaly Detection Solution by using Pub/Sub, Dataflow, BQML & Cloud DLP

dlp-cloud-functions-tutorials

dlp-dataflow-deidentification

Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP

dlp-rdb-bq-import

Relational Database Import to Big Query with Dataflow and DLP API

featran

A Scala feature transformation library for data science and machine learning

gcp-snippets

Collection of Google Cloud Platform scripts

gcs-to-bigquery

WIP: Moving data from GCS to BigQuery.

googlecloudarchitectprofessional

Resources to prepare for Google Certified Cloud Architect Professional Exam - 2017

googledataengineer

java-bigquerystorage

python-bigquery

python-docs-samples

Code samples used on cloud.google.com

s8s-spark-ce-workshop

scala

Scala 2 compiler and standard library. For bugs, see scala/bug

scala-seed

scala template project

scio

A Scala API for Apache Beam and Google Cloud Dataflow.

scio-contextual

Collection of additional string interpolators to use in your scio pipeline

scio-dataflow-flex-template-example

Example of how to run Scio job with Dataflow Flex Template