howardwong-db / gangliaexport Goto Github PK
View Code? Open in Web Editor NEWGangliaExport is a lightweight package provides an alternative way to monitor Databricks cluster utilization using Ganglia Web Service on the driver node of each cluster. The Ganglia metrics can be exported to any Spark datasource format which can be used to analyze cluster usages to avoid costly idle computing.
Home Page: https://github.com/howardwong-db/GangliaExport