SigLens is an Open Source Observability solution that is 100x more efficient than Splunk, Elastic.
Our experience servicing 10,000+ engineers with Observability tools taught us a few things:
- Developers have to jump through different tools for logs, metrics, traces
- Splunk, DataDog, NewRelic are very expensive
- ElasticSearch takes too many machines, cluster maintainence is hard
- Grafana Loki has slow query performance
Armed with decades of experience in monitoring domain, we set out to build a observability DB from the ground up, uniquely suited for logs, metrics and traces with zero
external dependencies. A single binary
that you can run on your laptop and process 8 TB/day
on it.
Come say Hi to us on Slack ๐
git clone [email protected]:siglens/siglens
cd siglens
go run cmd/siglens/main.go --config server.yaml
TBD
- SigLens can be installed on Linux or macOS machine.
- On macOS, Docker Engine should be installed before you run the install script.
- Git clone the SigLens repository and cd into the siglens directory
[email protected]:siglens/siglens.git
cd siglens
- Run the install.sh script:
./install_with_docker.sh
The SigLens backend is deployed independently of the UI. To allow the UI to connect to the backend a docker network can be used.
wget https://sigscalr-configs.s3.amazonaws.com/1.1.31/server.yaml
docker pull siglens/siglens:0.1.0
mkdir data
docker run -it --mount type=bind,source="$(pwd)"/data,target=/siglens/data \
--mount type=bind,source="$(pwd)"/server.yaml,target=/siglens/server.yaml \
-p 8081:8081 -p 80:80 siglens/siglens:0.1.0
To be able to query data across restarts, set ssInstanceName
in server.yaml.
The target for the data directory mounting should be the same as the data directory (dataPath
configuration) in server.yaml
- Multiple Ingestion formats: Open Telemetry, Elastic, Splunk HEC, Loki
- Multiple Query Languages: Splunk SPL, SQL and Loki LogQL
- Simple architecture, easy to get started.
Check out this blog where SigLens is 8x
Faster than Elasticsearch
Check out this blog where SigLens is 4x-37x
Faster than ClickHouse
Check out this blog where SigLens ingested data at 1 PB/day rate for 24 hours on a mere 32 EC2 instances
compared to 3000 EC2 instances
required for Splunk, Elastic, Grafana Loki
Please read CONTRIBUTING.md to get started with making contributions to SigLens.
TBD