check-sked/crypto_data_resources

Data resources for DeFi, Bitcoin, and centralized crypto entities.

crypto-data-resources

Table of Contents

• Description
• Data
• Installation
• Usage
• Have-Questions-or-Want-to-Conntect?

---

Description

The crypto-data-resources repository is a data resource for crypto analysts and those curious in understanding crypto on a more granular level. It offers easily manipulatable resources for observing and visualizing the most important facets of the blockchain world and the pieces of infrastructure that comprise it.

The repository covers data on:

1. Stablecoins
2. Ethereum Layer2
3. DeFi (including TVL of dapps and chains, liquidity pools and yields, lending and borrowing, application and protocol level fees and revenues, and more)
4. Asset level trading volumes, prices and market caps
5. The Bitcoin network (including hash, on-chain transfer volume, and more)
6. The visualization and animation of the data above

Among a wide variety of other topics.

---

Data

The data is sourced from the most notable data platforms, DeFi protocols, and exchanges.

---

Installation

Instructions for installation project and setting up the development environment:

Take the following steps to get your environment up and running:

Mac Users

1. Install Homebrew: $ /bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install.sh)"
2. Install Python: $ brew install python
3. Confirm that Python was installed and check your version: python --version

Linux Users

If you are using Ubuntu 16.10 or newer, open your command line prompt and run the following:

1. $ sudo apt-get update
2. $ sudo apt-get install python3.6

If you are using another version of Ubuntu, open your command line prompt and run the following:

1. $ sudo apt-get install software-properties-common
2. $ sudo add-apt-repository ppa:deadsnakes/ppa
3. $ sudo apt-get update
4. $ sudo apt-get install python3.8

If you are using another Linux distrubution, you likely already have Python pre-installed. If not, use your distribution’s package manager. For example on Fedora, you would use dnf in the command line:

1. $ sudo dnf install python3

Windows Users

Windows users can refer to this link for instructions on installing Python.

Libraries

Each script requires its own set of libraries that must be installed to successfully retreive the data. The most consistently used ones include:

• requests
• datetime
• csv
• json
• pandas

To install the libraries above, or any of the required ones, run pip install [LIBRARY NAME] in your environment once it is up and running. If you are using Python3, run pip3 install [LIBRARY NAME]

---

Usage

How to use the resources:

Consult the READMEs for each individual resource to use any of the scripts contained in this repository. Once you have the script ready to go, simply run it to produce Excel or CSV files with the desired data.

Linked in each README is the documentation for corresponding the API. Refer to these links to use the scripts for your tailored needs.

---

Questions?

Got questions or want to connect? Reach me through the following channels:

GitHub: @check-sked

Twitter: @Check-Sked

Newsletter and Other Content: Medium

crypto_data_resources's Issues

CoinMarketCap README

Add a README to the CMC folder. Once added, make it descriptive, use images, and walk users through an example with pictures.

DeFi Llama fees_and_revenue folder README

Populate the DeFi Llama fees_and_revenue folder README. Make it descriptive, use images, and walk users through an example with pictures.

Improve naming for CSV and Excel files

Give them names relevant to inputs where applicable.

DeFi Llama stablecoin_data folder README

Populate the DeFi Llama stablecoin_data folder README. Make it descriptive, use images, and walk users through an example with pictures.

DeFi Llama fees_by_protocol.py

Write script using DeFi Llama API to get fees by protocol. File is already created in the fees_and_revenue folder.

Add Bitstamp Volume

Write a script that gets the volume of any pair on Bitstamp. Make it produce a csv or Excel sheet.

CoinGecko README

Improve the CoinGecko README. Make it descriptive, use images, and walk users through an example with pictures. Note the auto granularity based on price range. Note the use of the glossary for asset ID input.

Data granularity is automatic (cannot be adjusted)
1 day from current time = 5 minute interval data
1 - 90 days from current time = hourly data
above 90 days from current time = daily data (00:00 UTC)

Rename the respository

The repository needs a new name that is more closely related to what it is and what it enables. Consider something along the lines of "crypto_data_resources."

DeFi Llama folder README

Improve the DeFi Llama folder README. Make it descriptive and use images.

DeFi Llama yields_data folder README

Populate the DeFi Llama yields_data folder README. Make it descriptive, use images, and walk users through an example with pictures.

DeFi Llama revenue_by_protocol.py

Write script using DeFi Llama API to get revenue by protocol. File is already created in the fees_and_revenue folder.

Blockchain.com README

Improve the blockchain.com README. Make it descriptive, use images, and walk users through an example with pictures.

README for repository

Update the README for the repository landing section. Make it detailed and explain the purpose of the repo. Include images and links to take users to specific areas.

Derivatives data script

Write a script getting derivatives data. CoinGecko appears to have an endpoint for it (https://www.coingecko.com/en/api/documentation), start here and work out.

DeFi Llama tvl_data README

Populate the DeFi Llama tvl_data folder README. Make it descriptive, use images, and walk users through an example with pictures.

DeFi Llama opportunties_search folder README

Populate the DeFi Llama opportunities_search folder README. Make it descriptive, use images, and walk users through an example with pictures. Add list of categories, and note that because of the APIs the results are limited.

READMEs

Write documentation for every folder. Make it as detailed as possible, use pictures and clear step by step guids for everything.

Repo README

Improve repo readme

Add error handling to all scripts

Add error handling where applicable. Be specific with errors.

Finished:

• Blockchain.com
• CoinGecko