yyt1002/einet

Uncertainty and causal emergence in complex networks

Effective information and causal emergence in python

Python code for calculating effective information in networks. This can then be used to search for macroscale representations of a network such that the coarse grained representation has more effective information than the microscale, a phenomenon known as causal emergence. This code accompanies the recent paper:

The emergence of informative higher scales in complex networks
Brennan Klein and Erik Hoel, 2020. Complexity.
doi:10.1155/2020/8932526

---

Fig. 1: Effective information vs network size.

Fig. 2: Causal emergence vs preferential attachment.

---

Tutorial Notebooks (works in progress...)

1. Chapter 01 - Network Effective Information
2. Chapter 02 - Network Size and Effective Information
3. Chapter 03 - Determinism and Degeneracy
4. Chapter 04 - Effective Information in Real Networks
5. Chapter 05 - Causal Emergence in Preferential Attachment and SBMs
6. Chapter 06 - Causal Emergence and the Emergence of Scale
7. Chapter 07 - Estimating Causal Emergence in Real Networks
8. Chapter 08 - Miscellaneous
9. Chapter 09 - Spectral Causal Emergence

Installation and Usage

In order to use this code, first clone/download the repository. Below is a simple example usage. Please feel free to reach out if you find any bugs, have any questions, or if for some reason the code does not run.

>>> from ei_net import *
>>> import networkx as nx
>>> G = nx.karate_club_graph()
>>> print("effective_information(G) =", effective_information(G))

EI(G) = 2.3500950888734686

The tutorial notebooks are designed to walk through some of the main results from the paper above, in addition to several in-depth analyses that were not included in the original paper.

Requirements

This code is written in Python 3.x and uses the following packages:

• NetworkX
• Scipy
• Numpy
• And for replicating figures, you will need:
  • matplotlib
  • Pandas

The colormaps in the paper are from https://matplotlib.org/cmocean/ and the named colors are from https://medialab.github.io/iwanthue/.

Citation

If you use these methods and this code in your own research, please cite our paper:

Klein, B. & Hoel, E. (2020). The emergence of informative higher scales in complex networks. Complexity, no. 8932526. doi:10.1155/2020/8932526.

Bibtex:

@article{Klein2020causalemergence,
    title = {{The emergence of informative higher scales in complex networks}},
    author = {Klein, Brennan and Hoel, Erik},
    journal = {Complexity},
    year = {2020},
    pages = {1--12},
    volume = {2020},
    arxivId = {1907.03902v2},
    doi = {10.1155/2020/8932526}
}

See also:

• Hoel, E. (2017). When the map is better than the territory. Entropy. 19(5), 188; doi: 10.3390/e19050188.
  • recent work making explicit connections between causal emergence and the channel capacity of a model.
• Hoel, E., Albantakis, L., & Tononi, G. (2013). Quantifying causal emergence shows that macro can beat micro. Proceedings of the National Academy of Sciences. 110 (49) 19790-19795. doi: 10.1073/pnas.1314922110.
  • the first work to quantify causal emergence, showing how and why certain coarse-grained models can have more effective information.