xinychen/awesome-latex-drawing

Drawing Bayesian networks, graphical models, tensors, technical frameworks, and illustrations in LaTeX.

Awesome LaTeX drawing

Made by Xinyu Chen • 🌐 https://xinychen.github.io

awesome-latex-drawing is a collection of 20+ academic drawing examples for using LaTeX, including Bayesian networks, function plotting, graphical models, tensor structure, and technical frameworks. [Blog post on Medium]

Description

LaTeX is a high-quality typesetting system, and it is available as a free software. In recent years, it is very popular for creating and drawing academic graphics via LaTeX. This is because that LaTeX is able to draw many complicated graphics containing special symbols and math equations. It is really good for using LaTeX to draw certain graphics in your research.This project introduces some graphics that created by using LaTeX. It would be easy to follow the examples with a popular online LaTeX system - Overleaf. If you are interested, welcome to use Overleaf and reproduce our examples. The Overleaf is available at overleaf.com, please feel free to try it.

Contents

Table of Examples

• Bayesian networks
  • Bayesian network of Bayesian CP factorization (BCPF)
  • Bayesian network of Bayesian Gaussian CP (BGCP) factorization
  • Bayesian network of Bayesian augmented tensor factorization (BATF)
  • Bayesian network of Bayesian temporal matrix factorization (BTMF)
  
  
• Graphical models
  • Partially observed time series matrix and tensor
  • Matrix and tensor time series prediction in the presence of missing values
  • Undirected and circulant graphs on the relational data samples with certain degrees
  • Laplacian convolutional time series modeling
  
  
• pgfplots function plotting
  • PDF and CDF functions of Erlang distribution
  • PDF of normal distribution with different means and variances
  • (Joint) PDF functions of Lognormal distributions
  • Iterative process of conjugate gradient for solving a system of linear equations
  • Random and non-random missing patterns
  • Sine and Cosine functions
  • Mechanism of time series forecasting
  
  
• tikz for matrix structure
  • Graphical illustration of the multivariate time series forecasting problem
  • Graphical illustration of the temporal matrix factorization
  • Graphical illustration of the rolling time series forecasting with temporal matrix factorization
  
  
• tikz-3dplot for tensor structure
  • Graphical illustration for the (origin, destination, time slot) tensor
  • Graphical illustration of the classical CP tensor factorization on a third-order tensor
  • Graphical illustration of augmented tensor factorization (AuTF) model
  • Graphical illustration of tensor completion task and its framework
  • Graphical illustration of low-rank autoregressive tensor completion model
  • Graphical illustration of singular value thresholding process of the tensor data with unitary transform
  • Graphical illustration of low-rank tensor completion model
  • Graphical illustration of low-rank tensor regression model

Usage

Open overleaf.com in your Chrome.

It is not necessary to open each file in this repository because you can just follow this readme document.

Gallery

Looking for some good LaTeX drawing examples? Here are 30+ graphics for showing how to draw in LaTaX.

Bayesian Networks

LaTeX provides some powerful domain-specific packages and tools like tikz to enable flexible graphical models. Bayesian networks represent a family of graphical models consisting of variables (usually denoted by nodes) and dependency relationships (usually denoted by arrows). Fortunately, tikz has a specific library for drawing Bayesian networks and directed factor graphs.

Another toolbox in Python: https://docs.daft-pgm.org/en/latest/

Bayesian Tensor Factorization

[Example 1]

This example is from the following paper:

• Qibin Zhao, Liqing Zhang, Andrzej Cichocki (2015). Bayesian CP factorization of incomplete tensors with automatic rank determination. IEEE Transactions on Pattern Analysis and Machine Intelligence, 37(9): 1751-1763.

which shows the Bayesian network of Bayesian CP factorization (BCPF) model. To draw this Bayesian network example, there are some preliminaries to follow:

• preamble codes:
  1. define the documentclass as standalone, e.g., \documentclass[border = 0.1cm]{standalone} with 0.1cm border,
  2. use the package tikz, i.e., \usepackage{tikz}, and use tikz library like \usetikzlibrary{bayesnet} which is an important tool for drawing Bayesian networks and directed factor graphs,
  3. set the tikz style by using the \tikzstyle{} command,
  4. use math equation environments including \usepackage{amsfonts, amsmath, amssymb}.
• body codes:
  1. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  2. use \node to define nodes and text boxes in the Bayesian network,
  3. use \path to define arrows in the Bayesian network,
  4. use \plate to define plates in the Bayesian network.

Please click on the image and check out the source code.

• Open BGCP.tex in your overleaf project, then you will see the following pictures about BGCP (Bayesian Gaussian CP decomposition) model as a Bayesian network and a directed factor graph:

[Example 2]

This example is from the following paper:

Xinyu Chen, Zhaocheng He, Lijun Sun (2019). A Bayesian tensor decomposition approach for spatiotemporal traffic data imputation. Transportation Research Part C: Emerging Technologies, 98: 73-84.

which shows the Bayesian network of Bayesian Gaussian CP factorization (BGCP) model. To draw this Bayesian network example, there are some preliminaries to follow:

• preamble codes:
  1. define the documentclass as standalone, e.g., \documentclass[border = 0.1cm]{standalone} with 0.1cm border,
  2. use the package tikz, i.e., \usepackage{tikz}, and use tikz library like \usetikzlibrary{bayesnet} which is an important tool for drawing Bayesian networks and directed factor graph,
  3. set the tikz style by using the \tikzstyle{} command,
  4. use math equation environments including \usepackage{amsmath, amsfonts, amssymb}.
• body codes:
  1. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  2. use \node to define nodes and text boxes in the Bayesian network,
  3. use \path to define arrows in the Bayesian network,
  4. use \plate to define plates in the Bayesian network.

Please click on the image and check out the source code. If you are interested in the original Bayesian network of BGCP in the paper, please check out BGCP.tex.

[Example 3]

This example is from the following paper:

Xinyu Chen, Zhaocheng He, Yixian Chen, Yuhuan Lu, Jiawei Wang (2019). Missing traffic data imputation and pattern discovery with a Bayesian augmented tensor factorization model. Transportation Research Part C: Emerging Technologies, 104: 66-77.

which shows the Bayesian network of Bayesian augmented tensor factorization (BATF) model. To draw this Bayesian network example, there are some preliminaries to follow:

• preamble codes:
  1. define the documentclass as standalone, e.g., \documentclass[border = 0.1cm]{standalone} with 0.1cm border,
  2. use the package tikz, i.e., \usepackage{tikz}, and use tikz library like \usetikzlibrary{bayesnet} which is an important tool for drawing Bayesian networks and directed factor graph,
  3. set the tikz style by using the \tikzstyle{} command,
  4. use math equation environments including \usepackage{amsmath, amsfonts, amssymb}.
• body codes:
  1. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  2. use \node to define nodes and text boxes in the Bayesian network,
  3. use \path to define arrows in the Bayesian network,
  4. use \plate to define plates in the Bayesian network.

Please click on the image and check out the source code.

[Example 4]

This example is from the following paper:

Xinyu Chen, Lijun Sun (2021). Bayesian temporal factorization for multidimensional time series prediction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44 (9): 4659-4673.

which shows the Bayesian network of Bayesian temporal matrix factorization (BTMF) model. To draw this Bayesian network example, there are some preliminaries to follow:

• preamble codes:
  1. define the documentclass as standalone, e.g., \documentclass[border = 0.1cm]{standalone} with 0.1cm border,
  2. use the package tikz, i.e., \usepackage{tikz}, and use tikz library like \usetikzlibrary{bayesnet} which is an important tool for drawing Bayesian networks and directed factor graph,
  3. set the tikz style by using the \tikzstyle{} command,
  4. use math equation environments including \usepackage{amsmath, amsfonts, amssymb}.
• body codes:
  1. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  2. use \node to define nodes and text boxes in the Bayesian network,
  3. use \path to define arrows in the Bayesian network,
  4. use \plate to define plates in the Bayesian network.

Please click on the image and check out the source code. Instead of multivariate vector autoregressive process on temporal factors, we can also use univariate autoregressive process to rebuild BTMF. The Beyasian network is available at btmf_net.png, you can also check out the source code btmf_net.tex.

Graphical Models

[Example 5]

These two examples show the partially observed time series matrix and tensor, respectively. To draw both two examples, we can follow these steps:

• preamble codes:

  1. define the documentclass as standalone,
  2. use the package tikz.

• body codes:

  1. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  2. use \node to define nodes and text boxes in the graphical model,
  3. use \path to define arrows in the graphical model.

[Example 6]

These two examples show the time series prediction in the presence of missing values. To draw both two examples, we can follow these steps:

• preamble codes:

  1. define the documentclass as standalone,
  2. use the package tikz.

• body codes:

  1. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  2. use \node to define nodes and text boxes in the graphical model,
  3. use \path to define arrows in the graphical model.

[Example 7]

These two examples show the undirected and circulant graphs on the relational data samples with certain degrees. To draw both two examples, we can follow these steps:

• preamble codes:

  1. define the documentclass as standalone,
  2. use the package tikz.

• body codes:

  1. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  2. use \node to define nodes,
  3. use \path to define arrows.

[Example 8]

This example is from the following paper:

Xinyu Chen, Zhanhong Cheng, Nicolas Saunier, Lijun Sun (2022). Laplacian convolutional representation for traffic time series imputation. arXiv preprint arXiv: 2212.01529.

which gives a graphical illustration of the Laplacian convolutional model for time series imputation. To draw the example, we can follow these steps:

• preamble codes:
  1. define the documentclass as standalone,
  2. use the package tikz.
• body codes:
  1. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  2. use \begin{axis} \end{axis} and \addplot to draw coordinates,
  3. use \node and \path to draw nodes and arrows.

pgfplots Function Plotting

[Example 9]

These two examples show the probability density function (PDF) and cumulative density function (CDF) of Erlang distribution, respectively. To draw the example, there are few steps to follow:

• preamble codes:
  1. define the documentclass as standalone,
  2. use the package pgfplots,
  3. set font style and adjust \pgfplotsset{} as you prefer.
• body codes:
  1. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  2. use \begin{axis} \end{axis} to draw the function,
  3. use \addplot to define the function for drawing.

[Example 10]

This example shows the PDF of normal distribution with different means and variances. To draw this example, there are few step to follow:

• preamble codes:
  1. define the documentclass as standalone,
  2. use the package pgfplots,
  3. set font style and adjust \pgfplotsset{} as you prefer.
• body codes:
  1. use \pgfmathdeclarefunction to define the PDF function of normal (Gaussian) distribution,
  2. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  3. use \begin{axis} \end{axis} to draw the function,
  4. use \addplot to define the function for drawing.
• More posts:
  1. Plotting Normal distribution in pgfplots
  2. number format in pgfplots axis
  3. Remove the scientific notation which is unreasonable

[Example 11]

These two examples show the PDF and joint PDF of Lognormal distributions, respectively. There are some recommended material to follow the examples:

• More posts:
  1. Draw a bivariate normal distribution in TikZ
  2. How can two bivariate normal distributions be plotted in one plot?
  3. Plotting a Bivariate Normal Distribution in Tikz
  4. Split curve with addplot3

[Example 12]

These two examples show the iterative process of conjugate gradient for solving a system of linear equations.

[Example 13]

These two examples show the random and non-random missing patterns. To draw both two examples, we can follow these steps:

• preamble codes:
  1. define the documentclass as standalone,
  2. use both tikz and pgfplots packages,
  3. use \begin{filecontents} \end{filecontents} to contain the data.
• body codes:
  1. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  2. use \begin{axis} \end{axis} to draw the function,
  3. use \addplot to draw the data.

[Example 14]

This example shows four sequences consisting of Sine and Cosine functions. When regarding these sequences as time series, then we can see two kinds of temporal dynamics, that is, one is from Sine function, while another is from Cosine function. To draw this example, we can follow these steps:

• preamble codes:
  1. define the documentclass as standalone,
  2. use the package pgfplots,
  3. set font style and adjust \pgfplotsset{} as you prefer.
• body codes:
  1. use \pgfmathdeclarefunction to define the PDF function of normal (Gaussian) distribution,
  2. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  3. use \begin{axis} \end{axis} to draw the function,
  4. use \addplot to define the function for drawing.

[Example 15]

This example illustrates the mechanism of time series forecasting on streaming data in our tracebase project. To draw this example, we can follow these steps:

• preamble codes:
  1. define the documentclass as standalone,
  2. use both tikz and pgfplots packages,
  3. set font style and adjust \pgfplotsset{} as you prefer.
• body codes:
  1. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  2. use \begin{axis} \end{axis} to define the graphic,
  3. use addplot to define the marks at some coordinates and specify the color of these marks.

tikz for Matrix Structure

[Example 16]

This example gives a graphical illustration of the multivariate time series forecasting problem with missing values. To draw this example, we can follow these steps:

• preamble codes:
  1. define the documentclass as standalone,
  2. use the package tikz.
• body codes:
  1. set \Depth, \Width, and \Height parameters by using \newcommand,
  2. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  3. use \draw, \filldraw, and \node commands to define rectangles and nodes.

[Example 17]

This example gives a graphical illustration of the temporal matrix factorization. To draw this example, we can follow these steps:

• preamble codes:
  1. define the documentclass as standalone,
  2. use the package tikz.
• body codes:
  1. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  2. use \draw and \filldraw to set nodes and rectangles.

[Example 18]

This example gives a graphical illustration of the rolling time series forecasting with temporal matrix factorization. To draw this example, we can follow these steps:

• preamble codes:
  1. define the documentclass as standalone,
  2. use the package tikz.
• body codes:
  1. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  2. use \draw and \filldraw to set nodes and rectangles.

tikz-3dplot for Tensor Structure

[Example 19]

This example gives a graphical illustration of a third-order tensor. To draw this example, we can follow these steps:

• preamble codes:
  1. define the documentclass as standalone,
  2. use both tikz and tikz-3dplot packages.
• body codes:
  1. set \Depth, \Width, and \Height parameters by using \newcommand,
  2. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  3. define the coordinates of the tensor edges,
  4. use \draw command to define nodes.

[Example 20]

This example gives a graphical illustration of classical CP tensor factorization on a third-order tensor. To draw this example, we can follow these steps:

• preamble codes:
  1. define the documentclass as standalone,
  2. use both tikz and tikz-3dplot packages.
• body codes:
  1. set \Depth, \Width, and \Height parameters by using \newcommand,
  2. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  3. define the coordinates of the tensor edges,
  4. use \draw command to define nodes.

[Example 21]

This example gives a graphical illustration of augmented tensor factorization model. To draw this example, we can follow these steps:

• preamble codes:
  1. define the documentclass as standalone,
  2. use both tikz and tikz-3dplot packages.
• body codes:
  1. set \Depth, \Width, and \Height parameters by using \newcommand,
  2. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  3. define the coordinates of the tensor edges,
  4. use \draw command to define nodes.

[Example 22]

This example gives a graphical illustration of tensor completion task and its framework including data organization and tensor completion, in which traffic measurements are partially observed. To draw this example, we can follow these steps:

• Request:
  1. upload curve1.pdf,
  2. upload curve2.pdf.
• preamble codes:
  1. define the documentclass as standalone,
  2. use both tikz and tikz-3dplot packages.
• body codes:
  1. set \Depth, \Width, and \Height parameters by using \newcommand,
  2. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  3. define the coordinates of the tensor edges,
  4. use \draw command to define nodes.

[Example 23]

This example gives a graphical illustration of low-rank autoregressive tensor completion model. To draw this example, we can follow these steps:

• preamble codes:
  1. define the documentclass as standalone,
  2. use both tikz and tikz-3dplot packages.
• body codes:
  1. set \Depth, \Width, and \Height parameters by using \newcommand,
  2. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  3. use \node, \path, \plate commands to define nodes, arrows, and plates,
  4. define the coordinates of the tensor edges,
  5. use \draw command to define nodes.

[Example 24]

This example gives a graphical illustration of singular value thresholding process of the tensor data with unitary transform. To draw this example, we can follow these steps:

• preamble codes:
  1. define the documentclass as standalone,
  2. use both tikz and tikz-3dplot packages.
• body codes:
  1. set \Depth, \Width, and \Height parameters by using \newcommand,
  2. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  3. use \node command to define nodes,
  4. define the coordinates of the tensor edges,
  5. use \draw command to define nodes,
  6. use \filldraw command to define colors of rectangles.

[Example 25]

This example gives a graphical illustration of low-rank tensor completion model. To draw this example, we can follow these steps:

• Request:
  1. upload input_tensor.pdf,
  2. upload output_tensor.pdf.
• preamble codes:
  1. define the documentclass as standalone,
  2. use both tikz and tikz-3dplot packages,
  3. use the algorithm2e package,
  4. use \usetikzlibrary{positioning, matrix, fit, calc}.
• body codes:
  1. use \begin{algorithm} \end{algorithm} environment to define algorithm,
  2. use \matrix command to position the components,
  3. use \begin{scope} \end{scope} to contain the layers.

[Example 26]

This example gives a graphical illustration of low-rank tensor regression model. To draw this example, we can follow these steps:

• preamble codes:
  1. define the documentclass as standalone,
  2. use both tikz and tikz-3dplot packages.
• body codes:
  1. set \Depth, \Width, and \Height parameters by using \newcommand,
  2. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  3. use \draw command to define nodes.

Data Visualization

[Example 27]

This example shows the imputation accuracy of some matrix and tensor models. To draw this example, we can follow these steps:

• preamble codes:
  1. define the documentclass as standalone,
  2. use the package tikz.
• body codes:
  1. use \begin{tikzpicture} \end{tikzpicture} to start drawing,
  2. use \draw command to define nodes,
  3. use \pgfuseimage command to import images.

Related Projects

• tikz-bayesnet
• awesome-tikz
• transdim

Publications

Most of these examples are from our papers:

• Xinyu Chen, Zhanhong Cheng, Nicolas Saunier, Lijun Sun (2022). Laplacian convolutional representation for traffic time series imputation. arXiv preprint arXiv: 2212.01529. [Preprint] [Python code (univariate imputation)] [Python code (multivariate imputation)]

• Xinyu Chen, Lijun Sun (2022). Bayesian temporal factorization for multidimensional time series prediction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44 (9): 4659-4673. [Preprint] [DOI] [Slides] [Data & Python code]

• Xinyu Chen, Mengying Lei, Nicolas Saunier, Lijun Sun (2022). Low-rank autoregressive tensor completion for spatiotemporal traffic data imputation. IEEE Transactions on Intelligent Transportation Systems, 23 (8): 12301-12310. [Preprint] [DOI] [Data & Python code] (Also accepted in part to MiLeTS Workshop of KDD 2021, see workshop paper)

• Xinyu Chen, Yixian Chen, Nicolas Saunier, Lijun Sun (2021). Scalable low-rank tensor learning for spatiotemporal traffic data imputation. Transportation Research Part C: Emerging Technologies, 129: 103226. [Preprint] [DOI] [Data] [Python code]

• Xinyu Chen, Lijun Sun (2020). Low-rank autoregressive tensor completion for multivariate time series forecasting. arXiv preprint arXiv: 2006.10436. [Preprint] [Data & Python code]

• Xinyu Chen, Jinming Yang, Lijun Sun (2020). A nonconvex low-rank tensor completion model for spatiotemporal traffic data imputation. Transportation Research Part C: Emerging Technologies, 117: 102673. [Preprint] [DOI] [Data & Python code]

• Xinyu Chen, Zhaocheng He, Yixian Chen, Yuhuan Lu, Jiawei Wang (2019). Missing traffic data imputation and pattern discovery with a Bayesian augmented tensor factorization model. Transportation Research Part C: Emerging Technologies, 104: 66-77. [DOI] [Slides] [Data] [Matlab code] [Python code]

• Xinyu Chen, Zhaocheng He, Lijun Sun (2019). A Bayesian tensor decomposition approach for spatiotemporal traffic data imputation. Transportation Research Part C: Emerging Technologies, 98: 73-84. [Preprint] [DOI] [Data] [Matlab code] [Python code]

awesome-latex-drawing's Issues

Code is not match the image.

awesome-latex-drawing/BayesNet/BTMF.tex