marxlp/pyflightanalysis

Flight log file visualization tools

pyFlightAnalysis

A PX4 flight log (ulog) visual analysis tool, inspired by FlightPlot.

pyFlightAnalysis GUI

pyFlightAnalysis is written in Python, and depends on pyqtgraph (which is based on PyQt), pyOpenGL, pyulog, and a number of other widely used scientific packages including numpy, matplotlib, etc.

For other log analysis tools see dev.px4.io

Installation

pyFlightAnalysis only supports Python 3.x. To use pyFlightAnalysis, you can either clone the repository and run the tool directly from source, or you can install pyFlightAnalysis (from source or using the PyPi Python package manager) and then run it. In either case you will first need to install PyQt (as shown below).

Install PyQt

PyQt5 can be installed directly from pip:

pip install PyQt5

Run from Source

After installing PyQt, enter the following commands to install other dependencies:

pip install pyqtgraph pyOpenGL pyulog matplotlib numpy

Once you have installed these packages you can clone the source files:

# In folder where you want put the source code
git clone https://github.com/Marxlp/pyFlightAnalysis.git

Then run the analysis.py source files:

cd pyFlightAnalysis/src
python analysis.py

Install and Run

You can install pyFlightAnalysis from either source or PyPi (after first installing PyQt as described above):

# Install from pypi
pip install pyFlightAnalysis

Or

# Install from source
git clone https://github.com/Marxlp/pyFlightAnalysis.git
python setup.py install

After installing pyFlightAnalysis you can run it as shown:

analysis

Features

• Dynamic filter for displaying data
• 3D visulization for attitude and position of drone
• Easily replay with pyqtgraph's ROI (Region Of Interest)

Usage

Video Tutorial:

Brief usage tutorial of pyFlightAnalysis

Literacy Tutorial:

1. Open log file (currently only support .ulg format) by clicked .
2. Choose data by using filter and double click to add it.
3. Change color or toggle visibility .
4. Scroll the middle wheel of mouse to zoom, press down and drag to move the curve.
5. Click to show 3D viewer ( currently may not be robust).
6. Press to play ( you'd better open the 3D viewer to show the animation).

Issues

If you have installed PyQt4 and pyqtgraph but get the error below:

ImportError: cannot import name QtOpenGL

try

>>> sudo apt-get install python-qt4-gl

License

MIT

pyflightanalysis's Issues

A few issues while using the app

Ok, there's a few.

so, loading data into the app, and hitting play causes this to happen:

C:\Users\mikep\Desktop> analysis
C:\Python\Anaconda3\lib\site-packages\h5py\__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
Traceback (most recent call last):
  File "C:\Python\Anaconda3\lib\site-packages\pyflightanalysis-1.0.4b1-py3.6.egg\pyflightanalysis\analysis.py", line 358, in animation_update
    state_data = [self.position_history[indexes[0]],
TypeError: 'map' object is not subscriptable

Trying to export the graph:

C:\Users\mikep\Desktop> analysis
C:\Python\Anaconda3\lib\site-packages\h5py\__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
Traceback (most recent call last):
  File "C:\Python\Anaconda3\lib\site-packages\pyqtgraph\exporters\Exporter.py", line 77, in fileSaveFinished
    self.export(fileName=fileName, **self.fileDialog.opts)
  File "C:\Python\Anaconda3\lib\site-packages\pyqtgraph\exporters\ImageExporter.py", line 70, in export
    bg = np.empty((self.params['width'], self.params['height'], 4), dtype=np.ubyte)
TypeError: 'float' object cannot be interpreted as an integer

trying to run the simulation:

C:\Users\mikep\Desktop> analysis
C:\Python\Anaconda3\lib\site-packages\h5py\__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
Traceback (most recent call last):
  File "C:\Python\Anaconda3\lib\site-packages\pyflightanalysis-1.0.4b1-py3.6.egg\pyflightanalysis\analysis.py", line 381, in callback_show_quadrotor
    splash = ThreadQDialog(self.quadrotor_win.quadrotor_widget,self.quadrotor_win)
  File "C:\Python\Anaconda3\lib\site-packages\pyflightanalysis-1.0.4b1-py3.6.egg\pyflightanalysis\analysis.py", line 661, in __init__
    self.connect(self.loading_widget,QtCore.SIGNAL('loadFinished(bool)'),self.callback_close)
AttributeError: 'ThreadQDialog' object has no attribute 'connect'

There are more, I think I may have installed wrong. I dont have these issues in other programs, though.

symbol lookup error

I successfully installed pyFlighAnalysis but I'm stuck when trying to start it. I'm using Ubuntu 18.04 and I have next error:
egor@egor:~/Documents/pyFlightAnalysis/src$ python analysis.py
python: symbol lookup error: /usr/lib/x86_64-linux-gnu/libGLX_mesa.so.0: undefined symbol: xcb_dri3_get_supported_modifiers
What seems to be the problem and how can I resolve it ?

Encountered problem loading ulg file

Hi there,

I encountered problem while trying to load the ulg file via the user interface. It appears to complain no such file/directory.

config.txt not found error

I get this simple error if installed via pip:

Traceback (most recent call last):
  File "/home/bramsvs/.local/lib/python3.6/site-packages/pyflightanalysis/analysis.py", line 305, in callback_open_log_file
    with open(get_source_name('config.txt'), 'r+') as conf:
FileNotFoundError: [Errno 2] No such file or directory: '/home/bramsvs/.local/lib/python3.6/site-packages/pyflightanalysis/config.txt'

Can't find the exact same line in this repo, only this:

pyFlightAnalysis/src/analysis.py

Line 406 in 88ce9b4

with open(config_path, 'r') as conf:

Workaround:

touch /home/bramsvs/.local/lib/python3.6/site-packages/pyflightanalysis/config.txt

ImportError: cannot import name 'QtOpenGL' from 'pyqtgraph.Qt'

Traceback (most recent call last):
File "analysis.py", line 23, in
from widgets import (QuadrotorWin, InfoWin, ParamsWin,
File "/home/parallels/dev/github/pyFlightAnalysis/src/widgets.py", line 8, in
from pyqtgraph.Qt import QtCore,QtGui,QtOpenGL
ImportError: cannot import name 'QtOpenGL' from 'pyqtgraph.Qt' (/home/parallels/.local/lib/python3.8/site-packages/pyqtgraph/Qt/init.py)

Ubuntu 20.04 (ARM)
Python 3.8.10

AttributeError causing pyFlightAnalysis to crash

When I import a flight log I get a message saying: 'odict_keys' object has no attribute 'index', but the program continues to run. When I try to open a particular data stream, for example vehicle_local_position, it causes a crash saying

Traceback (most recent call last):
  File "/home/ross/miniconda2/envs/flight_log_analysis/lib/python3.6/site-packages/pyflightanalysis/analysis.py", line 457, in callback_tree_double_clicked
    data_index = self.data_dict.keys().index(item_label.split('->')[0])
AttributeError: 'odict_keys' object has no attribute 'index'
Aborted (core dumped)

ubuntu mate "No matching distribution found for PyQt5"

Hi there,
trying to install on ubuntu mate 16.04 I do the steps:

• sudo apt install python3-pip
• pip3 install --upgrade pip
• pip3 install PyQt5

in this last step there is an error:
No matching distribution found for PyQt5

also tried to install PyQt5 in the system with sudo apt install python3-pyqt5, but then the pyFlightAnalysis installation failed with:

pip3 install pyFlightAnalysis
Could not install packages due to an EnvironmentError: [Errno 13]

what can I do for this ?

Visualization Crashes on Scroll wheel zoom

When I use two finger scroll in the visualization window on a MacBook trackpad the program crashes. Couldn't test with a mouse wheel but I imagine it might be the same.

analysis                                                                                                                                                                                                                          [08f01b5]
2019-10-04 14:26:56.862 python[89594:8884286] GLUT Warning: glutInit being called a second time.
None
<pyflightanalysis.analysis.TableView object at 0x11c021948>
objc[89594]: Class FIFinderSyncExtensionHost is implemented in both /System/Library/PrivateFrameworks/FinderKit.framework/Versions/A/FinderKit (0x7fff99a5b3d8) and /System/Library/PrivateFrameworks/FileProvider.framework/OverrideBundles/FinderSyncCollaborationFileProviderOverride.bundle/Contents/MacOS/FinderSyncCollaborationFileProviderOverride (0x123c8cf50). One of the two will be used. Which one is undefined.
End initialization.
None
<pyflightanalysis.analysis.TableView object at 0x11c021948>
None
Traceback (most recent call last):
  File "/Users/dlw/Workspace/pyFlightAnalysis/.direnv/python-3.7.3/lib/python3.7/site-packages/pyFlightAnalysis-1.1.0b0-py3.7.egg/pyflightanalysis/widgets.py", line 937, in wheelEvent
    self.setScale(event.delta())
AttributeError: 'QWheelEvent' object has no attribute 'delta'
[1]    89594 abort      analysis

can't open

after analysis:
Traceback (most recent call last):
File "/home/mch/.local/bin/analysis", line 7, in
from pyflightanalysis.analysis import main
File "/home/mch/.local/lib/python2.7/site-packages/pyflightanalysis/analysis.py", line 20, in
from widgets import QuadrotorWin, InfoWin, TabWidget
File "/home/mch/.local/lib/python2.7/site-packages/pyflightanalysis/widgets.py", line 161, in
class QuadrotorWidget(QtOpenGL.QGLWidget):
File "/home/mch/.local/lib/python2.7/site-packages/pyqtgraph/Qt.py", line 56, in getattr
raise self.err
ImportError: cannot import name QtOpenGL

Give full list of dependencies in README

In section https://github.com/Marxlp/pyFlightAnalysis#run-from-source , rather than the somewhat imprecise list of dependencies, would be great if you could provide something people can copy-paste like:

pip install pyqtgraph pyOpenGL pyulog numpy matplotlib

If using Python3, then also install PyQt as shown

pip install PyQt5

Note If using Python 2, instead install PyQt4 manually ....

how to check the my log file in pyFlightAnalysis

am using windows 10. am already convert my log file to csv but am analysis the data in pyflightanalysis . how to do

Undefined function glutInit

I'm trying to use pyFlightAnalysis on Windows 10, following the 'run from source' instructions in the readme.

Following the advice here, I believe I'm running the right versions of everything; Python 3.7 (using virtualenv), and pyqtgraph 0.10.0.

When I try to run analysis.py, it fails with the following error:

OpenGL.error.NullFunctionError: Attempt to call an undefined function glutInit, check for bool(glutInit) before calling

What can I do to fix this?

shows me nothing , gives me an error

gives me q[o] then saying out of index range when i upload , it doesnt show anything, i'm running on iwndows 10

ImportError: cannot import name 'QtOpenGL' from 'pyqtgraph.Qt'

I'm trying to use pyFlightAnalysis on Windows 10, following the 'run from source' instructions in the readme.

When I try to run analysis.py, I'm getting the error:

ImportError: cannot import name 'QtOpenGL' from 'pyqtgraph.Qt'

Am I doing something wrong, or is something broken?

OpenGL.error.NullFunctionError: Attempt to call an undefined function glutInit, check for bool(glutInit) before calling

i'm getting an error when i try to run the analysis file

Cannot run from sourse

I tried to install and run in anaconda environment

after I type "python analysis,py"

comes the error:

ImportError: cannot import name 'QtOpenGL' from 'pyqtgraph.Qt' (/home/zhangyuyang/anaconda3/envs/learn/lib/python3.9/site-packages/pyqtgraph/Qt/init.py)

Installation from pip fails - no module widgets

I have a python3 virtual environment in which I first installed PyQt5 and then pyFlightAnalysis - see env below:

(mypy3env) ubuntu@ubuntu:~/github/pyFlightAnalysis$ pip list
numpy (1.14.3)
pip (8.1.1)
pkg-resources (0.0.0)
pyFlightAnalysis (1.0.1b1)
PyOpenGL (3.1.0)
PyQt5 (5.10.1)
pyqtgraph (0.10.0)
pyulog (0.6.0)
setuptools (20.7.0)
sip (4.19.8)

When I try run analysis I get error:

ubuntu@ubuntu:~/github/pyFlightAnalysis$ analysis
Traceback (most recent call last):
  File "/home/ubuntu/github/pyFlightAnalysis/mypy3env/bin/analysis", line 7, in <module>
    from pyflightanalysis.analysis import main
  File "/home/ubuntu/github/pyFlightAnalysis/mypy3env/lib/python3.5/site-packages/pyflightanalysis/analysis.py", line 16, in <module>
    from widgets import QuadrotorWin
ImportError: No module named 'widgets'

Similarly, building from source fails - as you would expect because dependency is missing. See #5

No response after loading the file

No response after loading the file

The terminal jump out of 'vehicle' in terminal_ local_ position' is not in list'

How Can I solve it?

$ analysis
Gtk-Message: 15:56:58.511: Failed to load module "canberra-gtk-module"
None
<pyflightanalysis.analysis.TableView object at 0x7f4d516d2190>
Traceback (most recent call last):
File "/home/whu/.local/lib/python2.7/site-packages/pyflightanalysis/analysis.py", line 305, in callback_open_log_file
with open(get_source_name('config.txt'), 'r+') as conf:
IOError: [Errno 2] No such file or directory: '/home/whu/.local/lib/python2.7/site-packages/pyflightanalysis/config.txt'
Traceback (most recent call last):
File "/home/whu/.local/lib/python2.7/site-packages/pyflightanalysis/analysis.py", line 305, in callback_open_log_file
with open(get_source_name('config.txt'), 'r+') as conf:
IOError: [Errno 2] No such file or directory: '/home/whu/.local/lib/python2.7/site-packages/pyflightanalysis/config.txt'
None
Appriciate your help, thanks