luaav/luaav

Audiovisual scripting with Lua

LuaAV: Audiovisual Scripting with Lua

See the copyright information in the file named COPYRIGHT.

LuaAV is an integrated programming environment based upon extensions to the Lua programming language to enable the tight real-time integration of computation, time, sound and space. LuaAV is first and foremost an audiovisual composition environment but can be used for general Lua scripting and prototyping as well.

Principal developers: Wesley Smith and Graham Wakefield.

LuaAV Website: http://lua-av.mat.ucsb.edu

LuaAV Concept

LuaAV is a real-time audiovisual scripting environment based on the Lua scripting language and a collection of libraries for sound, graphics, and media protocols. The goal of LuaAV is to serve as a computational platform for creative exploration that is both fluid and generative. As with the Lua language, the design strategies for LuaAV favor mechanisms over implementation in order to keep its structure as clear, compact, dynamic, and reconfigurable as possible. At any given moment, it should be possible to enact any creative thought about sound, image, space, and time and experiment with a range of possible approaches without having to divert energy away from its pursuit due to the brittleness of the computational system. Computation must become plastic. Software must become softer.

LuaAV is a generative kernel of computation, capable of spawning new structures and procedures dynamically. In essence, it is meta-software for an audiovisual composition capable of generating a vast range of possible software either at the hand of a user/programmer or even algorithmically through abstract machines. As much of LuaAV as is reasonable is generated dynamically through the built-in compiler, parser, and code generating mechanisms such that the software grows and adapts as features are employed.

LuaAV is divided between a cross-platform library called libluaav and collection platform-specific classes and functions that make up the LuaAV application. libluaav contains the core timing, scheduling, and multi-threaded messaging functionality and is designed in such a way that it can be embedded in a wide variety of contexts much like Lua itself. Possible contexts might include VST plugins, web-browser plug-ins, streaming radio stations, or other host applications such as 3D modeling programs. In such contexts, platform-specific functionality such as windowing and menus are irrelevant, which is why they are in the LuaAV application instead of libluaav.

luaav's Issues

Linux buildsystem broken on Ubuntu 11.10?

on a fresh install of ubuntu 10.10 with all the updates,
install_dependenices.sh went ok
but lua build_linux_lua ../

failed at building video module with the:

ERROR: In file included from /usr/include/glib-2.0/glib/galloca.h:34:0,
from /usr/include/glib-2.0/glib.h:32,
from /usr/include/gstreamer-0.10/gst/gst.h:27,
from /home/nesa/LuaAV/LuaAV/buildtool/../modules/video/src/video/GstUtils.h:4,
from /home/nesa/LuaAV/LuaAV/buildtool/../modules/video/src/video/GstVideoImpl.h:7,
from /home/nesa/LuaAV/LuaAV/buildtool/../modules/video/src/video/VideoImpl.cpp:12:
/usr/include/glib-2.0/glib/gtypes.h:34:24: fatal error: glibconfig.h: No such file or directory
compilation terminated.

Script Ordering is Confusing

Script ordering in the LuaAV console is confusing and inconsistent. When a script is loaded, it automatically goes to the top, which is not desirable.

Linux build stops after calling svn command - should be updated for git?

Hiho,

After checking out the source from github and building (build instructions with the source, e.g in an INSTALL file, would also be nice), I'm getting an error when the build script tries to svn export folders; this should probably be adapted since the source moved to git?

svn export --force /home/nescivi/versioncontrol/git/github/LuaAV/LuaAV/buildtool/../LuaAVApp/scripts /home/nescivi/versioncontrol/git/github/LuaAV/LuaAV/buildtool/../sysbuild/Debug/resources

ERROR: svn: '/home/nescivi/versioncontrol/git/github/LuaAV/LuaAV/LuaAVApp/scripts' is not a working copy

LuaAV looks in different path for files than where they are

Hi,

after building, I start LuaAV from the Debug build folder.
LuaAV then looks for various files in
Debug/resources/
whereas they are in
Debug/resources/scripts

I manage to solve it temporarily, but this should be fixed.

sincerely,
Marije

Broken Scripts

• simple.gui.lua
• scope.display.lua
• setphase.lua
• processing.example.mousepressed.lua (mousePressed)

Better Documentation + Search

Improve documentation layout and add a search feature.

Midi help file outdated

midi help file says functions to get the in/out ports are:

inputs()
outputs()

printing the actual midi module says:

inports()
outports()

which works.

This can be a little bit misleading because there is no midi example at all and one relies on the documentation only.

Help from menu or help button not working

In the last release (12.22.11) opening the help from the menu (Help > LuaAV Reference) and the ? Button on the bottom right aren't working.

opengl.Shader load shader code from vs/fs files

could load form these files directly and as a file reference within a .shl file.

Interaction Console Buffer Needed?

possibly remove this feature.

Misc. Release Issues

-) Box2d helpfile not working.
-) Module opencv not found
-) The lines drawn by the processing library are blurry. Adding 0.5 to the x and y will make the line 1 pix and crisp.

Managed to build on Ubuntu 14.04...

...with these changes:

Added missing unistd.h include to /LuaAV/LuaAVApp/linux/luaav_app_qt.cpp

Added missing dependency to libX11 to /LuaAV/buildtool/projects/LuaAV/LuaAV.lua
line 190:

+                               Dependency{
+                                       name = "X11",
+                                       path = "/usr/lib",
+                                       type = "shared",
+                               },

Added missing dependency to libdl to /LuaAV/buildtool/projects/LuaAV/LuaAV.lua line 504:

+                               Dependency{
+                                       name = "dl",
+                                       path = "/usr/lib",
+                                       type = "shared",
+                               },

Changed header path on /LuaAV/modules/font/src/lua_font.h

-       #include <freetype/freetype.h>
-       #include <freetype/ftoutln.h>
-       #include <freetype/ftglyph.h>
+       #include <freetype2/freetype.h>
+       #include <freetype2/ftoutln.h>
+       #include <freetype2/ftglyph.h>

Don't know if it runs, though, still searching for the app binary :)

Pause Button

It would be nice if there was a pause button for each script. This would stop all schedulers in the script.

Help Menu Item to Open Local Docs

add a help menu item to open local documents that ship with the binary

Text Editor Preferences

It would be nice to set the text editor opened by LuaAV via a preferences pane.

Newest OSX Binary - OpenCV module missing?

Trying out the OpenCV example the OpenCV module seems to be missing?

error ...ns/LuaAV/extra/samples/opencv/opencv.filter.test.lua:12: module 'opencv' not found:
no field package.preload['opencv']
no file '/Applications/LuaAV/extra/samples/opencv/opencv/init.lua'
no file '/Applications/LuaAV/extra/samples/opencv/opencv.lua'
no file '/Applications/LuaAV/LuaAV.app/Contents/Resources/opencv/init.lua'
no file '/Applications/LuaAV/LuaAV.app/Contents/Resources/opencv.lua'

Mute/Solo Buttons

It would be nice if there were mute/solo buttons for each script