tobyspark/drawinginteractions

An iOS app for drawing on data.

Drawing Interactions

An iOS app designed for video and stylus. One output of the ‘Drawing Interations’ project. As that might suggest, it lets you draw and annotate. Currently, that’s on still (and moving) video imagery, but it could as much be motion capture data and so on.

This app is guided by five aims:

1. To get ‘hands on’ with time.
2. To be able to annotate and trace freeze-framed imagery.
3. To see those annotations combined as illustrations that convey development over time.
4. To be able to ‘draw through time’, tracing and highlighting movement.
5. Ultimately, to go beyond video as source data.

And to fit a broader workflow, will have to export its data for further analysis and publication.

drawinginteractions's Issues

Timeline: UI for setting playback speed

e.g. keep tap to play/pause, but if touch down then pans up/down extend a rate slider.

Video: load arbitrary video via document picker

Pretty obvious, this one.

Playback: model physically

Chase desired time by altering rate within physics-like constraints. This will also result in audio being heard during scrubs.

Persist state / data

Handle screen rotation for drawings

Drawings are recorded in the coordinate space of the screen rather than the video. This is most obvious when rotating the screen, but will also be an issue if the video can be arbitrarily placed on-screen.

Drawings are not consistently showing when snapping to frame

Timeline: UI for next frame / previous frame

Annotations: export

Pick off the easiest, but to record thoughts

• JSON of lines w/points
• Rendered drawings
• Rendered PDFs with timelines and allsorts
• ELAN, CLAN compatability

Timeline drawings are duplicated

The timeline appears to have drawing 1 at timestamp 1, but also drawing 1,2 at timestamp 3, drawing 1,2,3 at timestamp 3, etc.

Keep timeline within safeArea

Currently, the timeline can be dragged into screen edge areas it can't then be dragged back out of.

Drawing: UI for removing completed strokes

e.g. 'undo' / 'redo' buttons

Performance: dynamic drawings

The performance of dynamic drawings (i.e. drawing when scrubbing/playing) is subpar. Notably

• App framerate drops
• Temporal resolution of points is not enough. Partly framerate, above, but also missing coalesced points.

Timeline: can be enlarged via vertical pinch

Timeline: timescale can be zoomed via horizontal pinch