HeadGazeLib is a pure Swift library to empower iOS app control through head gaze without a finger touch.
See the story behind it here
The above teaser is available at example/demo.
Any iOS developer who would like to introduce head-based control to their app. Ideal for accessibility and game control.
iPhone X, iOS 11, Swift 4
- Simply copy and paste the entire folder
HeadGazeLibto your xcode project. - Extend your ViewController from
UIHeadGazeViewControllerand change the button outlet reference class fromUIButtontoUIHoverableButtonorUIBubbleButton
class MyViewController: UIHeadGazeViewController{
@IBOutlet weak var myButton: UIBubbleButton! // UIButton!
}-
Similarily, change the button class from
UIButtontoUIHoverableButtonorUIBubbleButtonin the identity inspector of storyboard -
Define head gaze event handler through
UIHeadGazeRecognizerinstance inMyViewControllerclass
class MyViewController: UIHeadGazeViewController{
//.....
private var headGazeRecognizer: UIHeadGazeRecognizer? = nil
override func viewDidLoad() {
super.viewDidLoad()
setupGestureRecognizer()
}
private func setupGestureRecognizer() {
// set button dwell duration
self.myButton.dwellDuration = 1 // in second
// add head gaze recognizer to handle head gaze event
self.headGazeRecognizer = UIHeadGazeRecognizer()
//Between [0,9]. Stablize the cursor reducing the wiggling noise.
//The higher the value the more smoothly the cursor moves.
super.virtualCursorView?.smoothness = 9
super.virtualCursorView?.addGestureRecognizer(headGazeRecognizer)
self.headGazeRecognizer?.move = { [weak self] gaze in
self?.buttonAction(button: (self?.myButton)!, gaze: gaze)
}
}
private func buttonAction(button: UIButton, gaze: UIHeadGaze){
guard let button = button as? UIHoverableButton else { return }
// The button instance would trigger TouchUpInside event after user specified seconds
button.hover(gaze: gaze)
}
@IBAction func myBtnTouchUpInside(_ sender: UIBubbleButton) {
print("Button clicked by head gaze.")
}
//....
}For working demo, we have prepared three examples:
- demo: A simple jump start example showing how to empower a regular iOS app with head control with minimum code change.
- HeadSwipe: A more serious example - swipe daily deal on eBay with head control
- Sensitivity: An example on how to use
UIMultiFuncButtonto track the location and timestamp of the cursor as user is "clicking" the button. Useful for sensitivity analysis.
If you find this work useful in your research, please consider citing:
Cicek, Muratcan, Jinrong Xie, Qiaosong Wang, and Robinson Piramuthu. "Mobile Head Tracking for eCommerce and Beyond." arXiv preprint arXiv:1812.07143 (2018).
BibTeX entry:
@article{cicek2018mobile,
title={Mobile Head Tracking for eCommerce and Beyond},
author={Cicek, Muratcan and Xie, Jinrong and Wang, Qiaosong and Piramuthu, Robinson},
journal={arXiv preprint arXiv:1812.07143},
year={2018}
}
Copyright 2018 eBay Inc.
HeadGazeLib is available under the MIT license. See the LICENSE file for more info.
Jinrong Xie, Muratcan Cicek, Qiaosong Wang, Robinson Piramuthu
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent