vizia-fydp/ios

The Vizia iOS app is responsible for receiving the AI inference results from the server and performing speech synthesis and playback on it.

ios's Issues

Build Test App to Evaluate OCR Options

Small test app that just lets you take a picture from your phone and runs OCR on it. We can use it as a sandbox to test out various OCR options as well as other computer vision features

Explore hardware options

Consider our options for the hardware that will go on the device. At a minimum, need:

• MCU Board
• Camera

Properties we want:

• Low cost
• Adequate compute power
• Bluetooth

Play around with Raspberry Pi Zero W and Pi Cam

Get familiar with the platform. Figure out how to:

• Take pictures with the pi cam
• Do common stuff (ssh into it, install/update OS, etc.)
• Go around and take some pictures with the Pi Cam so we have an idea of the kind of camera quality we are dealing with. Try it in various settings (outdoors on a sunny day, indoors, etc.)

Try out Buttons with Pi

I think we will need a few buttons as a part of our hardware design that we can configure to do some common actions. Have a look at Pi GPIO and see how many buttons we can use and how to actually trigger them from software

Find a consultant

Options:

• John Zelek (recommended by Oscar)
• See "Potential Advisors" page on Notion

Get feedback from potential users/organizations

Ideally, we'd want to talk to:

• A visually impaired person
• Organization(s) that represent or support the visually impaired
  • CNIB
  • Be My Eyes

Design Project Proposal (DPP)

Due Friday, May 28 @ 11:59 pm EDT

Explore options for AI features

Consider how to implement these to work both online and offline:

• Optical character recognition (OCR)
• Scene translation
• Text to Speech

Learn iOS dev

Finish Angela Yu's iOS bootcamp on udemy so Connor isn't the only person with iOS knowledge on the team

Brainstorm project names

Can't call this repo "FYDP" forever. Comment on this issue with your suggestions

Preliminary iOS app design mockups

Keeping in mind that the user is visually impaired, the interface needs to be as simple as possible and accessible

Preliminary Design Project Proposal (PDPP)

Due Friday, May 21 @ 11:59 pm EDT

Sending image data over an RPC call between Pi and iOS app?

This might be possible? Two most popular rpc frameworks are thrift & grpc, and they have bindings available in almost every common language (including python and swift)

• Thrift

  • https://pypi.org/project/thrift/
  • https://github.com/apocolipse/Thrift-Swift

• gRPC

  • https://github.com/grpc/grpc-swift
  • https://github.com/grpc/grpc