Giter Site home page Giter Site logo

open-eyes's Introduction

OPEN-EYES

Presentation

Presentation_video

iPhone

phone1 phone2 phone3

Apple Watch

watch1 watch2 watch3

Intro

OPEN EYES is an app designed to protect visually impaired individuals in situations where they rely on auditory perception to understand their surroundings. Instead of using the TTS (Text-to-Speech) feature on a smartphone, which can potentially block the important sensory input of hearing and lead to accidents, OPEN EYES offers an alternative solution.

The app works by sending the visual information captured by the client's device to a server for object recognition and document scanning. The server then processes this information and converts it into a string of text. This text is subsequently translated into Braille, and the translation is conveyed to the client through vibrations on their Apple Watch.

Object Recognition: The app utilizes object recognition technology to identify and describe objects in real-time. This enables users to better understand their surroundings and interact with their environment more independently.

Document Scanning: OPEN EYES can scan and convert printed text into digital text using optical character recognition (OCR) technology. This allows users to access information from books, documents, and other printed materials by translating the text into Braille.

The six cells, divided into six sections, correspond to the six dots in Braille that represent a single character. When your finger touches the raised portion, it will vibrate to indicate the presence of a raised dot.

In this way, OPEN EYES enables visually impaired individuals to access visual information through the sense of touch, providing them with a safer and more inclusive experience.

Installation

Search for OPEN-EYES in the App Store and install it.

Basic Configuration

Shortcut to Open the App with AssistiveTouch on Apple Watch
If the Shortcut Download Doesn't Work

How to use

  1. Open the Watch app using AssistiveTouch.
  2. Use Siri to open the app on your iPhone.
  3. Shake your phone to launch the camera.
  4. Receive the text recognition results from the photo through vibrations on your watch or phone.
    You can use the crown on your Apple Watch to navigate to the previous or next characters of the text.
  5. If the document is long, long-press the screen on your iPhone to listen to the text recognition results through audio.

Used Libraries

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.