dmotz/thing-translator

📷 🗣 Point your camera at things to hear how to say them in a different language

Thing Translator

An AI Experiment

✨ Try the live demo here. ✨

Thing Translator is a web app that lets you point your phone (or laptop) at stuff to hear to say it in a different language. It was developed as part of Google's AI Experiments project. You can try the app here.

Behind the scenes Thing Translator is using Google's Cloud Vision and Translate APIs.

Development

To start a development server on 9966 that will watch for code changes simply run:

$ npm start

You will need to set your API key in src/config.js.

To optimize the output for production, run:

$ npm run build

For production builds, replace the contents of the api_key file with your production key.

If you'd like to create a fork or a similar project, you'll need to setup some API keys on Google Cloud Platform.

thing-translator's Issues

Do you accept pull requests?

@dmotz, do you accept pull requests?

Am not able to access camera in windows even after changing API KEY

Am not able to access the camera in windows even after changing API KEY, can you guide me how can i setup in order to access it. what all changes i have to do

Too quick to label an object as a weapon. -be careful what that code is used for.

When I held up a harmonica, it says weapon. Checking the harmonica a second time yields 'pistol'. When I held up a pen, it says weapon. Be careful what that code is used for.

Not working showing lots of error

Pronunciation

I know this is not a technical issue exactly. But while giving the app a try I noticed that at least for the Spanish pronunciations almost all of them were incorrect. It's clear that the app's learned language skills are based on English phonemes which is distinctly obvious with the vowels.
Just figured for a translator it's a noticeable factor.

How to develop thing_translator as an Android App

Hello Sir,
I just check out the Project Thing_translator.I want to develop this project as an android app that
can be run in mobiles.Please help me, how to develop thing_translator as an android app.
Is it possible to develop thing_translator in any other programming language instead of
Node.js??

              I will wait for your reply
              Thanks

App doesn't work

Can you re-check if everything's working on your side? All I'm getting is the failureState.

Requests from referer are blocked

I'm trying to run this project in localhost and I encountered this error while running it.

It says:

{error: {code: 403, message: "Requests from referer http://localhost/www/index.html are blocked.",…}}

Anyone can help?

needs options to load an image file

upon running npm run dev the app loads the error view only

I have npm installed , have installed all the project dependecies, yet the app does not seem to load the main view; this on all the browsers on my mac (chrome/opera/safari)
I built a webRTC app to check if my accesibility to video etc is fine ; that piece works spendidly.
Could you help me on this ; am I missing something here?

how to create ios app

? Appearing when using web-app demo

On certain days when I use this app I get ? when taking any pictures- the app is using the camera fine during this. Vision and Translate API don't happen to be down or anything when this happens. Not sure how often this occurs but the downtime seems to be 1-2 days sometimes every couple of weeks or so.

Server Error

I cloned the repo, moved into the directory and run npm install, then ran npm run dev and got this error
Error: Cannot find module '../modules/web.dom.iterable' (While processing preset: "/var/www/thing-translator/node_modules/babel-preset-es2015/lib/index.js") while parsing file: /var/www/thing-translator/src/app.js

Demo doesnt work

Hello,
I was seeing ur project and i wanted to try the demo but it is not working.

thing-translator.appspot.com not working

HI,

Looks like the version deployed at thing-translator.appspot.com/ has a problem with its Google Vision API key. THe query to vision returns a 400 error with the following body.

{
  "error": {
    "code": 400,
    "message": "API key expired. Please renew the API key.",
    "status": "INVALID_ARGUMENT",
    "details": [
      {
        "@type": "type.googleapis.com/google.rpc.ErrorInfo",
        "reason": "API_KEY_INVALID",
        "domain": "googleapis.com",
        "metadata": {
          "service": "vision.googleapis.com"
        }
      }
    ]
  }
}

Unable to use back camera of smartphone

Please add the ability to change video input from front to back camera using UI. By default the app uses the front camera. It makes the app almost unusable.

Tested on Google Nexus 5 using Google Chrome.

The following sample can be helpful: https://webrtc.github.io/samples/src/content/devices/input-output/ ;-)

Black Screen

Really new to this, got it running, but is only showing me a black screen in the browser. Am I doing something wrong? Thanks for your help!

Google API Key place.

Hi, where should I put the google API key? I tried to run in my local and its not working. Hope you can help. Thanks :)

Chromium Web Browser Camera Issues on Raspbian Jessie (RPI3)

Does this app work on Raspbian Jessie 8 (Raspberry Pi 3 - ARM) and the Chromium web browser? It seems like the browser prompts the user to allow for camera access but camera image does not render in the browser frame after access is allowed...

localhost:9966

Thanks.