Giter Site home page Giter Site logo

nullality / nullality.github.io Goto Github PK

View Code? Open in Web Editor NEW

This project forked from jaanus/voicebot

0.0 2.0 0.0 278 KB

A web-based voice bot for Stress Disorders (Incl. PTSD).

Home Page: http://nullality.github.io

JavaScript 41.79% HTML 13.78% CSS 35.72% PHP 8.72%

nullality.github.io's Introduction

SinDy V.69

This project is being developed. This is a web-based voicebot built with api.ai Dialogflow backend. It implements a static client app, and tries to communicate through natural language dialog and webhook interface.

Demo

This is running at nullality.github.io

But why?

Many people suffer from different stress disorders ranging from PTSD to General Anxiety. This project came from a real world need. I hope to apply natural language coding, and multiple technologies into a self contained audio recognition mobile diagnostic assistant with varying range of portability and form solidarity. While it may not work 'out-the-box' entirely for everyone, (or anyone for a while,) my goal is to help achieve an assistive AI that can help others in [but not limited to] grounding, disengaging, coping, identifying triggers and even building better habits.

Please feel free to message me with support, comments, suggestions, inquiries, or even donations = p I'd love help!


Implementations / Global Body

  • 1 : Simple Web App
  • 2 : React Native App
  • 3 : Embedded System
    • A : Raspberry Pi 3 + Google AIY Board
    • B : Raspberry Pi Zero W + Pimoroni Speaker board
  • 4 : Configure extensions
    • A : Alexa Skill
    • B : Facebook Messenger Bot
    • C : Slack Messenger Bot

Goals for Sindys' Capabilities

  • Recognizes your voice, responds.
  • Relief
    • Plain old Distraction
      • Small Talk
      • Webhooks for Videos / app suggestions
    • Venting
      • Record note entry
      • Create Worry List from note entry
      • Export / save list
    • Grounding
      • Mental
        • Play Simple Game
          • Suggestions e.g. Flappybird
          • Snake, Rock Paper Scissors, puzle, a self contained game?
        • Play deeper game
          • Suggestions e.g. Stranger things 2
        • Say statements
          • Name 5 olympic sports, 5 types of dog, 5 green things in the room, etc..
          • Affirmation Statements
        • Read something
          • Poems, Speeches, Philosophy excerpts from public domain.
          • Suggestions, articles, reddit.
        • Watch / Listen to Something
          • Youtube (Cat Videos, Cute or Funny videos, People playing video games, Music)
          • Music app / suggestions
          • Built in atmospheric sounds or suggestion to other app (rain, meadow, ocean, soothing sounds).
      • Physical
        • suggestion to other app
        • Breathing exercises
        • Touch various objects around you.
          • e.g. What texture do you feel? Something else, is it colder? smoother? continue for 5 instances.

General 'What's next'?

Sindys' Conversation Capabilities:

  • Learn your name, or hold small bits of preferencial information.
  • Transcribe / save notes
  • Webhooks i.e. Youtube, 'smarter' weather, calendar(?)
  • More Entities, More Contexts.

1:

  • Create multiple interval for listening events
  • Create 'stop' button for Sindy to STFU
  • Proper Cards for display of image/link?
  • Adding more style code

2:

  • Start Building.

3.A:

  • Create Startup / Shutdown scripts
  • Change identifier from 'Okay Google' to 'Okay Sindy' or 'I need help!'
  • Get a better power supply
  • Be able to: Boot, run headless, run Sindy, shut down on command.

3.B:

  • Mimic 3.A
  • assign GPIO for button / create route for identifier / add addEventListener in app.js etc..

4:

  • Start Building

Version / Deployment Status.

  • V.69 Just after my Birthday 'Break'

    • Added simple weather webhook only does weather today, must have location in query.

    • GA Update

    • Added .CTreply Timestamp - Doesn't fuckign work after first reply.

    • Testing Sindy, using test subjects to refine context and flows.

    • Removed chrome authentication in app.js. For whatever reason mobile chrome on oreo was not verifying as chrome so fuuckkiiitt.. It will still verify if you have speech synthesis, etc.. but at least it won't get denied just for chrome.

    • Update to 3.A Purchased, received, set up RPi 3(B) with Google AIY Board and Dev Kit

      • Assembled, running, works with initial identifier "Okay Google" and button tests. Communicates.
    • Update to 3.B mimicing movements of 3.A except sometimes it doesn't go as well lol.

    • Rewrote README files.

  • V.5

    • Design / apply temporary logo, reassign bot svg.
    • Add some style code
    • Added / Fine tuned nullality.github.io/r
    • Update to 3.B found issue, amperage drop in charger = (
      • Need new 5v ~2.5a charger (didn't find one at goodwill yet)
      • Works with USB battery dedicated 2a charger. Temporary Success = )
  • V.4

    • Adjusted speech intervals a bit (still needs fine tuning).
    • Added style code - rainbow motion gradient.
  • V.3

    • Started Github Repo, README file this
    • Update to 3.B Purchased, received, set up RPi Zero W with Pimoroni Speaker pHat and misc button.
      • OS, audio interface all set up. Running into issues.
      • Troubleshooting
    • Wrote ~15 pages of dialogue that needs to be transcribed into API.AI / Dialogflow
    • Researching. Researching. Researching.

Random unsorted thoughts

  • Python Library for RPi
  • Use AIML at all?
  • Touch screen enabled raspberry pi?
  • Design website / landing for whole project (don't really want to focus on this right now.)

RPi Research Wishlist

Android Apps I used for resources / inspiration.

  • AFA Grounding by Boud Digital
  • Break Free by Abele Apps
  • PTSD Coach by US Dept of Veterans Affairs (VA)

Huge Credit

Original Design - Voicebot by Jaanus

Backend - api.ai Dialogflow

nullality.github.io's People

Contributors

jaanus avatar nullality avatar

Watchers

 avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.