singulartier/aerspeech

A.E.R. Interface for Elite Dangerous

aerspeech's Issues

Configurations

Need a better way to configure custom grammar and settings.

Settings Required:
AerQuery & AerEndQuery Text
Response Timeout
Confidence
Culture Settings
Commander Name
Note Directory
VerboseLogging Directory
AER's Voice
Output Device
Input Device

Command Name missing Space

When it appends the Commander's name in the Greeting it isn't adding a space.

So if I name myself "S", it will say Greeting CommanderS instead of Greeting Commander S.

Here's the offending line

        if (commanderName != null)
            greeting.Append(commanderName);

Get current system from logging.

Slopey's BPC tool can get your current system from you log realtime in game. Could this functionality be added? That way you don't have to manually set your current system.

Ability to set AER "name"

Would it be possible to make it so the name to which AER listens is customizable? Like, having it listen to simply "hey computer" (I know, imaginative..)

EDIT: oh, also, this is small so I dunno if it deserves its own post but I think a "repeat" or "again" command to make it say the last thing again would be nice.

Reputation/KOS List (part of Notes system)

A way to query commanders for player 'notes'

Support for different keyboard layouts

I use a Swiss German keyboard layout which means that keys are in different places than the English one. For dictations, "don't" will appear as "donät" because my key / key combo for ' is somewhere else. Same for "why" which will come out as "whz" because those two keys are switched on German keyboards.

Make AER only respond when spoken to

I'm re-writing the prefix grammar to give AER some context.

"[Hey Aer|Aer|Hey Listen]" etc. will put AER in a listening state that stays for 30 seconds and gets refreshed every query. After 30 seconds of no interfacing AER will not respond until directly addressed again.

This will be in 1.3

Voice blocking

My setup makes AER constantly talk to itself. So while tell me

"Setting current system to Alpha Centauri"

it is listening and thinks I'm trying to set current system to something else.

So chains of:

"Setting current system to Alpha Centauri"
"Setting current system to Alpha Mart"
"Setting current system to Amort"

With he systems shrinking in length are common and I have to play with my mute button to stop it.

I know that you have to have it constantly listen for "stop talking" but should it be blocked to only accept that command while it is talking and blocked from other commands?

(Fun side note, "Frame Ship Drive Warming Up" comes over to AER as "Thank you" on my system, so everytime I warp, AER says "You're Welcome.")

"Where was [player] last seen?" Grammar

Part of notes system. Might not work very well.

store commander name

1.3 release notes
-Ability to store commander name

Is this done vocally or in the default XML? I cannot seem to find a command for it.

EDIT: FOUND IT

AU Hayley Voice not working

" I did try and run it side by side as the console (to try the dictation stuff), and while it did work, interestingly, it defaulted to Anna, not the voice I have set as default. I checked in both the TTS settings and in Narrator, and it shouldn't be using Anna. Maybe it's the way it's calling it.
One thing on the console. When I run it, it crashes once, then reruns itself. Both times it shows the RSS error listed, then I get these two: Error formatting Average Price for Terrain Enrichment Systems and Toxic Waste, input string was not in a correct format."

x86 Voice Attack

"It's one of the other MS voices, the AU Hayley. I hear her going into Narrator setup as well as the other settings windows, but Anna comes out of the console. As the plugin, Hayley works fine."

Added What is said to console

Can you make AER output what he is saying to the console? I think it is just adding debug.log to the .say class, but you would know better :)

Commodity Data Incomplete or searching is incorrect

Some commodities at stations are not showing up in commodity searches. This can either be because the data from eddb is incorrect or the search is incorrect.

CPU usage hovers around 10%

Polling thread is eating CPU.

Setting reminders

Does the note-taking system allow for setting reminders? Because IMO that could be a nifty addition.
Something like "Set reminder x days y hours z minutes [reminder content]". (maybe support not only "x time has to pass", but also "on x day at y time")

Not sure whether parting it up into two parts whereby you first enter the time, wait for confirmation, and then enter the message would be better. It probably needs the option to change it though, directly after entry and also at a later point. Maybe have the player confirm / decline and try again after time entry and message entry?

"Set reminder"
"Setting reminder, please enter time or date"
"in 2 hours"
"setting reminder to in 2 hours"
["confirm." | "change that" (starts the time input over)]
"please state the reminder content"
"put pizza in oven"
"reminder content is 'put pizza in oven."
["confirm" | "change that" (starts the content input over)]

In order to edit the reminders after the fact they might need unique identifiers though, with which the player can ask AER to change a specific reminder.

I may or may not have accidentally forked AerSpeech...

I'm not sure what to do to make sure I don't delete something I shouldn't by accident - how do I undo this?

Type commands don't work when AER is run as a Voice Attack Plugin

I need to investigate this. I suspect VA is intercepting any keyboard input.

Updating the Json

There are new Json files out , can we update ?

Custom Responses

Make a way to customize responses, either through XML or something better.
Clean up AerTalk class in general.

A.E.R. Crashes on systems that do not have an en-US speech recognizer (all non-english systems by default)

I suspect that using something other than en-* recognizer will cause problems elsewhere.

Not sure how to test this =(

Updating the .json files

Can you give us the link for all the .json Or have AER do it for us
Aer " link established file save " ie to desktop , if it not possible to paste .json by AER when your using it

What is the closest [Federation|Alliance|Empire] System

Takes current system and searches for the closest system of the listed allegiance.

"Where is the nearest black market?" Grammar

Takes current system and finds the nearest black market.

Bonus points for "What's the closest black market to ?"

Bad memory leak in voice attack plugin.

With the plugin enabled, voice attack starts using 500 MegaBytes of memory and continually grows until all system ram is used and windows gives a warning. It has grown to over a gigabyte several times. When I disable the plugin, voice attack uses a cool 50-56 MegaBytes.

VA: 1.5.7.73

Allow for Elite wiki information pull

Would it be possible to have AER read the information stored on the Elite: Dangerous wiki?

simple use case:

• "give me information on ship type x"

more complex (not sure if viable):

• "compare ship x to ship y" (reads their stats from the wiki page and says which is better in what)

follow-up commands

Another thing that would be useful before we get API integration:

If I ask AER to tell me which the closest alliance system is, I'd like to then be able to tell her to type it into the current text field.

Example:
"What is the closest Alliance system?"
"Xi Wangda, spelled X I W A N G D A." (which, btw., appears to be Empire controlled. Also, AER doesn't spell the spaces so with some it gets hard to find them)
"Type that."

Aer not picking up 'Hey Aer'

Is there any more debug information I can get as to why it isn't finding my voice?

"How much is [commodity] at [station] in [system]"? Grammar

I'm not sure its written anywhere. In the video you ask "How much is [commoditiy]?" and its reads back a price. Unsure if it is a buy or sell price. I don't believe this function is documented or explained in the list of functions. Additionally, I'm not sure what station it is pulling that info from. Just checked the functionality, and it works, but the data does not match the current station I am in. My currently set system is correct.

Sorry for flooding your issues log. My first time with Github.

updating EDDN information through AER

This may very well be a long shot but would it be possible to allow the player to update certain information on EDDN by dictating it to AER?

Obviously I doubt anyone would want to go and read commodity prices but I've used the "give me information about station x in system y" command a couple times and more often than not the information is 90% "unknown". Now the station / system information is usually fairly limited in the sense that there aren't that many variations. For example, there are only I think four different types of allegiance for a system (Alliance, Federation, Empire, Independent, None). The same goes for, for example, space station types. As long as input is constrained to those predefined answer possibilities, from what I understand, it would be fairly hard to get that wrong and input incorrect information into EDDN by accident.

Of course there is also the non-trivial issue of whether EDDN would even allow for such a functionality.

"Update eddb data" grammar

Need a way to initiate a client-side update of EDDB json files.

Powerplay Galnet news

AER no longer able to read the news

Calculate Grammar

Voice controlled simple arithmetic so people don't need to open a calculator in the rift.

"Calculate 104.2 [times|multiplied] [by] 10"

"What Time is it?" Grammar

Says Local Time

Note taking grammar

Add Grammar for note taking.

Find Trade Routes ("What is the best trade route under xxx light years") Grammar

I'll at least TRY and get this in as a showcase of the settings.

"What is the best trade route under xxx light years?"
"What is the best trade route under xxx light years with yyy credits?"
etc.

Requires:
"Set Available Cargo Hold xxx" (or Frontier API)
"Set [Laden] Jump Distance" (or Frontier API)
"Set Available Credits" (or Frontier API)

Optional:
Jump Planner

Everything is unknown

I am using the 1.2 version of the VoiceAttack plugin.
The problem is that AER doesn't know anything, it's like it has no information. If I use the command
"Set current system to " it responds with "I do not know" no matter what system I say. I have tried both saying system names and spelling them in the nato alphabet. Nothing works. I have manually opened the "/Grammer/Default.xml" file to check that the system names are there, and they are. I have also opened the "Systems.json" to see if the data is actually there, and it is.
I don't know what I am doing wrong. It worked yesterday with the previous version.
Hope you can fix it :)
(btw, this project is AWESOME!)

Hook in to frontier API once it become available

Yeah.

Can functionality extend into the "ship"?

How much acsess to game data do you have? Can a ship diagnostic run-through be created?

Command: "Perform system check"

Hull 78 percent
Thrusters 100 percent
Shield Gen 100 percent
Cargo Hatch 100 percent
Life Support 100 percent
Frame Shift Drive Inoperable

etc etc

Ability to set "always listen" mode (to not require 'Hey Aer')

Now that the default mode requires you to query AER via 'Hey Aer', there should be a way to turn it back to always listen for those who like it that way.

EDDB station info not current.

I can update EDDB for a station I am at and ask AER to provide that info and it is not current. This may need a fix, or addressing.

Voice Attack and AER console don't work together in some configurations (depends on Engine setting)

Voice Attack on "Default Engine" and A.E.R. on en-US didn't work together.

Setting VA to en-US engine fixed the problem.

Don't know why. Investigation needed.

AER Stops responding after "stop listening" completely

Squelch doesn't recover with "start listening", going to redo the entire AerHandler state and move it to a Personality class AFTER a code cleanup pass.