Comments (4)
foolip
commented on July 28, 2024
@AdamSobieski, is speechSynthesis.speak(document) something that could be implemented on top of the current API, are are there things that are impossible to do with the current API that would be needed first?
It sounds a lot like you're describing a screen reader, how would an API to read a whole document interact with that?
from speech-api.
AdamSobieski
commented on July 28, 2024
@foolip , I think that such a polyfill is possible. Algorithms can traverse DOM trees to produce SSML. In theory, a hypertext-to-speech JavaScript library could be implemented atop the current Web Speech API.
There are some complexities. There is, for instance, complexity with respect to the speech synthesis of MathML. One solution is to use the MathML annotation framework. That is, inside of <annotation-xml> elements, one can put SSML versions of MathML expressions.
<html xmlns:ssml="http://www.w3.org/2001/10/synthesis">
<body>
<span id="sentence-2">This is a sentence with mathematics <math>...<annotation-xml encoding="application/ssml+xml">...</annotation-xml>...</math> for hypertext-to-speech.</span>
</body>
</html>Screen readers and accessibility are proximate topics. A hypertext-to-speech API could clarify a number of interoperating technologies which are also utilized by screen readers. A hypertext-to-speech API (client-side speech synthesis) and media overlay standards (server-side speech synthesis) could simplify Web-based multimodal dialogue systems.
References
- https://www.w3.org/TR/MathML3/chapter5.html#mixing.semantic.annotations
- https://www.w3.org/community/exercises-and-activities/wiki/Hypertext-to-Speech_and_Media_Overlays#Media_Overlays
from speech-api.
foolip
commented on July 28, 2024
What I'd suggest here is to experiment with achieving the effect that you're after using JavaScript. If there are things not possible with existing web platform APIs, file requests for those smaller missing bits. (Note that in theory Web Speech API already supports SSML as a string to the SpeechSynthesisUtterance constructor, although it doesn't work in Chrome and I'm not sure about other browsers.)
Since not everybody in the Speech API Community Group subscribes to GitHub issues, you could also email [email protected] to reach more people who have been involved with Web Speech.
If you are interested in pursuing a high-level feature like this, however, I would ask that it's first incubated in https://wicg.io/, as it would be a significant expansion of scope for this spec.
from speech-api.
foolip
commented on July 28, 2024
I added a test for SSML in web-platform-tests/wpt#12568 to see if it's supported anywhere.
from speech-api.
Related Issues (20)
- Define how to load custom voices HOT 3
- Can I capture UserMedia stream and do processing on that along with using SpeechRecognition HOT 1
- SpeechRecognition ends after unspecified time
- Bubbling model for SpeechSynthesisUtterance HOT 1
- need to improve speech recognition in conversation between multiple speakers
- Speach Destination HOT 1
- Requirements for SpeechSynthesisErrorEvent HOT 1
- Offline/on-device speech recognition HOT 2
- Could we have web speech API support IPA for speech synthesis voice language HOT 2
- Arabic TTS Web Speech is Missing some letters
- Interaction with screen readers and other assistive technology? HOT 1
- getVoices() is supposed to be user agent dependent, but appears not to be. HOT 1
- Android issue HOT 1
- Could not get isFinal == true HOT 9
- Feature request: SpeechRecognition pause/resume HOT 2
- Multiple Issues HOT 1
- speechSynthesis: utterance with lang but not voice
- Why is SpeechRecognition not working correctly in Safari?
- Clear Privacy Contracts HOT 1
- Continuously listening
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from speech-api.