Page MenuHomePhabricator

[SPIKE] Review Jio voice APIs
Closed, ResolvedPublicSpike

Description

Background

Through the research on understanding KaiOS users, we learned that some users prefer voice search over typing as a way to search for information on their phones. This spike task is to help us identify:

  1. What Indic languages the Jio voice API supports
  2. How it works
  3. How to integrate it
  4. Identify integration risks

Results

Jio confirmed there is no Voice API for us to use but they are working on it.

On non-Jio devices, the Google assistant can be used to search (long press on CSK) in the app. On Jio devices, the Google assistant is present but seems to be only integrated on Google apps (youtube, maps).

The Web Speech API can be enabled using the speech-recognition permission in the manifest. Here's an example on how to use it:

var recognition = new SpeechRecognition();
recognition.continuous = false;
recognition.lang = 'en-US';
recognition.interimResults = false;
recognition.maxAlternatives = 1;
recognition.onresult = event => { /* do something with event.results[0][0].transcript */};
recognition.start(); // listening now

Event Timeline

AMuigai created this task.

I remember seeing mentions of the Voice SDK but I can't find the documentation anywhere. I've emailed Jio about it, still waiting for a response.

SBisson edited projects, added Inuka-Team; removed Inuka-Team (Kanban).

Jio confirmed there is no Voice API for us to use but they are working on it.

Could not find any KaiOS-specific APIs for this.

There is a standard SpeechRecognition Web API but it is not available on the Firefox version that powers KaiOS.

AMuigai renamed this task from [SPIKE] Review Jio voice APIs to [SPIKE] Review availaibility of voice APIs on KaiOS.Nov 25 2020, 12:27 PM
AMuigai updated the task description. (Show Details)
AMuigai moved this task from Product sign off to Dev on the Inuka-Team (Kanban) board.
AMuigai renamed this task from [SPIKE] Review availaibility of voice APIs on KaiOS to [SPIKE] Review Jio voice APIs.Nov 26 2020, 11:50 AM
AMuigai updated the task description. (Show Details)