Testing

Section 1 – Alexa

These are the results for the Amazon Alexa Echo dot unit, out of the box set-up. Clearly functionality is evolving the whole time and may change, but as of 12th December 2017 these were the results, against the objectives.

Given each area a score out of 5, based on response. There may be other ways of achieving the result, but the base assumption is that someone living with dementia will only be capable of remebering to use using their natrual expressions.

Objective Alexa Testing Results
1 turn on/off the TV and change channels

  • “turn tv on”
  • “turn on television”
  • “switch on television”
  • “switch on tv”
  • “put on bbc1”
  • “change TV to bbc1”
  • “channel up”
  • “channel down”
 Not tested yet as requires home automation set-up.
2 be able to turn on/off music (radio)

  • “turn on radio”
  • “switch on radio”
  • “play radio”
 If you have an Amazon music account (i.e. prime) then in all cases this these will play an Alexa chosen Amazon Music stream.

If you are specific and say “Alexa play Radio 4” or “Play BBC Radio 4” then it plays the BBC Radio station.

Impressive 5/5
3 remember where my mother is, what time she will be home

To remember:

  • “[person] is going to [location] and will be back at [time]”
  • “[person] is going to [location] and will be back in [Hours / Minutes]”
  • “[person] is going for [activity] and will be back at [time]”
  • “[person] is going to [activity] and will be back in [Hours / Minutes]”

To be reminded:

  • “where is [person]”
  • “what time will [person] be back”
  • “what time will [person] be home”
  • “how long will [person] be out”
  • “how long before [person] will be back”
 In all cases, and tried with several names (“matthew”, “betty”, “mary”) and terms like “wife” it fails to understand the remember, you get a “I’m not quire sure how to help with that” response.

Therefore, cannot test the reminded part.

Failed 0/5
4 remember other specific items, where is something etc

To remember:

  • “my [item] is/are in [location]”
  • “the [item] is/are in [location]”

To be reminded:

  • “where is [item]”
  • “where did I put [item]”
  • “where did I leave [item]”
  • “I’ve forgotten where [item] is”
 Again Alexa fails on this. It doesn’t seem to understand the Remember phrase.

Failed 0/5
5 add items to a shopping list

To remember:

  • “add [item] to shopping list”
  • “remind me to buy [item]”
  • “put [item] on the shipping list”

To be reminded:

  • “what is on my shopping list”
  • “what is my shopping list”
  • “what do I need to buy at shops”
 “add apples to shopping list” – worked fine with apples and responded to day added.

“remind me to buy oranges” – fails as it wants a time when you should be reminded.

“put oranges on the shipping list” – works fine and get a “I’ve added oranges to shopping list response”

“what is on my shopping list” and

“what is my shopping list” work fine with apples and oranges list.

“what do I need to buy at the shops” – fails

Ok 4/5
6 know when I (or carer / doctor) may be visiting next / where I am currently

To be reminded:

  • “when is [person] coming next”
  • “when is [person] coming to see me”
  • “when is next visit from [person]”
  • “when is next [person] due”
  • “is [person] coming today”
  • “is [person] coming to tomorrow”
 Not yet tested
7 be able to call me / contact me in an emergency

  • “call [person]”
  • “contact [person]”
  • “get hold of [person]”
  • “I need to contact [person]”
  • “ring/telephone [person]”
  • “I need to speak to [person]”
  Not yet tested
8 check what day or week / time is

  • “what day is it”
  • “what day is today”
  • “is it [a day] today”
  • “is it [a day]”
  • “what is the time”
  • “what’s the time”
  • “is it morning”
  • “is it afternoon”
  • “what day is it” – works
  • “what day is today” – works
  • “is it [a day] today” – fails, as seems to look for an event
  • “is it [a day]” – works
  • “what is the time” – works
  • “what’s the time” – works
  • “is it morning” – fails
  • “is it afternoon” – fails

OK 4/5
9 to be able to message the house/home remotely to ask them to contact you Not applicable
10 to prompt to undertake an activity and get a response (i.e. prompt have they eaten, and get a yes/no response)

To prompt:

  • “[name] have you [activity] yet”

To be respond:

  • “yes”
  • “no”
  • “not yet”
  • “just doing it”
  • “soon”
 Not tested yet

Section 2 – Google Home

These are the results for the Google Home Mini unit, out of the box set-up. Clearly functionality is evolving the whole time and may change, but as of 12th December 2017 these were the results, against the objectives.

Given each area a score out of 5, based on response. There may be other ways of achieving the result, but the base assumption is that someone living with dementia will only be capable of remebering to use using their natrual expressions.

Objective Google home Testing Results
1 turn on/off the TV and change channels

  • “turn tv on”
  • “turn on television”
  • “switch on television”
  • “switch on tv”
  • “put on bbc1”
  • “change TV to bbc1”
  • “channel up”
  • “channel down”
 Not tested yet as requires home automation set-up.
2 be able to turn on/off music (radio)

  • “turn on radio”
  • “switch on radio”
  • “play radio”
  • “Play Radio” – If you have an default music account (i.e. play music or spotfoy) then will play an google chosen music stream.
  • “turn on radio” – fails
  • “switch on radio” – fails
  • If you are specific and say “ok google play Radio 4” or “ok google Play BBC Radio 4” then it plays the BBC Radio station.

4/5
3 remember where my mother is, what time she will be home

To remember:

  • “[person] is going to [location] and will be back at [time]”
  • “[person] is going to [location] and will be back in [Hours / Minutes]”
  • “[person] is going for [activity] and will be back at [time]”
  • “[person] is going to [activity] and will be back in [Hours / Minutes]”

To be reminded:

  • “where is [person]”
  • “what time will [person] be back”
  • “what time will [person] be home”
  • “how long will [person] be out”
  • “how long before [person] will be back”
 Not tested yet
4 remember other specific items, where is something etc

To remember:

  • “my [item] is/are in [location]”
  • “the [item] is/are in [location]”

To be reminded:

  • “where is [item]”
  • “where did I put [item]”
  • “where did I leave [item]”
  • “I’ve forgotten where [item] is”
 Not tested yet
5 add items to a shopping list

To remember:

  • “add [item] to shopping list”
  • “remind me to buy [item]”
  • “put [item] on the shipping list”

To be reminded:

  • “what is on my shopping list”
  • “what is my shopping list”
  • “what do I need to buy at shops”
 “add apples to shopping list” – worked fine with apples and responded to say added.

“remind me to buy oranges” – fails as it wants a time when you should be reminded.

“put oranges on the shopping list” – works fine and get a “sure I’ve added oranges to shopping list” response

 

“what is on my shopping list” and “what is my shopping list” work fine with apples and oranges list.

“what do I need to buy at the shops” – fails, is looks in the remember list for items with shops in, vs the shopping list

Ok 4/5
6 know when I (or carer / doctor) may be visiting next / where I am currently

To be reminded:

  • “when is [person] coming next”
  • “when is [person] coming to see me”
  • “when is next visit from [person]”
  • “when is next [person] due”
  • “is [person] coming today”
  • “is [person] coming to tomorrow”
 Not yet tested
7 be able to call me / contact me in an emergency

  • “call [person]”
  • “contact [person]”
  • “get hold of [person]”
  • “I need to contact [person]”
  • “ring/telephone [person]”
  • “I need to speak to [person]”
  Not yet tested
8 check what day or week / time is

  • “what day is it”
  • “what day is today”
  • “is it [a day] today”
  • “is it [a day]”
  • “what is the time”
  • “what’s the time”
  • “is it morning”
  • “is it afternoon”
  • “what day is it” – works
  • “what day is today” – works
  • “is it [a day] today” – works
  • “is it [a day]” – works
  • “what is the time” – works
  • “what’s the time” – works
  • “is it morning” – fails
  • “is it afternoon” – fails

OK 4/5
9 to be able to message the house/home remotely to ask them to contact you Not applicable
10 to prompt to undertake an activity and get a response (i.e. prompt have they eaten, and get a yes/no response)

To prompt:

  • “[name] have you [activity] yet”

To be respond:

  • “yes”
  • “no”
  • “not yet”
  • “just doing it”
  • “soon”
 Not tested yet