Extracting multiple entities with same name from user message.

[gsanasW]

Extracting multiple entities with same name from user message.

[oleg-fiksel]

Maybe we can use the role to create a unique variable name.
Example:

• {name: "city", role: "departure"}
• the output will be {"city_departure":{"value":"Berlin", "confidence": 0.9977127313613892}}

This will not a a breaking change but will not be obvious for a user, so we have to document it with big ‼️ 🙂

[oleg-fiksel]

I checked the rasanlu matcher and found the issue.

That's what happening:

• The entity extraction in rasanlu matcher is happening here
• which calls the entity update function
• which overwrites the key city in message.entities

This is common to Opsdroid in general, thatmessage.entities is a dictionary. A dictionary cannot contain duplicate entries.

Any ideas how to fix this without breaking every skill depending on it?

[oleg-fiksel]

Here's the test for it: oleg-fiksel@962ecfa

[oleg-fiksel]

This will also apply, when using "groups" in Rasa.

[gsanasW]

I checked the rasanlu matcher and found the issue.

That's what happening:

• The entity extraction in rasanlu matcher is happening here
• which calls the entity update function
• which overwrites the key city in message.entities

This is common to Opsdroid in general, thatmessage.entities is a dictionary. A dictionary cannot contain duplicate entries.

Any ideas how to fix this without breaking every skill depending on it?

Well is it possible, that if we found multiple same entities we can return list of values & confidence?

[oleg-fiksel]

I checked the rasanlu matcher and found the issue.
That's what happening:

• The entity extraction in rasanlu matcher is happening here
• which calls the entity update function
• which overwrites the key city in message.entities

This is common to Opsdroid in general, thatmessage.entities is a dictionary. A dictionary cannot contain duplicate entries.
Any ideas how to fix this without breaking every skill depending on it?

Well is it possible, that if we found multiple same entities we can return list of values & confidence?

Can you provide an example how will the result look like?

[gsanasW]

I checked the rasanlu matcher and found the issue.
That's what happening:

• The entity extraction in rasanlu matcher is happening here
• which calls the entity update function
• which overwrites the key city in message.entities

This is common to Opsdroid in general, thatmessage.entities is a dictionary. A dictionary cannot contain duplicate entries.
Any ideas how to fix this without breaking every skill depending on it?

Well is it possible, that if we found multiple same entities we can return list of values & confidence?

Can you provide an example how will the result look like?

yes, This is how it will look like.
{'city': {'value': ['Berlin', 'San Fransisco'], 'confidence': [0.9633104801177979, 0.7566294074058533]}}

[oleg-fiksel]

I checked the rasanlu matcher and found the issue.
That's what happening:

• The entity extraction in rasanlu matcher is happening here
• which calls the entity update function
• which overwrites the key city in message.entities

This is common to Opsdroid in general, thatmessage.entities is a dictionary. A dictionary cannot contain duplicate entries.
Any ideas how to fix this without breaking every skill depending on it?

Well is it possible, that if we found multiple same entities we can return list of values & confidence?

Can you provide an example how will the result look like?

yes, This is how it will look like. {'city': {'value': ['Berlin', 'San Fransisco'], 'confidence': [0.9633104801177979, 0.7566294074058533]}}

Ok, I understand. This is possible but it will be a change, which will most probably break every skill depending that value is not an array. 😕

[oleg-fiksel]

I tried to reproduce your issue but after some time figured out that I need to adjust intents.yml.

version: "3.1"

intents:
  - greetings
  - bye
  - help
  - travel

entities:
  - city:
    roles:
    - departure
    - destination

nlu:
  - intent: greetings
    examples: |
      - Hey
      - Hi
      - hey there
      - hello
  - intent: bye
    examples: |
      - googbye
      - bye
      - ciao
      - see you
  - intent: travel
    examples: |
      - I want to fly from [Berlin]{"entity": "city","role":"departure"} to [San Francisco]{"entity": "city","role":"destination"}
      - I want to go from [Berlin]{"entity": "city","role":"departure"} to [San Francisco]{"entity": "city","role":"destination"}
      - I want to travel from [Berlin]{"entity": "city","role":"departure"} to [San Francisco]{"entity": "city","role":"destination"}

In your intents.yml nlu: was missing and additional examples of intens.

https://docs.opsdroid.dev/en/stable/skills/matchers/rasanlu.html#example1

Note - Rasa NLU requires an intent to have at least three training examples in the list. There must also be a minimum of two intents in your file for Rasa to train.

😉

[oleg-fiksel]

What Rasa version are you using and how do you run it?

[gsanasW]

What Rasa version are you using and how do you run it?
Rasa Version : 3.3.1 Minimum Compatible Version: 3.0.0 Rasa SDK Version : 3.3.0 Python Version : 3.9.15

well, I'm training rasa model separately with rasa. and then using this model in opsdroid.

In rasa,
we can simply use rasa train command to train the model.