microsoft/mcw-intelligent-analytics

MCW Intelligent analytics

This workshop is archived and is no longer being maintained. Content is read-only.

Intelligent analytics

First Up Consultants specializes in building software solutions for the hospitality industry. Their latest product is an enterprise mobile/social chat product called Concierge+ (aka ConciergePlus). The mobile web app enables guests to easily stay in touch with the concierge and other guests, enabling greater personalization and improving their experience during their stay. Sentiment analysis is performed on top of chat messages as they occur, enabling hotel operators to keep tabs on guest sentiments in real-time.

June 2021

Target audience

• Application developer
• AI developer

Abstracts

Workshop

In this workshop you will learn real-time analytics without IoT. You'll enable intelligent conversation in a machine learning enabled, real-time chat pipeline, and apply analytics to visualize customer sentiment in real time for hotel guests, allowing them to chat with one another, and to communicate directly with the concierge. You'll apply analytics to visualize customer sentiment in real-time, as well as view trending sentiment over time and create a bot that can answer questions and embed it in the custom web app.

At the end of this workshop, you will better understand how to leverage Cognitive Services (LUIS & Text Analytics API), process events with Azure functions, index with Search Archive and Cosmos DB, visualize with Power BI Q&A, and use Bot Framework for questions and answers. You will be able to implement a lambda architecture, and enable web-based, real-time messaging through SignalR, Event Hubs, and Services Bus.

Whiteboard Design Session

In this whiteboard design session, you will work with a group to design a solution for building a real-time chat pipeline, incorporating machine learning and analytics to detect and visualize customer sentiment. You will also design a lambda architecture to handle both real-time chat processing and data archiving as well as search indexing for analyzing all data flowing through the system. Finally, you will determine whether a bot can be incorporated in the solution, and how it fits alongside the messaging capabilities.

At the end of this whiteboard design session, you will have a better understanding about how to design a real-time intelligent chat solution in Azure, which is scalable, enhanced by pre-built machine learning models, and the role bots can play as part of your overall solution.

Hands-on Lab

This hands-on lab is designed to provide exposure to many of Microsoft's transformative line of business applications built using Microsoft advanced analytics. The goal is to show an end-to-end solution, leveraging many of these technologies, but not necessarily doing work in every component possible.

By the end of the hands-on lab, you will be more confident in the various services and technologies provided by Azure, and how they can be combined to build a real-time chat solution that is enhanced by Cognitive Services.

Azure services and related products

• Azure Cognitive Services
• Azure Cosmos DB
• Azure Search
• Azure Event Hubs
• Azure App Services
• Azure Functions
• Azure Service Bus
• Azure Storage
• Azure Stream Analytics
• SignalR
• Language Understanding (LUIS)
• Microsoft Bot Framework
• Power BI
• Visual Studio

Azure solution

Modern Business Intelligence

Related references

MCW Library

mcw-intelligent-analytics's Issues

instructions and screenshots need to be updated

here this todo 12 should be replaced with todo 6 as it contains code written for todo 6 but named as todo 12

and while publishing chatsentiment app we should update the screenshots as per latest UI and we have to add instructions to uncheck run from package file

exercise 3 task 4

Hi in Exercise 3 task 4 , there is an issue while accesing hotel website . sometimes it is giving response sometimes it's not . when i published the app service, the hotel chat website was not responding to messages even though i can see the data in cosmos dn containers .

i tried re-publishing the app then chat worked but the next step is not working i am not able to find the data in eventhubs . it is saying there is no data make sure your strings are corrrect i cross checked the strings it is as per lab guide steps .

can you please check into this

AdventureWorks Travel

AdventureWorks Travel is not a CELA approved example

Service Bus queue output validation has changed. Hyphens not allowed.

When I was going through the lab to debug another issue, I noticed that Service Bus queue names no longer accept hyphens in the name. This causes an instruction dependency problem later when users need to create a message logger query. This total breaks the lab. It is a simple fix.

Archive folder

Hi Lino! Can you please move the Archive - October 2018 folder that contains the unguided lab document from the main workshop page and put it into the Hands-on lab folder? Thanks!

Issues with lab instructions

Hi, I am planning to deliver this lab to one of my customers next week but I found a couple of issues with the lab guide/instructions. For example, Exercise 3 asks to create the following configuration keys:

ChatMessageSubscriptionName
ChatTopic
EventHubConnectionString
SourceEventHubName
ServiceBusConnectionString

However, for some of those keys, it is not clear what the values should be. I have found other issues with the lab that I would like to discuss with someone to fix and be able to present this to my customers. I am a FTE, can someone ping me internally to look at this?

Thank you!

Ready for review and QC

The august-2018-testfix branch is ready for review and QC.

PPT missing correct abstract

Regular abstract is listed but WDS abstract is not.

Change ChatMessageSentimentProcessorFunction to use ILogger or Tracewriter

The Function code currently only uses Console.WriteLine() for output. This is not helpful at all since it will neither show up in the log stream nor in the AppInsights logging. Instead ILogger (.LogInformation(...)) or at least Tracewriter (.Info(...)) should be used.
In our workshop we had a few instances where participants misconfigured some step and it was hard to impossible to debug the Function in an easy way.
The output that is already foreseen to be printed using Console.WriteLine() is indeed very helpful - if it would shop up somewhere.

Unblock Web Essemblies

Make sure students are running the code from a local drive (not a OneDrive folder) and make sure all files are "unblocked" (Powershell -> gci -r |Unblock-File). This will prevent errors when publishing referring to "loadFromRemoteSources".

WDS - student & trainer guide

Information doesn't match.
Student guide has no SMS messaging - trainer guide has SMS messaging with 2 questions answered.
Student guide does not have Q&A Bot sections - trainer guide answers 1 question
Student guide has 2 questions in Visualization and reporting section - trainer guide answers 3 questions.
Student guide - Infographic of common scenarios & header images aren't showing up

**Maybe the student guide didn't get updated but the trainer guide did. Student section of the trainer guide looks like it has what's missing above - but double check me to make sure.

Before Hands-On Lab

Exercise 1, Task 9, step 13 mentions:

Select Authorize. This will authorize the connection to your Power BI account. When prompted in the popup window, enter the account credentials you used to create your Power BI account in the Before the Hands-on Lab exercise. You may have to enter your Username and Password.

https://github.com/microsoft/MCW-Intelligent-analytics/blob/master/Hands-on%20lab/HOL%20step-by-step%20-%20Intelligent%20analytics.md#task-9-create-stream-analytics-job

There is no mention of this on this page:
https://github.com/microsoft/MCW-Intelligent-analytics/blob/master/Hands-on%20lab/Before%20the%20HOL%20-%20Intelligent%20analytics.md

Enhancement Required: Screenshots in the lab guide for provisioning the resources are mismatching with the Azure Portal.

Below are some examples with images for your reference:

1. In Exercise 1, Task 7, While adding Collection in Step 4, Partition key is added as a new field and there is no option for selecting Storage capacity as in the lab guide.
   

2. In Exercise 6, Task 3, After selecting " Service bus-Bus - When a message is received in a queue (auto-complete) "in Step 4, Dialog box open is not same as mentioned in Lab guide. We have to enter a connection name and Service bus namespace or Service bus connection string by selecting manually enter connection information enter for proceeding further to screenshot in lab guide.
   

3. In Exercise 5, Task 2, While publishing the app in Step 10, there is no option to select region and add key as per screenshot in lab guide. Also, when publishing complete, For end point URL, We have to go to Keys and Endpoints under Manage option in menu.
   

Similarly, Need to update the screenshots for Bing Speech API, Stream Analytics Job,Function app.

Not able to use Functions Bot app

In Exercise 9 Task 2 , i am not able to get Functions Bot app from Marketplace

Please check on this and let us know the solution ASAP

Thanks

Images HOL step by step

Several images in the HOL step by step are not showing up at all.

June 2020 Update Suggestions

HOL - unguided - Image may not match alt-text??

Please review this one for me? Line 525 in the unguided lab. I don't think the image showing is correct, it doesn't look like it matches the alt text.

Image:

Alt-text:
The Power BI dashboard has four panes: two Count of Messages panes, an Average Sentiment, and Upset Users. The first Count of Messages pane displays a number (18). The second Count of Messages is a pie chart broken out by username. The Average Sentiment is a donut chart displaying the Average Sentiment (0.58) in the past 24 hours. Upset Users chart is a horizontal bar chart displaying the average of upset users (0.25) in the past 24 hours.](media/image158.png 'Power BI dashboard')

conciergePlusAppSearchApi not created

In Exercise 8 task 3 , task is to Copy the URL value of conciergePlusAppSearchApi, and paste it into the value setting for the chatSearchApiBase key, but as per Lab guide conciergePlusAppSearchApi is never created

powerbi workspace

In exercise7 task 1 , in powerbi user should get steps to create the Myworkspace, or it should be added in prerequisites

WDS - trainer presentation

Slide 6 - Slide lists 4 customer needs, presenter notes list 5, trainer guide lists 6 - these should match

After Slide 16 - there is no slide for SMS messaging in the preferred solution section

Slide 17 - No presenter notes asking the Q&A Bot question that the slide is answering

Slide 20 - No presenter notes with question # 3 of Visualization & reporting that the slide is answering

HOl step-by-step: Image is sideways

Image appears sideways in preview

Line 1405:

1. Next, convert this to a Gauge chart by expanding the Visualizations palette, and selecting the Gauge control

   

January 2020 - content update

This workshop is scheduled for a January 2020 content update. Please review open issues #21 & #26 and provide additional recommended changes for SME review.

Preferred objections handling: PPT

Final question hasn't been answered fully.

Question: Can a real-time, intelligent chat solution be built entirely in Azure?

Current Answer: Yes!

Missing lab file

In hands on lab file app.Config is missing for the ChatMessageSentimentProcess Web Job project for the solution (ConciergePlusSentiment.sln).
It is required as per Ex3: https://github.com/microsoft/MCW-Intelligent-analytics/blob/master/Hands-on%20lab/HOL%20step-by-step%20-%20Intelligent%20analytics.md#exercise-3-configure-the-chat-web-app-settings

Steps 23 and 24 for Linguistic Intelligence is wrong

Step 23 and 24 of the linguistic intelligence is wrong:

"Type a new utterance in the text box.

The screenshot displays the sample value entered into the utterance text box.

Enter the following utterance:

Utterance: bring me toothpaste

Text to select: toothpaste

Entity: RoomService:RoomItem

Repeat this process for the following phrases (text to select is in bold):

Bring me towels | RoomService:RoomItem

Bring me blankets | RoomService:RoomItem

Order a soda | RoomService:FoodItem"

The RoomItem is tied to the Housekeeping entity NOT RoomService

Header image HOL

Header image is not displaying correctly in the HOL

Verify links in HOLs

Folder and document names have been updated. Please check your HOL documents for links that use folder names in their path and make sure they are still valid and working.

Live Chat not working

In exercise 4 Task 3 while testing hotel lobby chat i am getting pop-up as error:undefined.

when i tried accessing website using IIS in visual studio i am not getting popup but i am not getting response in live chat

HOL - step-by-step

Line 623 - There's a link to task 1 in the before the HOL - the link only takes you to the step-by-step beginning

Same with line 641 & 1431

Line 1960 leads to Exercise 1, task 11 not Exercise 4, task 2

GitHub dependency notice

March 2019 - Scheduled content update

@DawnmarieDesJardins Adding this issue to track SME reviews and update progress.

Before the HOL

I've added the TOC from the template, but I can't get the TOC links to work. Please correct formatting.

Re-arrange content for faster start

After having worked through the MCW with a client, one very valid feedback point came back from the participants:
Exercise 1, the provisioning of Azure resources, should be split up so that only those resources are provisioned which are needed for a the very first start of the app. This brings participants much faster to a point where they get a feeling what is actually happening. Many of the resources from Exercise 1 are only needed (much) later:

• All of the cognitive Services
• Azure Search
• Stream Analytics
• CosmosDB
• API App

First step should be to set up the Web App, Function and one Event Hub and the Service Bus topic. Then move to the part to complete the first set of coding steps.
Once messages started to flow through the system, people started to understand much better the role each component was playing.
Overall the workshop was very well received, only the 2-3 hours of clicking through the Azure portal until something was finally start to show up, was perceived as too cumbersome.