microsoft / azure-analytics-and-ai-engagement Goto Github PK

View Code? Open in Web Editor NEW

127.0 17.0 104.0 3.24 GB

Azure Analytics and AI Engagement

License: Other

PowerShell 4.89% Jupyter Notebook 91.21% TSQL 0.87% Python 0.09% ASL 0.04% HTML 2.74% CSS 0.16%

azure-analytics-and-ai-engagement's Introduction

All • Microsoft Fabric • FSI • Public Finance • Retail • Healthcare • Manufacturing • Media • MIDP • Ignite Lab

Important Links:
• Data & AI Industry DREAM Demos & DREAM PoC Accelerator

Getting Started

DREAM PoC Accelerators (DPoC) are packaged Industry Scenario DREAM Demos with ARM templates (Containing a demo web application, Power BI reports, Synapse resources, AML Notebooks etc.) that can be deployed in a customer’s subscription using the CAPE tool within a matter of few hours. Partners can also deploy DREAM Demos in their own subscriptions using DPoC.

Objective & Intent

With the DPoC solution, partners can also deploy DREAM Demos within their own subscriptions. Partnering with Microsoft sellers, partners can deploy the Iindustry scenario DREAM demos into customer subscriptions. Customers can play, get hands-on experience navigating through the demo environment in their own subscription and demonstrate demo to their own stakeholders.

❗IMPORTANT NOTES:

Prior to proceeding, lease read the license agreement and disclaimer, as your access to and use of the code made available hereunder is subject to the terms and conditions made available therein.
Without limiting the terms of the license , any Partner distribution of the Software (whether directly or indirectly) may only be made through Microsoft’s Customer Acceleration Portal for Engagements (“CAPE”). CAPE is accessible by Microsoft employees. For more information about the CAPE process, please connect with your local Data & AI specialist or CSA/GBB.
• It is important to note that Azure hosting costs are involved when DREAM PoC Accelerators are implemented in customer or partner Azure subscriptions. Microsoft will not cover the costs of DPoC hosting.
• As a DPoC, certain resources are available to the public.Please ensure proper security practices are followed before you add any sensitive data into the environment. To strengthen the environment's security posture, leverage Azure Security Centre.
For any questions or comments please email [email protected].

Disclaimer

This presentation, demonstration, and demonstration model are for informational purposes only and (1) are not subject to SOC 1 and SOC 2 compliance audits, and (2) are not designed, intended or made available as a medical device(s) or as a substitute for professional medical advice, diagnosis, treatment or judgment. Microsoft makes no warranties, express or implied, in this presentation, demonstration, and demonstration model. Nothing in this presentation, demonstration, or demonstration model modifies any of the terms and conditions of Microsoft’s written and signed agreements. This is not an offer and applicable terms and the information provided are subject to revision and may be changed at any time by Microsoft.

This presentation, demonstration, and demonstration model do not give you or your organization any license to any patents, trademarks, copyrights, or other intellectual property covering the subject matter in this presentation, demonstration, and demonstration model.

The information contained in this presentation, demonstration and demonstration model represents the current view of Microsoft on the issues discussed as of the date of presentation and/or demonstration, for the duration of your access to the demonstration model. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information presented after the date of presentation and/or demonstration and for the duration of your access to the demonstration model.

No Microsoft technology, nor any of its component technologies, including the demonstration model, is intended or made available as a substitute for the professional advice, opinion, or judgment of (1) a certified financial services professional, or (2) a certified medical professional. Partners or customers are responsible for ensuring the regulatory compliance of any solution they build using Microsoft technologies.

Copyright

By using this demo/lab, you agree to the following terms:

The technology/functionality described in this demo/lab is provided by Microsoft Corporation for purposes of obtaining your feedback and to provide you with a learning experience. You may only use the demo/lab to evaluate such technology features and functionality and provide feedback to Microsoft. You may not use it for any other purpose. You may not modify, copy, distribute, transmit, display, perform, reproduce, publish, license, create derivative works from, transfer, or sell this demo/lab or any portion thereof.

COPYING OR REPRODUCTION OF THE DEMO/LAB (OR ANY PORTION OF IT) TO ANY OTHER SERVER OR LOCATION FOR FURTHER REPRODUCTION OR REDISTRIBUTION IS EXPRESSLY PROHIBITED.

THIS DEMO/LAB PROVIDES CERTAIN SOFTWARE TECHNOLOGY/PRODUCT FEATURES AND FUNCTIONALITY, INCLUDING POTENTIAL NEW FEATURES AND CONCEPTS, IN A SIMULATED ENVIRONMENT WITHOUT COMPLEX SET-UP OR INSTALLATION FOR THE PURPOSE DESCRIBED ABOVE. THE TECHNOLOGY/CONCEPTS REPRESENTED IN THIS DEMO/LAB MAY NOT REPRESENT FULL FEATURE FUNCTIONALITY AND MAY NOT WORK THE WAY A FINAL VERSION MAY WORK. WE ALSO MAY NOT RELEASE A FINAL VERSION OF SUCH FEATURES OR CONCEPTS. YOUR EXPERIENCE WITH USING SUCH FEATURES AND FUNCITONALITY IN A PHYSICAL ENVIRONMENT MAY ALSO BE DIFFERENT.

FEEDBACK.

If you give feedback about the technology features, functionality and/or concepts described in this demo/lab to Microsoft, you give to Microsoft, without charge, the right to use, share and commercialize your feedback in any way and for any purpose. You also give to third parties, without charge, any patent rights needed for their products, technologies and services to use or interface with any specific parts of a Microsoft software or service that includes the feedback. You may not give feedback that is subject to a license that requires Microsoft to license its software or documentation to third parties because we include your feedback in them. These rights survive this agreement.

MICROSOFT CORPORATION HEREBY DISCLAIMS ALL WARRANTIES AND CONDITIONS WITH REGARD TO THE DEMO/LAB, INCLUDING ALL WARRANTIES AND CONDITIONS OF MERCHANTABILITY, WHETHER EXPRESS, IMPLIED OR STATUTORY, FITNESS FOR A PARTICULAR PURPOSE, TITLE AND NON-INFRINGEMENT. MICROSOFT DOES NOT MAKE ANY ASSURANCES OR REPRESENTATIONS WITH REGARD TO THE ACCURACY OF THE RESULTS, OUTPUT THAT DERIVES FROM USE OF DEMO/ LAB, OR SUITABILITY OF THE INFORMATION CONTAINED IN THE DEMO/LAB FOR ANY PURPOSE.

Contributing

This project welcomes contributions and suggestions. Most contributions require you to agree to a Contributor License Agreement (CLA) declaring that you have the right to, and actually do, grant us the rights to use your contribution. For details, visit https://cla.opensource.microsoft.com.

When you submit a pull request, a CLA bot will automatically determine whether you need to provide a CLA and decorate the PR appropriately (e.g., status check, comment). Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.

This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact [email protected] with any additional questions or comments.

azure-analytics-and-ai-engagement's People

Contributors

Stargazers

Watchers

Forkers

xor-ranavikrant joelhulen taffywrinkle claudiusgonzo priyankamali rrios042 abhishekmishra1783 ronen33 rakeshsharma2441 sumeetchoudhary ajitdharap xorsameer22 kmrshiv kaus1995 amjadmkhan wahalulu praveenksingh7 devopsonazure connectionmaster zeyefkey karthikeyan-git-hub mallik-g daovo leehs-msft adnansharique aasim-syed qpc-database fredgis mbarry-gh xinbinz vipul1306 sanjaydatasciencedojo muhammadsameerhussain rupaligokhale asmadamani lsdace30095 alan-at-microsoft mdjuyel nima31 python-repository-hub aksharjoshi27 kbrustad shyamali11 shakmr95 albarwahab stversch dattachandan click2cloud-ashwin nigeldw-nd click2cloud-rninja click2cloud nagaraj-yadav click2cloud-swapnilshedame click2cloud-anupam click2cloud-lamda nutims syedumairhasan amy-chue isabella232 thedatadojo manjunathdharmatti michellechuang rajatsystems tsystemssingapore geekwolverine cmargraff quisitive ebad371 danialashidiq98 ievsantillan is-solutions parisamousavi vikrambalaaj theoracley dr-alok-tiwari delicpsyche azurewaalebabu beck-tech-cloud swmannepalli vijisoms ivegamsft jacgatorka lukemurraynz bernatrm swiftsolves-msft djkampouris dsghostpos3idon doytsujin dearborn-open-ai numanthugormen allwavemedia antoniosql loc1985 thetrainingboss allgeierschweiz to-thesis-mwucs

azure-analytics-and-ai-engagement's Issues

'Reset' SQL Script is missing in Azure Synapse Workspace

Changes to be made in Before-Starting.md

Hello Team

I request you to please address the following things with respect to "Before-Starting.md" markdown

While creating Power BI Streaming dataset, please mention below point at step 4, not at step 5:“Make sure Historic data analysis is enabled. Select Create to proceed”
Create Resource Group step is not needed for Demo Champs as resource group is already packaged with the lab environment.
While creating Azure Synapse Analytics workspace, in the custom deployment form, password rules and unique suffix rules has to be mentioned clearly else deployment will fail.
At Download artifacts step, while launching cloud shell, entire step to create storage account has to be added in the document. PFB screenshot link screenshot your reference:
Mention storage account name and file share name to be unique names in the above step.
Please remove unnecessary step from Power BI part related to two workspaces.

30 Billion Rows QA

Spektra - Twitter Testing

'Customize All' Pipeline is missing in Synapse

EMailAnalytics CSV Copy Failure

Power BI Linked Services is missing in Synapse Workspace

Since we removed the step of creating new workspace in Power BI, the workspace name is not in our control anymore. So linked service creation for Power BI in synapse workspace is failing.

Azure Functions Deployment Issues

Automation script throwing error for azure functions deployments.

Twitter Disconnected Real-Time Report

Updating ML Product Recommendations Pipeline

HOL-step-by-step: Task 1 Step 10-11

PBI Workspace ID Explanation Missing in Setup Document

PBI Workspace ID input field is expected during ARM deployment. More help and explanation is needed.

Pipelines (Customize Campaign Analytics,Customize Decomposition Tree..etc) are getting failed in Synapse workspace

Error Message 1 : Operation on target Clean Social Analytics failed: ErrorCode=AkvAccessDeniedByCallerNotAuthorized,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Caller was not found on any access policy in this key vault, secretName: SQL-USER-ASAEXP, secretVersion: , vaultBaseUrl: https://asaexpkeyvaultkmrshiv.vault.azure.net/. The error message is: The user, group or application 'appid=eaa407dd-5141-4b77-9d35-1eae315adde9;oid=fefdf081-c176-418f-8ab3-1764a790cd1d;iss=https://sts.windows.net/f94768c8-8714-4abe-8e2d-37a64b18216a/' does not have secrets get permission on key vault 'asaexpkeyvaultkmrshiv;location=westus2'. For help resolving this issue, please see https://go.microsoft.com/fwlink/?linkid=2125287.,Source=Microsoft.DataTransfer.ClientLibrary,'

Error Message 2: "errorCode": "2200", "message": "ErrorCode=SqlOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=A database operation failed. Please search error to get more details.,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Data.SqlClient.SqlException,Message=PdwManagedToNativeInteropException ErrorNumber: 46724, MajorCode: 467, MinorCode: 24, Severity: 20, State: 2, Exception of type 'Microsoft.SqlServer.DataWarehouse.Tds.PdwManagedToNativeInteropException' was thrown.,Source=.Net SqlClient Data Provider,SqlErrorNumber=100000,Class=16,ErrorCode=-2146232060,State=1,Errors=[{Class=16,Number=100000,State=1,Message=PdwManagedToNativeInteropException ErrorNumber: 46724, MajorCode: 467, MinorCode: 24, Severity: 20, State: 2, Exception of type 'Microsoft.SqlServer.DataWarehouse.Tds.PdwManagedToNativeInteropException' was thrown.,},],'", "failureType": "UserError", "target": "Ingest Social Analytics", "details": [] }

Pipelines focused QA #61

Twitter Real-Time Report Failing

Azure Function is working.

Event Hub is in good shape.

ASA output is observed.

Power BI Output in ASA shows no workspace assigned, but...

When listed in Power BI Desktop the dataset shows up in the CDP workspace, with no Owner.

Once the config values and keywords for Azure Functions were filled in with twitter developer account credentials it all started to work. Data was visible on the map in Power BI.

The disconnected path did not work during QA.

Twitter ConsumerKeySecret Value Missing Error

After deployment I tried hitting the endpoint. Got the error below.

I checked the config for the function app, it looks like the values are in there.

Any ideas?

30 Billions Row Loading to be moved to an async background job.

No restriction on unique Suffix

When user enters uniqueSuffix while deploying the ARM template there is no restriction on this field. Since this suffix is appended to the names of all the resources, the template may fail if used enters uniqueSuffix with a special character or a capital letter as storage account names will not accept anything except lower case characters.

AutoML Notebook Bug with the new resource group naming changes

Datapath need to be update in Synapse Notebook '3 Campaign Analytics Data Prep'

Combine Separate ARM Templates

Hi @xor-ranavikrant

Can you merge the twitter ARM template with the primary ARM template? We have to give users a single ARM template to deploy. Otherwise, they will have to go through multiple steps. Please push the changes into the real-time branch.

Thanks

Static Power BI Reports did not get uploaded

Static Power BI reports did not upload to the pre-created workspace during the testing. This part was working before the fix for multiple workspaces was added.

Power BI and Synapse authentication not working with vm identity tokens

Tokens taken from az login --identity return unauthorized for synapse and Power BI api's

PowerBI Dashboard Images to be included as a separate report.

Combine Powershell Scripts

Right now we have two PowerShell scripts the user has to run. Can we combine the two? Any particular reason we keep those separate?

Thanks

Remove Twitter Fields from the ARM template.

Automation QA #60

Hard-coded resourcegroup Name

User will need to use same subscription for sharing the automation with demo personnel, it would be better if we accept the resource group name from user in the script instead of the hardcoded wildcard that we currently have in the core script.( 01-environment-setup.ps1 line number 83)

{
    "error": {
        "code": "ValidationFailed",
        "message": "Workspace request validation failed, check error details for more information",
        "details": [
            {
                "code": "SqlServerRegionDoesNotAllowProvisioning",
                "message": "Location '' is not accepting creation of new Windows Azure SQL Database servers at this time."
            }
        ]
    }
}