azure-samples/azureai-samples

Official community-driven Azure AI Examples

azureai-samples's Issues

Broken links in Assistants API in-a-box README for Sample Assistants

Operating System

Linux

Version Information

Python: 3.11.7

Steps to reproduce

1. Go to /azureai-samples/scenarios/Assistants/assistants-api-in-a-box/notebooks/README.md
2. Scroll to #sample-assistants---jupyter-notebooks section: sample assistants section
3. Click/follow on any of the 4 sample assistants listed

Expected behavior

Links should go to each of the 4 sample assistants mentioned

Actual behavior

File not found for each

Addition information

⬇️ markdown and relative link issue - should repo in any envio. inc. just browsing readme in github.com

There are some examples in the /notebooks folder but they're named differently to the ones in the README. It's not clear which is which, or if these are the same samples referred to in the README

🙏 Thank you for providing these samples and READMEs - this is an exciting new feature and this is a great way to get hands-on. keen to test!😄

No module named 'openai.types.beta.threads.message_content_image_file'

Operating System

Windows

Version Information

1

Steps to reproduce

ModuleNotFoundError: No module named 'openai.types.beta.threads.message_content_image_file'

Expected behavior

1

Actual behavior

1

Addition information

No response

Outdated sample code for Assistant

Operating System

Windows

Version Information

python version: 3.10
openai package version: 1.36.0

Steps to reproduce

I tried to import the requirement libraries

from openai import AzureOpenAI
from openai.types.beta.threads.message_content_image_file import MessageContentImageFile
from openai.types.beta.threads.message_content_text import MessageContentText
from openai.types.beta.threads.messages import MessageFile
from PIL import Image

Expected behavior

No error while excuting

Actual behavior

No module found

Addition information

I try to downgrade the openai library version to 1.11.0, it works, but plz fix it in requirement.txt

Notebook samples do not work

Operating System

Windows

Version Information

Python Version: 3.12

I am following the notebook sample verbatim found HERE. It does not work.

The cell where you prep the assistand with the file_ids throws:
BadRequestError: Error code: 400 - {'error': {'message': 'Files [assistant-abc123] are invalid', 'type': 'invalid_request', 'param': None, 'code': None}}

Steps to reproduce

Just try to run the sample.

Expected behavior

It should be able to answer the questions using process_message

Actual behavior

Fails to create the assistant using the file_ids

Addition information

No response

Sample Assistants - Jupyter notebooks

Operating System

Windows

Version Information

Sample Assistants - Jupyter notebooks that are listed on the Assistants API-in-a-Box readme file are not available ( the links are broken)

Topic Description
Assistant-01: Foundational Concepts Showcases the foundational concepts of Assistants such as Threads, Messages, Runs, Tools, and lifecycle management.
Assistant-02: Helper The aihelper.py file serves as a helper library that extracts repetitive code, such as handling lifetime events. It keeps track of instantiated Assistants, Files, and Threads, and can dispose of them when they are no longer needed. aihelper.py also provides a delegate interface to pass Assistant functions. While it is not mandatory to use aihelper.py in your code, this Assistant and the others depend on it.
Assistant-03: Financial Summary Assistant Using Function calling, this Assistant can summarize a financial news article, extract the ticker symbols from the article, and provide a summary of the article and the latest (simulated) stock prices.
Assistant-04: Portpolio Reporting Assistant Using Assistant tools Code Interpreter and Function calling, this bot can get a CSV portfolio file, calculate the latest portfolio value based on the latest stock prices, point out the best and the worst investment, and email a report to a client.
Prerequisites

Steps to reproduce

go to the Assistants API-in-a-Box readme page

Expected behavior

the sample notebooks should be there by clicking on the links

Actual behavior

the links mentioned above are not avaiable.

Addition information

No response

Notebook samples do not work

Operating System

Windows

Version Information

Operating System
Windows

Version Information
Python Version: 3.12.2

I am following the notebook sample verbatim found HERE. It does not work.

The cell where you prep the assistand with the file_ids throws:
NotFoundError: Error code: 404 - {'error': {'code': '404', 'message': 'Resource not found'}}

Steps to reproduce

Just try to run the sample.

Expected behavior

It should be able to answer the questions using process_message

Actual behavior

Error code: 404 - {'error': {'code': '404', 'message': 'Resource not found'}}

Addition information

No response

ModuleNotFoundError: No module named 'openai.types.beta.threads.message_content_image_file'

Operating System

Windows

Version Information

I ran the code assistant-math_tutor at codespaces. I got the error that ModuleNotFoundError: No module named 'openai.types.beta.threads.message_content_image_file'

Python Version: 3.10

Steps to reproduce

from openai.types.beta.threads.message_content_image_file import MessageContentImageFile
from openai.types.beta.threads.message_content_text import MessageContentText

Expected behavior

no error

Actual behavior

can not load the
from openai.types.beta.threads.message_content_image_file import MessageContentImageFile
from openai.types.beta.threads.message_content_text import MessageContentText

Addition information

No response

Running vision with video sample throws an error

Operating System

Windows

Version Information

While running the sample https://github.com/Azure-Samples/azureai-samples/blob/main/scenarios/GPT-4V/video/video_chatcompletions_example_restapi.ipynb with own video throws an error:
{"choices":[{"messages":[{"delta":{"role":"tool", "content": "{"ErrorMessage":The 'video' enhancement requires a data source of type 'AzureComputerVisionVideoIndex'.,"ErrorCode": 400}"}}]}]}

This is how my payload looks:
payload = {
"model": "gpt-4-vision-preview",
"enhancements": {
"video": {
"enabled": True
}
},
"dataSources": [
{
"type": "AzureComputerVisionVideoIndex",
"parameters": {
"computerVisionBaseUrl": f"{vision_api.get('endpoint')}computervision",
"computerVisionApiKey": vision_api.get("key"),
"indexName": video_index.get("video_index_name"),
"videoUrls": [video_index.get("video_SAS_url")],
},
}
],
"messages": messages,
"max_tokens": 800,
"stream": True
}

Few changes were made to the api_url from this documentation https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/gpt-with-vision?tabs=rest%2Csystem-assigned%2Cresource

Steps to reproduce

Run the above sample with a new video

Expected behavior

suppose to get output like this:
{
"id": "chatcmpl-8V4J2cFo7TWO7rIfs47XuDzTKvbct",
"object": "chat.completion",
"created": 1702415412,
"model": "gpt-4",
"choices":
[
{
"finish_reason":"stop",
"index": 0,
"message":
{
"role": "assistant",
"content": "The advertisement video opens with a blurred background that suggests a serene and aesthetically pleasing environment, possibly a workspace with a nature view. As the video progresses, a series of frames showcase a digital interface with search bars and prompts like "Inspire new ideas," "Research a topic," and "Organize my plans," suggesting features of a software or application designed to assist with productivity and creativity.\n\nThe color palette is soft and varied, featuring pastel blues, pinks, and purples, creating a calm and inviting atmosphere. The backgrounds of some frames are adorned with abstract, organically shaped elements and animations, adding to the sense of innovation and modernity.\n\nMidway through the video, the focus shifts to what appears to be a browser or software interface with the phrase "Screens simulated, subject to change; feature availability and timing may vary," indicating the product is in development and that the visuals are illustrative of its capabilities.\n\nThe use of text prompts continues with "Help me relax," followed by a demonstration of a 'dark mode' feature, providing a glimpse into the software's versatility and user-friendly design.\n\nThe video concludes by revealing the product name, "Copilot," and positioning it as "Your everyday AI companion," implying the use of artificial intelligence to enhance daily tasks. The final frames feature the Microsoft logo, associating the product with the well-known technology company.\n\nIn summary, the advertisement video is for a Microsoft product named "Copilot," which seems to be an AI-powered software tool aimed at improving productivity, creativity, and organization for its users. The video conveys a message of innovation, ease, and support in daily digital interactions through a visually appealing and calming presentation."
}
}
],
"usage":
{
"prompt_tokens": 2068,
"completion_tokens": 341,
"total_tokens": 2409
}
}

Actual behavior

Gets back this
{"choices":[{"messages":[{"delta":{"role":"tool", "content": "{"ErrorMessage":The 'video' enhancement requires a data source of type 'AzureComputerVisionVideoIndex'.,"ErrorCode": 400}"}}]}]}

Addition information

No response

Action required: migrate or opt-out of migration to GitHub inside Microsoft

Migrate non-Open Source or non-External Collaboration repositories to GitHub inside Microsoft

In order to protect and secure Microsoft, private or internal repositories in GitHub for Open Source which are not related to open source projects or require collaboration with 3rd parties (customer, partners, etc.) must be migrated to GitHub inside Microsoft a.k.a GitHub Enterprise Cloud with Enterprise Managed User (GHEC EMU).

Action

✍️ Please RSVP to opt-in or opt-out of the migration to GitHub inside Microsoft.

❗Only users with admin permission in the repository are allowed to respond. Failure to provide a response will result to your repository getting automatically archived.🔒

Instructions

Reply with a comment on this issue containing one of the following optin or optout command options below.

✅ Opt-in to migrate

@gimsvc optin --date <target_migration_date in mm-dd-yyyy format>

Example: @gimsvc optin --date 03-15-2023

OR

❌ Opt-out of migration

@gimsvc optout --reason <staging|collaboration|delete|other>

Example: @gimsvc optout --reason staging

Options:

• staging : This repository will ship as Open Source or go public
• collaboration : Used for external or 3rd party collaboration with customers, partners, suppliers, etc.
• delete : This repository will be deleted because it is no longer needed.
• other : Other reasons not specified

Need more help? 🖐️

• Email [email protected]. ✉️
• Post your questions in GitHub inside Microsoft Team in Microsoft Teams. 🗨️

Broken link for Incorporate multi-modality sample on Azure Ai Studio

Operating System

Windows

Version Information

Broken Link for Sample code for multi-modality in azure ai studio page

Steps to reproduce

1. Visit Azure Ai Studio Page - ai.azure.com
2. Click on Open in GitHub in Incorporate multi-modality section

Expected behavior

Go to a sample Jupyter notebook GPT-4V.ipynb

Actual behavior

The Notebook is not present or the Link is not correctly mapped to the actual sample code

Addition information

Not sure if this needs to be added as a new issue.
Please close this issue if it is not relevant