Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature Request]: PY, JS, C#: Expanded File & Image Attachment Support #2221

Open
realAnth0ny opened this issue Dec 7, 2024 · 9 comments
Open
Labels
enhancement New feature or request JS & dotnet & Python Change or fix must apply to all three programming languages

Comments

@realAnth0ny
Copy link

realAnth0ny commented Dec 7, 2024

Scenario

User uploads a PDF, DocX, PNG, JPEG with or without text as an attachment. Bot does not recognize an attachment has been uploaded and asks the user to attach a file.

Solution

Provide a way to pass attachments through the planner so when a user uploads an attachment, the bot can “see” it and perform actions or answer questions in context.

[edit by corinagum]
Expand TeamsAttachmendDownloader to include other file types and support drag & drop and the upload button for all languages.

Additional Context

No response

@realAnth0ny realAnth0ny added the enhancement New feature or request label Dec 7, 2024
@Meghana-MSFT
Copy link

@realAnth0ny - Could you please share more details on this ask. Is this an issue with a bot that uses AI library. Could you please share repro steps/video and code used.

@realAnth0ny
Copy link
Author

This is using the Python Teams AI Assistant Preview toolkit with an OpenAI assistant. Basic template, launch in Teams, add pdf as attachment. Attachment uploads in Teams, but the bot does not "see" it.

@corinagum
Copy link
Collaborator

@realAnth0ny Are you using the TeamsAttachmentDownloader?

@realAnth0ny
Copy link
Author

No I am not. This is specifically to upload PNG, JPeg, PDF, and DocX to the Teams AI assistant.

If you attach a pdf in the chat while using the Teams AI Assistant Preview with OpenAI API, it will upload, but it's not passing to the OpenAI api.

@corinagum
Copy link
Collaborator

What is the Teams AI Assistant? Is this something you're running from our repo's samples or from somewhere else?

@realAnth0ny
Copy link
Author

Python Sample 06 Assistant Math bot

@corinagum
Copy link
Collaborator

Ok, I'm leaving this feature request open because it's a totally valid request. However, TeamsAttachmentDownloader is a way to set up the bot to receive the attachment for images. To use it you can copy-paste the image into the chatbox and send. Please take a look at the JS cardgazer sample to see how to implement it.

The work item for this feature request would be to expand TAD to accept other file types and facilitate other ways of adding attachments (drag and drop and pressing the upload button)

@corinagum corinagum changed the title [Feature Request]: PY File & Image Attachment Support [Feature Request]: PY, JS, C#: Expanded File & Image Attachment Support Dec 9, 2024
@corinagum corinagum added the JS & dotnet & Python Change or fix must apply to all three programming languages label Dec 9, 2024
@realAnth0ny
Copy link
Author

Thank you very much, I appreciate it. I'll take a look at this.

@Benjiiim
Copy link
Contributor

Isn't it a duplicate of #1202?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request JS & dotnet & Python Change or fix must apply to all three programming languages
Projects
None yet
Development

No branches or pull requests

4 participants