Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for AWS Bedrock integration #5226

Open
Hama18 opened this issue Jan 28, 2025 · 2 comments
Open

Add support for AWS Bedrock integration #5226

Hama18 opened this issue Jan 28, 2025 · 2 comments
Assignees
Milestone

Comments

@Hama18
Copy link

Hama18 commented Jan 28, 2025

What feature would you like to be added?

  • New Module: Create a new module for AWS Bedrock integration.
  • New Class: Implement a new class .autogen_ext.models.aws.BedrockChatCompletionClient based on the ChatCompletionClient base class.
  • Reference: Please refer to existing extensions such as AzureAIChatCompletionClient for guidance.

Why is this needed?

Benefits:

  • Official support for AWS Bedrock would ensure stability, ease of use, and proper maintenance.
  • It would enhance the functionality of AutogenStudio for users who rely on AWS services.

Additional Information:
I am willing to contribute to the development of this feature. Please provide any guidance or steps on how I might be able to assist in making this feature officially supported.
In my environment, the setting for model_info is not passed from the JSON file, so I confirmed the operation by directly passing the arguments in the source code.

Thank you for your time and consideration.

@ekzhu
Copy link
Collaborator

ekzhu commented Jan 28, 2025

Thank you @Hama18, for start, you can take a look at the CONTRIBUTING.md for how to run tests locally. You can check with us when you are stuck.

For API documentation, it would be good to have at least 1 runnable code block showing a hello world example. Would be good to also show a streaming example.

The two examples from their official doc is great:

https://docs.aws.amazon.com/code-library/latest/ug/python_3_bedrock-runtime_code_examples.html

For dependency, add aws for the boto3 dependency, with a minimal verison bound set to the latest stable release verison.

For unit test, create unit tests following those for the Azure AI client. Also create one that hits the actual endpoint but use pytest.skip to skip it if access was denied. See existing test against OpenAI and Gemini endpoints.

@ekzhu
Copy link
Collaborator

ekzhu commented Jan 29, 2025

It is also possible to use Semantic Kernel client adapter for AWS Bedrock models. See: https://microsoft.github.io/autogen/stable/reference/python/autogen_ext.models.semantic_kernel.html

ekzhu added a commit that referenced this issue Jan 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants