Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

google gemini plugin #456

Open
makerGeek opened this issue Jul 21, 2024 · 6 comments · May be fixed by #777
Open

google gemini plugin #456

makerGeek opened this issue Jul 21, 2024 · 6 comments · May be fixed by #777

Comments

@makerGeek
Copy link

Hi,

I'm trying to build an assistant with google gemini as LLM.
Are there any guidelines, docs or examples to follow on how to build a livekit-gemini plugin ?

Thanks
@keepingitneil
Copy link
Contributor

Hey! We'd love this as a contribution. Check out the openai plugin for reference: https://github.com/livekit/agents/blob/main/livekit-plugins/livekit-plugins-openai/livekit/plugins/openai/llm.py

We also have the minimal plugin: https://github.com/livekit/agents/tree/main/livekit-plugins/livekit-plugins-minimal that shows what is needed for the package

@makerGeek
Copy link
Author

makerGeek commented Jul 28, 2024 via email

@theomonnom
Copy link
Member

Hey, yes, please make a PR. We will be happy to help integrate the function-calling stuff!

@AphinityApp
Copy link

AphinityApp commented Aug 29, 2024 •
edited
Loading

@makerGeek Were you still planning to make a PR for Google LLM plugin?

If not, then I can work on this and open a PR.

@makerGeek
Copy link
Author

Hi
Sorry for the delay.
I can push the code tomorrow and you can have a look and eventually fix any broken parts.
Does that work for you?

@AphinityApp
Copy link

AphinityApp commented Aug 30, 2024 •
edited
Loading

Hi Sorry for the delay. I can push the code tomorrow and you can have a look and eventually fix any broken parts. Does that work for you?

Yes, sure no problem. Looking forward to your PR! Thanks

rsinnet added a commit to rsinnet/agents that referenced this issue Sep 18, 2024
@rsinnet
Add Google Generative AI LLMs
c714884 
Add Google Gemini LLMs via Google API with function calling and
image support.

Fixes: livekit#456
@rsinnet rsinnet linked a pull request Sep 18, 2024 that will close this issue
Open
rsinnet added a commit to rsinnet/agents that referenced this issue Sep 18, 2024
@rsinnet
Add Google Generative AI LLMs
7944612 
Add Google Gemini LLMs via Google API with function calling and
image support.

Fixes: livekit#456
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Add Google Generative AI LLMs rsinnet/agents
4 participants
@keepingitneil @theomonnom @makerGeek @AphinityApp