Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TO-DO] Build a stackable composable base prompt library #7

Open
Sing-Li opened this issue Mar 8, 2025 · 0 comments
Open

[TO-DO] Build a stackable composable base prompt library #7

Sing-Li opened this issue Mar 8, 2025 · 0 comments

Comments

@Sing-Li
Copy link
Member

Sing-Li commented Mar 8, 2025

This is the first prompt engineering task for this "mostly prompt engineering" project.

Build a library consisting of prompts that reliably does the following tasks when working with llama3.2vision-11b or llama3.3vision-11b:

  • extract or calculate the grand total on a receipt
  • extract the nth row off a receipt
  • based on a set of categories description/sub-prompt - classify which category a particular row belongs to
  • based on a set of categories description/sub-prompt - extract all rows that matches that category
  • based on a set of receipts description/sub-prompt - classify which type a receipt belongs to (Uber, FamilyMart, Didi, Tsco, Khetlaji , Reliance and so on)

The prompts in the library must be designed to be stackable - able to be combined and used one after another - in one single completion call to the LLM.

The prompts in the library must be designed to be composable as much as possible - able to be combined and used in one single call to perform a complex task -- but not necessarily combined in a stacked-linear fashion.

Make sure you have unit tests for every single prompt in the library. reliability should be defined as a 70% pass when 10 diverse receipts are used for the test dataset. (let's use 10 for this - of course you can propose 100 if you like)

Note that there is no limit to the length and complexity of the prompts in the library.

Looking for actual PoC implementation. Welcoming PRs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant