Visual Evaluation with Foundation Models

All

16 repositories

Q-Bench-Video
Public
A benchmark for video quality understanding of LMMs
Python
•1•102•0•0•Updated Feb 6, 2025Feb 6, 2025
A-Bench
Public
[ICLR 2025] What do we expect from LMMs as AIGI evaluators and how do they perform?
evaluation lmm ai-generated-images
3•141•0•0•Updated Feb 3, 2025Feb 3, 2025
Visual-Question-Answering-for-Video-Quality-Assessment
Public
Official released code for VQA² series models
Python
•1•25•5•0•Updated Jan 31, 2025Jan 31, 2025
LMM-PCQA
Public
Official repo for `LMM-PCQA: Assisting Point Cloud Quality Assessment with LMM', ACM MM2024 Oral
Python
•0•16•0•0•Updated Nov 21, 2024Nov 21, 2024
Q-Align-Aria
Public
Visual Scorer with Aria MoE model
Jupyter Notebook
•
Apache License 2.0
•84•2•0•0•Updated Nov 14, 2024Nov 14, 2024
Q-Ground
Public
Official codes for "Q-Ground: Image Quality Grounding with Large Multi-modality Models", ACM MM2024 (Oral)
Other
•0•35•2•0•Updated Oct 25, 2024Oct 25, 2024
R-Bench
Public
Jupyter Notebook
•0•9•0•0•Updated Oct 13, 2024Oct 13, 2024
Co-Instruct
Public
④[ECCV 2024 Oral, Comparison among Multiple Images!] A study on open-ended multi-image quality comparison: a dataset, a model and a benchmark.
image-quality-assessment
Other
•4•74•4•0•Updated Sep 29, 2024Sep 29, 2024
Compare2Score
Public
[Neurips 24 Spotlight] Training in Pairs + Inference on Single Image with Anchors
Python
•
MIT License
•3•32•5•0•Updated Aug 24, 2024Aug 24, 2024
Q-Align
Public
③[ICML2024] [IQA, IAA, VQA] All-in-one Foundation Model for visual scoring. Can efficiently fine-tune to downstream datasets.
aesthetic image-quality-assessment aesthetic-visual-analysis video-quality-assessment aesthetic-assessment
Python
•
Other
•23•353•19•0•Updated Aug 12, 2024Aug 12, 2024
Q-Instruct
Public
②[CVPR 2024] Low-level visual instruction tuning, with a 200K dataset and a model zoo for fine-tuned checkpoints.
image-quality-assessment low-level-vision cvpr2024
Python
•
Other
•10•213•11•0•Updated Aug 12, 2024Aug 12, 2024
Q-Bench
Public
①[ICLR2024 Spotlight] (GPT-4V/Gemini-Pro/Qwen-VL-Plus+16 OS MLLMs) A benchmark for multi-modality LLMs (MLLMs) on low-level vision and visual quality assessment.
quality-assessment iclr image-quality-assessment low-level-vision gpt-4 large-language-models vision-language-dataset visual-large-language-models
Jupyter Notebook
•
Other
•13•251•2•0•Updated Aug 12, 2024Aug 12, 2024
.github
Public
We are an open-source collaborative project to bring new possibilities to IQA!
0•2•0•0•Updated Aug 2, 2024Aug 2, 2024
Q-Refine
Public
[MM 2024 Oral] Refiner for AIGC
Jupyter Notebook
•
Apache License 2.0
•1•26•2•0•Updated Jul 29, 2024Jul 29, 2024
CMC-Bench
Public
Python
•
MIT License
•0•27•0•0•Updated Jun 14, 2024Jun 14, 2024
Chinese-Q-Bench
Public
[WIP@Oct 13] 质衡-基准测试 (Q-Bench in Chinese)，包含中文版【底层视觉问答】和【底层视觉描述】数据集，以及中文提示下的图片质量评价。 We will release Q-Bench in more languages in the future.
1•20•2•1•Updated Jan 7, 2024Jan 7, 2024