Change the repository type filter
All
Repositories list
20 repositories
grps_trtllm
PublicHigher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+Tokenizers.cpp, supporting chat and function call, AI agents, distributed multi-GPU inference, multimodal capabilities, and a Gradio chat interface.grps
PublicDeep Learning Deployment Framework: Supports tf/torch/trt/trtllm/vllm and other NN frameworks. Support dynamic batching, and streaming modes. It is dual-language compatible with Python and C++, offering scalability, extensibility, and high performance. It helps users quickly deploy models and provide services through HTTP/RPC interfaces.HGCDR
PublicFPARec
PublicControlTalk
Publicgrps_examples
Publicnn-infer-opt
Publiceasy-ngo
Publiceasy-ngo-website
Publiceasy-ngo-doc
Public archiveCSCE-Net
Publiceasy-ngo-examples
Publiceasy-ngo-layout
Publiceasy-ngo-tools
Publicngo
Public archivengo-demo
Public archivenetease-media.github.io
PublicPAMM-HiA-T5
Public