Article URL: https://github.com/jmaczan/tiny-vllm
Comments URL: https://news.ycombinator.com/item?id=48328184
Points: 5
# Comments: 0
Show HN: Tiny-vLLM – high performance LLM inference engine in C++ and CUDA
1 month ago
7
