shigure_ui
shigureui
AI & ML interests
None yet
Organizations
None yet
Spot not working
4
#1 opened 3 months ago
by
shigureui
Benchmark: locateanything-batch(MTP) vs the llama.cpp & vLLM AR ports
🚀 3
2
#14 opened 3 months ago
by
Liuwang971
A working example of how to use this model with vLLM
😎🚀 2
#13 opened 3 months ago
by
shigureui
Inference support for vLLM and SGLang OpenAI endpoints
➕ 14
10
#3 opened 3 months ago
by
Vishva007
Usage Example HERE!!!!
👍 2
1
#1 opened about 1 year ago
by
shigureui
Game-changer for 4x24GB setups! AWQ request
👍 3
3
#1 opened about 1 year ago
by
hyunw55
佬可以指路一下猫箱的RP数据是哪个数据集吗?
5
#1 opened almost 2 years ago
by
Limour
Add support for flash-attention2
2
#3 opened about 3 years ago
by
shigureui
Add support for flash-attention2
2
#3 opened about 3 years ago
by
shigureui