How to optimize with furiosa warboy

Furiosa Runtime
1

Jun
Now Thai AI association release OpenThaiGPT 7b, 13b, 70b 1.0.0
For Thail language It is better GPT 3.5, Gemini and Calude 3 Haiku
It is open source and now ready for download for test and development
More information https://OpenThaiGPT.aieat.or.th
Download Model
7b - openthaigpt/openthaigpt-1.0.0-7b-chat · Hugging Face

Please advise how to optimize with furiosa warboy.

Tom

2

Hi, Tom.

Unfotunately, the WARBOY is not able to accelerate GPT models, however the RNGD will accelerate the ones.

I believe Sean already shared pdf file(WARBOY Target model lists) with you, please find it out.

Thanks
Jun