Testing Qwen3.8-27b... suddenly?

58.204.***.***
9

Suddenly kimi in opencode? ㅋㅋㅋ

In open-webui, it is listed as qwen though...


{"object":"list","data":[{"id":"qwen3.8-27b","object":"model","created":1787119523,"owned_by":"vllm","root":"Qwen/Qwen3.8-27B","parent":null,"max_model_len":524288,"permission":[{"id":"modelperm-8f041d7ea3598863","object":"model_permission","created":1787119523,"allow_create_engine":false,"allow_sampling":true,"allow_logprobs":true,"allow_search_indices":false,"allow_view":true,"allow_fine_tuning":false,"organization":"*","group":null,"is_blocking":false}]}]}

Running the unquantized original model on an RTX PRO 6000, but

the token generation speed isn't as fast as expected. avg gen throughput around 30 tokens.
I'll have to try applying MTP.

로그인한 회원만 댓글 등록이 가능합니다.

개발한당

KR | ID | EN
  • IDR
  • KOR
7.81 -0.01

2026.08.19 KEB 하나은행 고시회차 701회

다가오는 한인 행사일정

  • 등록 된 일정이 없어요!