YouTube's algorithm kept showing me content about Diffusiongemma, so I checked it out and it said you can get over 1000 tps on an H100 and over 700 on a 5090, so I gave it a try.
I had it answer in Korean, and since it was supposed to reach 234 tps, I was secretly excited.. but it turned out it's still at the testing stage.
Like MTP, it has steps, and the higher they are, the slower it gets, but the results seem to be better.
max_steps=4 / 234.6 tok/s
Korea is a country located on the Korean Peninsula in East Asia, a nation with a long history and a dynamic economic economization tion tion is
. The main features of Korea Korea are as follows.
1. Geography and and: Korea is located located,, throughout the entire Korean Peninsula, three north and and, and,, three, sea three three three three
>> This is for speed. The quality breaks down.
max_steps=12 / 91.1 tok/s
Korea is a country located on the Korean Peninsula in East Asia, and its official name is the Republic of Korea. The main features regarding Korea
are as follows.
1. Geography and Location: Korea Korea is located in the southern part of the Korean Peninsula, and to the north it borders China der
...
2. History: With a long history of half a myriad years, it Goguryeo ryeo, Gojeje, Baekje...
3. Economy: Achieving unprecedentedented economic growth growth called 'the Miracle on the Han River'...
>> There are still many repetitions and errors.
max_steps=24 / 47.4 tok/s
Korea is a country located on the Korean Peninsula in East Asia, a nation where a long history and dynamic modern history coexist. The main features regarding
Korea are as follows.
1. Geography and Politics: The Republic of Korea is the national title, and it is a divided country to the north with North Korea across the armistice line
. The capital is Seoul, which is the center of politics, economy, and culture.
2. History: It developed over a long period of time, starting from the Three Kingdoms period (Goguryeo, Baekje, Silla) and passing through the Goryeo and Joseon periods
. It went through the painful history of Japanese colonial rule and the Korean War, but overcame this and achieved remarkable economic growth and democra
tization.
3. Economy: Through rapid growth called 'the Miracle on the Han River', it has now leaped to become one of the world's top 10 economic powers
...
>> This condition seems to be a practical, usable speed/quality trade-off.
max_steps=48 / 37.8 tok/s
Korea is a country located on the Korean Peninsula in East Asia, a nation where a long history and dynamic modern history are in harmony
. The main features regarding Korea are as follows.
1. Geography and Politics: Korea is located in the southern part of the Korean Peninsula, and to the north it is a divided country bordering North Korea (the Demilitarized Zone)
. The capital is Seoul, the center of politics, economy, and culture.
2. History: From prehistoric times, passing through the Three Kingdoms period of Goguryeo, Baekje, and Silla, it has developed its own unique culture
...
