L1 Video Homework for LLM Practical Camp Course (InternLM-1.8b)

The video referred to is this BiliBili video.

Great video! I tried to use Google Translate to translate Chinese sound to english , but it wasn't so accurate. I did translate some of the slides to English, though, and what I immediately found was that it's like a LLM ecosystem, with many kinds of models, and what also surprised me were the amazing companies using InternLM every day (just like companies use OpenAI every day!), the robust training techniques, and the HuixiangDou and MindSearch tools, which are extremely novel and interesting. (I used MindSearch myself to answer some questions on how to get more VRAM for GPUs - turns out it's possible, and "overclocking" a GPU exists, but it requires some strange hacks that probably aren't actually great for performance. It was great!)

Finally, what strikes me is the sheer speed of innovation - I think the MindSearch tool was released not 20, 25 days ago, but yet it's in the presentation! "AI time," as people who speak English sometimes refer to as the speed at which innovations happen in this new Machine Learning wave, is much faster than the speed for innovations in the previous waves of technology (microprocessors; the Internet; cloud computing). Pretty awesome!