… In contrast to other LLM tuning strategies, adapting LLMs with Cappy significantly reduces the high demand for device memory as it avoids the need for back-propagation through LLM parameters for downstream tasks. …
… How LLMs handle graph tasks In this experiment, we tested how well pre-trained LLMs tackle graph problems like identifying connections, cycles, and node degrees. Here is what we learned: LLMs struggle: On most of these basic tasks, LLMs did not do much better than a random guess. …
… Combining with LLMs We further explore combining VideoPrism with LLMs to unlock its ability to handle various video-language tasks. …