"Hmm...don't know really, can't say I have my finger on the pulse of trends that much to be honest. But it seems like there are many models that are good for simple things, and now there's a push to drive down cost for these. Quantization, LORA, PEFT etc are all in this direction."