LMFlow Updates! 23 Apr 2023

Hey everyone, happy weekend! Our toolbox for finetuning large machine learning models LMFlow has some amazing updates we wanna share with you:

1. Model inference now supports streaming output and is live on http://lmflow.com/ and run_chatbot.sh. Let us know if you’ve tried it out yet.
2. Support ChatGLM inference.
3. We’ve updated the Robin-7B model based on LLaMA-7B training, which has supercharged the dialogue capabilities. The best part? It’s open-sourced and ready for you to try out on http://lmflow.com.
4. We took it to the next level with two commercially viable models: Parakeets-2.7B (based on GPT-NEO-2.7B) and Cokatoo-7B (based on StableLM-7B). Although slightly less powerful than Robin-7B, they’re powerful enough to handle most real-life scenarios. More evaluation results will be coming your way in the next two days, and we’re constantly working to boost the performance of commercially viable models.
5. You can download all the models here: https://github.com/OptimalScale/LMFlow#model-zoo. Give them a go and see what they can do!