Post
1591
Remember when
@Microsoft
released Phi-3 models... 🤔
Yup, the ones that had 🦙Llama 3 8B beat on MMLU using 3.8B parameters! 🏆
Now they are on the LMSYS Chatbot Arena Leaderboard! 📊📈
Medium(14B) ranks near GPT-3.5-Turbo-0613, but behind Llama 3 8B. 📉
Phi-3 Small(7B) is close to Llama-2-70B, and Mistral fine-tunes. 📊
What about the Phi-3 Mini(3.8B), that was giving Llama 3 8B a run for its money on MMLU? It gets an arena score of 1037 (#73) against 1153 (#22) of Llama 3 8B 🤼
Looks like there is a struggle here between perplexity and inherent knowledge! 🤔
And Microsoft picked knowledge with high perplexity 🧠
Now I am even more intrigued: what is @Meta feeding its 🦙 Llamas?🌾
🏆 Leaderboard: https://chat.lmsys.org/?leaderboard
Yup, the ones that had 🦙Llama 3 8B beat on MMLU using 3.8B parameters! 🏆
Now they are on the LMSYS Chatbot Arena Leaderboard! 📊📈
Medium(14B) ranks near GPT-3.5-Turbo-0613, but behind Llama 3 8B. 📉
Phi-3 Small(7B) is close to Llama-2-70B, and Mistral fine-tunes. 📊
What about the Phi-3 Mini(3.8B), that was giving Llama 3 8B a run for its money on MMLU? It gets an arena score of 1037 (#73) against 1153 (#22) of Llama 3 8B 🤼
Looks like there is a struggle here between perplexity and inherent knowledge! 🤔
And Microsoft picked knowledge with high perplexity 🧠
Now I am even more intrigued: what is @Meta feeding its 🦙 Llamas?🌾
🏆 Leaderboard: https://chat.lmsys.org/?leaderboard