We dive into Phi-2 and some of the major differences and use cases for a small language model (SLM) versus an LLM.
With only 2.7 billion parameters, Phi-2 surpasses the performance of Mistral and Llama-2 models at 7B and 13B parameters on various aggregated benchmarks. Notably, it achieves better performance compared to 25x larger Llama-2-70B model on multi-step reasoning tasks, i.e., coding and math. Furthermore, Phi-2 matches or outperforms the recently-announced Google Gemini Nano 2, despite being smaller in size.
Find the transcript and live recording: https://arize.com/blog/phi-2-model
To learn more about ML observability, join the Arize AI Slack community or get the latest on our LinkedIn and Twitter.
Breaking Down EvalGen: Who Validates the Validators?
Keys To Understanding ReAct: Synergizing Reasoning and Acting in Language Models
Demystifying Chronos: Learning the Language of Time Series
Anthropic Claude 3
Reinforcement Learning in the Era of LLMs
Sora: OpenAI’s Text-to-Video Generation Model
RAG vs Fine-Tuning
HyDE: Precise Zero-Shot Dense Retrieval without Relevance Labels
A Deep Dive Into Generative's Newest Models: Gemini vs Mistral (Mixtral-8x7B)–Part I
How to Prompt LLMs for Text-to-SQL: A Study in Zero-shot, Single-domain, and Cross-domain Settings
The Geometry of Truth: Emergent Linear Structure in LLM Representation of True/False Datasets
Towards Monosemanticity: Decomposing Language Models With Dictionary Learning
RankVicuna: Zero-Shot Listwise Document Reranking with Open-Source Large Language Models
Explaining Grokking Through Circuit Efficiency
Large Content And Behavior Models To Understand, Simulate, And Optimize Content And Behavior
Skeleton of Thought: LLMs Can Do Parallel Decoding
Llama 2: Open Foundation and Fine-Tuned Chat Models
Lost in the Middle: How Language Models Use Long Contexts
Orca: Progressive Learning from Complex Explanation Traces of GPT-4
Create your
podcast in
minutes
It is Free
The Universe Speaks in Numbers
Breaking Math Podcast
Opinionated History of Mathematics
Biostatistics Podcast
SOA Podcasts - Society of Actuaries