Using AI

Meta (Llama 2) vs Open AI

On this episode: Llama, AI models, Weights Leakage, Comparison, Usage, Meta vs Open AI, Data management by Meta, Open Source AI, AI research groups, Instruction, fine-tuning, RLHF, Hosting Llama, AWS Bedrock, Azure AI Models, local finetuning, and guardrails, ChatGPT, GPT-4, GPT-3, GPT-3.5 Watch Using AI on YouTube (and see our daft AI-generated background images): https://www.youtube.com/@genieai Links: Llama Access Form (meta.com): ⁠https://ai.meta.com/resources/models-and-libraries/llama-downloads/⁠ Llama 2 on Hugging face: ⁠https://huggingface.co/meta-llama⁠ Llama 2 7B Chat on Hugging Face ⁠https://huggingface.co/spaces/huggingface-projects/llama-2-7b-chat⁠ Meta uses copyright ignored books on AI training: ⁠https://www.reuters.com/technology/meta-used-copyright-ignored-books-ai-training-despite-its-own-lawyers-warnings-authors-2023-12-12/⁠ Meta and IBM's Open Source AI partnership and it's lack of inclusion of OpenAI, Google, Microsoft: ⁠https://www.theguardian.com/technology/2023/dec/05/open-source-ai-meta-ibm⁠ Yann LeCun's social media attack on OpenAI, Google, Microsoft etc.: ⁠https://www.reddit.com/r/technology/s/IumG20ZOKz⁠ Model Weights Leakage: ⁠https://www.theverge.com/2023/3/8/23629362/meta-ai-language-model-llama-leak-online-misuse⁠ “We have no moat” - Google AI researcher: ⁠https://www.semianalysis.com/p/google-we-have-no-moat-and-neither⁠ Restrictions on using Llama: ⁠https://spectrum.ieee.org/open-source-llm-not-open⁠ Welcome to another episode of Using AI. I'm your usual host, Alex Denne, and today, I'm accompanied by Alex Pap and Nitish Mutha (Founder of Legaltech Genie AI). We start by introducing Llama and discuss its weights leaking incident. We also elaborate how Llama compares to other AI models and explain how to use it. The conversation takes a turn towards the Meta vs Open AI dispute, shedding light on their differences and impact in this space. We also discuss Meta's data management and how it can actually come up trumps on both privacy strategy here, and non-copyrighted multi-lingual training data.

Google vs OpenAI

We don't delve too deep into the already covered demo-gate scandal, don't worry! This episode features insights from Senior ML Research Scientist Alex Pap and AI Startup Founder and CTO Nitish Mutha. We discuss: Google vs OpenAI for the long-term. GPT4 Vision, GPT5, Multimodal AI, Gemini Ultra, Gemini Pro, Gemini Nano, OpenAI Whisper, DALL·E 3, Chain of thought, Google, OpenAI, Bard, AI technology, Machine Learning Welcome to Episode 17: and the 3rd episode in our AI Market Leaders mini-series - focusing on Google vs OpenAI. This episode dives into all the details of the release in Gemini’s Ultra, Pro, and Nano (and how that affects Alphacode2, and Bard). We also delve into multi-modal technology and its promise for the future. Watch This Episode of Using AI on youtube⁠⁠https://www.youtube.com/channel/UCHsQu4IipA7Ri2AqKcQZ1Yw⁠⁠ Topics Discussed: GPT4 Vision, GPT5, Multimodal AI Gemini’s announcements and releases Google’s catch up play with OpenAI (and a little bit about what they did wrong!) Additional Resources: Gemini Technical Report in full (PDF): https://storage.googleapis.com/deepmind-media/gemini/gemini_1_report.pdf Reddit post: Testing the Gemini demo video screenshots with GPT-4: https://www.reddit.com/r/ChatGPT/comments/18d9wgn/asked_gpt4_some_logical_questions_from_the_gemini/ GPT4 + Gemini Pro for coding: https://www.reddit.com/r/ChatGPT/comments/18d773r/gpt4_and_gemini_cocreated_code_better_than_gpt4/ AI Explained’s breakdown on Youtube: https://www.youtube.com/watch?v=toShbNUGAyo&ab_channel=AIExplained GPT4 comparison controversy https://twitter.com/kenshin9000_/status/1734238211088506967?s=46 Alex D's Midjourney background (Godzilla walking through a town in the style of 'The Starry Night Painting by Vincent van Gogh: https://www.reddit.com/r/midjourney/comments/18gt00b/exactly_what_i_expected_and_more_amazing/ Running an LLM on your Pixel 8 Pro: https://store.google.com/intl/en/ideas/articles/pixel-feature-drop-december-2023/ Deep dive into AlphaCode 2 on TechCrunch: ⁠https://tcrn.ch/46G5u8w⁠

OpenAI vs Anthropic

Alex and Alex discuss the use cases for OpenAI tools such as GPT-4, compared to Anthropic's Claude 2. We also offer some sneaky insights on Anthropic and their roadmap. Topics discussed: AI Startup Competition, Anthropic reportedly working on 1 million context window, ensemble LLMs, cohere, london, san francisco, Dario Amodei, Hallucination, Refusing to answer, API Tooling, Claude 1, Claude 2, Sam Altman Kebab challenge images on reddit: https://www.reddit.com/r/midjourney/comments/183hv0m/the_forgotten_kebab_challenge_1979/ Using AI on youtube - see what Alex Pap was laughing so hard at at the start of this episode https://www.youtube.com/@genieai/podcasts Links: Claude 2.1: 200K context, 2x decrease in hallucination rates, API Tool use, system prompts, cheaper prices: https://www.anthropic.com/index/claude-2-1 Anthropic will use AWS, Amazon to invest $4B https://www.aboutamazon.com/news/company-news/amazon-aws-anthropic-ai Google to invest $2B https://news.crunchbase.com/ai/google-anthropic-openai-funding-wars/

Happy ChatGPT Anniversary! Who is Open AI's Competition?

It's been a year since ChatGPT was released (yeah, feels longer than that doesn't it?). We’re going to look through it’s achievements, and then run a few episodes taking a closer look at the competition hot on OpenAI's heels So this will be the first in a short 5-part mini series where we’re talking about the alternatives to Open AI - given the Fiasco which has dominated headlines for the past 3 weeks - details of which are still emerging. Some stats on ChatGPT from the past 12 months ChatGPT was an overnight success, attracting one million users in the first five days of its launch, according to Sam Altman. Today, the chatbot has more than 100 million users. OpenAI’s website is visited more than 1.5 billion times every month, according to SimilarWeb data as of September. Nearly half of Americans have heard about ChatGPT, according to a recent poll by YouGov. In February 2023, OpenAI released ChatGPT Plus at $20 per month. Plus users can access GPT-4, while the free version of ChatGPT is powered by GPT-3.5. OpenAI is valued by private investors at up to $90 billion. That’s nearly 35 times what the company was worth two years ago. OpenAI’s headcount has more than doubled since launching ChatGPT. Currently it employs about 770. Using AI on youtube - see what Alex Pap was laughing so hard at at the start of this episode https://www.youtube.com/@genieai/podcasts Topics discussed: GPT store, Sam Altman, Dario Amodei, Anthropic, Elon Musk, Greg Brockman, Darth Vader, Fired by the board, Open AI CEO Links: timeline of the Open AI Fiasco https://www.axios.com/2023/11/22/openai-microsoft-sam-altman-ceo-chaos-timeline Open AI board tried to hire Anthropic CEO https://arstechnica.com/tech-policy/2023/11/report-openai-tried-and-failed-to-hire-anthropic-ceo-to-replace-sam-altman/

Non-Coder Uses AI Coding Tools / Code-Interpreter

We discuss: AI Coding Tools, Code-Interpreter, Python, Regex, Network errors, Machine Learning, ChatGPT4, HTML Parsing, Github Copilot vs GPT-4 In this episode, we delve into a fascinating experiment where I, Alex Denne, under the watchful guidance of ML Research Scientist Alex Pap, try to get AI to writing some regex that can be run locally on my machine using python, on millions of documents. The goal? To extract matching text from millions of HTML files. It all inadvertently unfolds into an intriguing journey of trial and error. For the no-code listeners, this episode offers first-hand insights into the application and limitations of AI coding tools and code interpreters (and why, for now, you probably still need technical help like Alex D did!) At the outset, we were greeted by a seemingly promising result - a neat CSV file with the right column names but no entries as the AI successfully claimed to extract definitions only to produce an empty result. In an attempt to further probe, the AI was prompted to read the first 100 characters for potential matches. Alas! In lieu of any found matches, it concluded the document must be lengthy and gracefully tapped out. In addition, we had to deal with several network errors that may be attributed to the reported DDoS attacks on OpenAI. After multiple hits and misses, we decided to start afresh with a new approach. We didn't exactly strike gold, but we learned a lot. Through this episode, we touch upon topics like ChatGPT4 and the wonderful feature of 'dragging and dropping' files into GPT-4 Turbo. Watch USING AI on youtube: https://www.youtube.com/channel/UCHsQu4IipA7Ri2AqKcQZ1Yw