The Gradient Podcast - Some Changes at The Gradient

Video Description

Hi everyone! If you’re a new subscriber or listener, welcome. If you’re not new, you’ve probably noticed that things have slowed down from us a bit recently. Hugh Zhang (https://substack.com/profile/3550791-hugh-zhang), Andrey Kurenkov (https://substack.com/profile/1498935-andrey-kurenkov) and I sat down to recap some of The Gradient’s history, where we are now, and how things will look going forward. To summarize and give some context: The Gradient has been around for around 6 years now – we began as an online magazine, and began producing our own newsletter and podcast about 4 years ago. With a team of volunteers — we take in a bit of money through Substack that we use for subscriptions to tools we need and try to pay ourselves a bit — we’ve been able to keep this going for quite some time. Our team has less bandwidth than we’d like right now (and I’ll admit that at least some of us are running on fumes…) — we’ll be making a few changes: * Magazine: We’re going to be scaling down our editing work on the magazine. While we won’t be accepting pitches for unwritten drafts for now, if you have a full piece that you’d like to pitch to us, we’ll consider posting it. If you’ve reached out about writing and haven’t heard from us, we’re really sorry. We’ve tried a few different arrangements to manage the pipeline of articles we have, but it’s been difficult to make it work. We still want this to be a place to promote good work and writing from the ML community, so we intend to continue using this Substack for that purpose. If we have more editing bandwidth on our team in the future, we want to continue doing that work. * Newsletter: We’ll aim to continue the newsletter as before, but with a “Best from the Community” section highlighting posts. We’ll have a way for you to send articles you want to be featured, but for now you can reach us at our [email protected]. * Podcast: I’ll be continuing this (at a slower pace), but eventually transition it away from The Gradient given the expanded range. If you’re interested in following, it might be worth subscribing on another player like Apple Podcasts (https://podcasts.apple.com/us/podcast/the-gradient-perspectives-on-ai/id1569777340), Spotify (https://open.spotify.com/show/6onNcSqsP6hEEqmZ6TU2g8), or using the RSS feed (https://api.substack.com/feed/podcast/265424/s/1354.rss). * Sigmoid Social: We’ll keep this alive as long as there’s financial support for it. If you like what we do and/or want to help us out in any way, do reach out to [email protected]. We love hearing from you. Timestamps * (0:00) Intro * (01:55) How The Gradient began * (03:23) Changes and announcements * (10:10) More Gradient history! On our involvement, favorite articles, and some plugs Some of our favorite articles! There are so many, so this is very much a non-exhaustive list: * NLP’s ImageNet moment has arrived (https://thegradient.pub/nlp-imagenet/) * The State of Machine Learning Frameworks in 2019 (https://thegradient.pub/state-of-ml-frameworks-2019-pytorch-dominates-research-tensorflow-dominates-industry/) * Why transformative artificial intelligence is really, really hard to achieve (https://thegradient.pub/why-transformative-artificial-intelligence-is-really-really-hard-to-achieve/) * An Introduction to AI Story Generation (https://thegradient.pub/an-introduction-to-ai-story-generation/) * The Artificiality of Alignment (https://thegradient.pub/the-artificiality-of-alignment/) (I didn’t mention this one in the episode, but it should be here) Places you can find us! Hugh: * Twitter (https://x.com/hughbzhang) * Personal site (https://hughbzhang.com/) * Papers/things mentioned! * A Careful Examination of LLM Performance on Grade School Arithmetic (https://arxiv.org/abs/2405.00332) (GSM1k) * Planning in Natural Language Improves LLM Search for Code Generation (https://arxiv.org/abs/2409.03733) * Humanity’s Last Exam (https://scale.com/blog/humanitys-last-exam) Andrey: * Twitter (https://x.com/andrey_kurenkov) * Personal site (https://www.andreykurenkov.com/) * Last Week in AI Podcast (https://www.lastweekinai.com/) Daniel: * Twitter (https://x.com/spaniel_bashir) * Substack blog (https://thejester.substack.com/) * Personal site (https://db7894.github.io/) (under construction) Get full access to The Gradient at thegradientpub.substack.com/subscribe (https://thegradientpub.substack.com/subscribe?utm_medium=podcast&utm_campaign=CTA_4) Episode link: https://play.headliner.app/episode/24212541?utm_source=youtube (video made with https://www.headliner.app)