[ad_1]
Teresa Berndtsson / Higher Photos of AI / Letter Phrase Textual content Taxonomy / Licenced by CC-BY 4.0.
We’ve collected among the articles, opinion items, movies and sources regarding massive language fashions (LLMs). A few of these hyperlinks additionally cowl different generative fashions. We’ll periodically replace this record so as to add any additional sources of curiosity. This text represents the third within the sequence. (The earlier variations are right here: v1 | v2.)
What LLMs are and the way they work
- What are Generative AI fashions?, Kate Soule, video from IBM Expertise.
- Introduction to Massive Language Fashions, John Ewald, video from Google Cloud Tech.
- What’s GPT-4 and the way does it differ from ChatGPT?, Alex Hern, The Guardian.
- What Is ChatGPT Doing … and Why Does It Work?, Stephen Wolfram.
- Understanding Massive Language Fashions — A Transformative Studying Listing, Sebastian Raschka.
- How ChatGPT is Skilled, video by Ari Seff.
- ChatGPT – what’s it? How does it work? Ought to we be excited? Or scared?, Deep Dhillon, The Radical AI podcast.
- Every little thing it’s good to find out about ChatGPT, Joanna Dungate, Turing Institute Weblog.
- Turing video lecture sequence on basis fashions: Session 1 | Session 2 | Session 3 | Session 4.
- Bard: What’s Google’s Bard and the way is it completely different to ChatGPT?, BBC.
- Bard FAQs, Google.
- Massive Language Fashions from scratch | Massive Language Fashions: Half 2, movies from Graphics in 5 minutes.
- What are Massive Language Fashions (LLMs)?, video from Google for Builders.
- Dangers of Massive Language Fashions (LLM), Phaedra Boinodiris, video from IBM Expertise.
- How ChatGPT and Different LLMs Work—and The place They May Go Subsequent, David Nield, Wired.
- What are Massive Language Fashions, Machine Studying Mastery.
- How To Delete Your Knowledge From ChatGPT, Matt Burgess, Wired.
- 5 Methods ChatGPT Can Enhance, Not Exchange, Your Writing, David Nield, Wired.
- AI immediate engineering: find out how to not ask a chatbot a foolish query, Callum Bains, The Guardian.
Journal, convention, arXiv, and different articles
- Scientists’ Views on the Potential for Generative AI of their Fields, Meredith Ringel Morris, arXiv.
- LaMDA: Language Fashions for Dialog Purposes, Romal Thoppilan et al, arXiv.
- What Language Mannequin to Prepare if You Have One Million GPU Hours?, Teven Le Scao et al, arXiv.
- Alpaca: A Robust, Replicable Instruction-Following Mannequin, Rohan Taori et al.
- Course of for Adapting Language Fashions to Society (PALMS) with Values-Focused Datasets, Irene Solaiman, Christy Dennison, NeurIPS 2021.
- On the Risks of Stochastic Parrots: Can Language Fashions Be Too Large? , Emily Bender, Timnit Gebru, Angelina McMillan-Main, Shmargaret Shmitchell, FAccT 2021.
- A Survey of Massive Language Fashions, Wayne Xin Zhao et al, arXiv.
- A Watermark for Massive Language Fashions, John Kirchenbauer, Jonas Geiping, Yuxin Wen, Jonathan Katz, Ian Miers, Tom Goldstein, arXiv.
- Between Subjectivity and Imposition: Energy Dynamics in Knowledge Annotation for Pc Imaginative and prescient, Milagros Miceli, Martin Schuessler, Tianling Yang, Proceedings of the ACM on Human-Pc Interplay.
- AI classifier for indicating AI-written textual content, OpenAI.
- Pythia: A Suite for Analyzing Massive Language Fashions Throughout Coaching and Scaling, Stella Biderman et al, arXiv.
- GPT-4 Technical Report, OpenAI, arXiv.
- GPT-4 System Card, OpenAI.
- BloombergGPT: A Massive Language Mannequin for Finance, Shijie Wu et al, arXiv.
- Evading Watermark based mostly Detection of AI-Generated Content material, Zhengyuan Jiang, Jinghuai Zhang, Neil Zhenqiang Gong, arXiv.
- PaLM 2 Technical Report, Google.
- Massive language fashions (LLM) and ChatGPT: what’s going to the affect on nuclear medication be?, Ian L. Alberts, Lorenzo Mercolli, Thomas Pyka, George Prenosil, Kuangyu Shi, Axel Rominger, and Ali Afshar-Oromieh, Eur J Nucl Med Mol Imaging.
- Ethics of huge language fashions in medication and medical analysis, Hanzhou Li, John T Moon, Saptarshi Purkayastha, Leo Anthony Celi, Hari Trivedi and Judy W Gichoya, The Lancet.
- Science within the age of huge language fashions, Abeba Birhane, Atoosa Kasirzadeh, David Leslie & Sandra Wachter, Nature.
- Standardizing chemical compounds with language fashions, Miruna T Cretu, Alessandra Toniato, Amol Thakkar, Amin A Debabeche, Teodoro Laino and Alain C Vaucher, Machine Studying: Science and Expertise.
- The way to preserve textual content non-public? A scientific assessment of deep studying strategies for privacy-preserving pure language processing, Samuel Sousa & Roman Kern, Synthetic Intelligence Evaluation.
- Materials transformers: deep studying language fashions for generative supplies design, Nihang Fu, Lai Wei, Yuqi Tune, Qinyang Li, Rui Xin, Sadman Sadeed Omee, Rongzhi Dong, Edirisuriya M Dilanga Siriwardane and Jianjun Hu, Machine Studying: Science and Expertise.
- Massive language fashions encode scientific information, Karan Singhal et al, Nature.
- SELFormer: molecular illustration studying through SELFIES language fashions, Atakan Yüksel, Erva Ulusoy, Atabey Ünlü and Tunca Doğan, Machine Studying: Science and Expertise.
- GPT-4 + Steady-Diffusion = ?: Enhancing Immediate Understanding of Textual content-to-Picture Diffusion Fashions with Massive Language Fashions, Lengthy Lian, Boyi Li, Adam Yala, and Trevor Darrell, BAIR weblog.
Newspaper, journal, College web site, and blogpost articles
- Why exams meant for people won’t be good benchmarks for LLMs like GPT-4, Ben Dickson, Enterprise Beat.
- Does GPT-4 Actually Perceive What We’re Saying?, David Krakauer, Nautilus.
- Massive language fashions are biased. Can logic assist save them?, Rachel Gordon, MIT Information.
- Ecosystems graph for ML fashions and their relationships, researchers at Stanford College.
- ChatGPT struggles with Wordle puzzles, which says rather a lot about the way it works, Michael G. Madden, The Dialog.
- AIhub espresso nook: Massive language fashions for scientific writing, AIhub.
- ChatGPT Is a Blurry JPEG of the Net, Ted Chiang, The New Yorker.
- ChatGPT, Galactica, and the Progress Entice, Abeba Birhane and Deborah Raji, Wired.
- ChatGPT can’t misinform you, however you continue to shouldn’t belief it, Mackenzie Graham, The Dialog.
- AI data retrieval: A search engine researcher explains the promise and peril of letting ChatGPT and its cousins search the net for you, Chirag Shah, The Dialog.
- A small step for analysis however a large leap for utility, Interview with Fredrik Heintz, Linköping College.
- ChatGPT threatens language range. Extra must be achieved to guard our variations within the age of AI, Collin Bjork, The Dialog.
- Column: Afraid of AI? The startups promoting it need you to be, Brian Service provider, Los Angeles Occasions.
- 3 ways AI chatbots are a safety catastrophe, Melissa Heikkilä, MIT Tech Evaluation.
- Time: OpenAI Used Kenyan Employees on Much less Than $2 Per Hour to Make ChatGPT Much less Poisonous, Billy Perrigo, TIME.
- Misplaced fears of an ‘evil’ ChatGPT obscure the true hurt being achieved, John Naughton, The Guardian.
- Darktrace warns of rise in AI-enhanced scams since ChatGPT launch, Mark Sweney, The Guardian.
- Lawmakers wrestle to distinguish AI and human emails, Kate Blackwood, Cornell Chronicle.
- Colombian choose says he used ChatGPT in ruling, Luke Taylor, The Guardian.
- Bhashini: At your service an Indian language chatbot powered by ChatGPT, video from The Financial Occasions.
- ChatGPT & Co.: Conversational skills of huge language fashions, Marisa Tschopp, Luca Gafner, Teresa Windlin, Yelin Zhang, SCIP.
- AI machines aren’t ‘hallucinating’. However their makers are, Naomi Klein, The Guardian
- Google launches new AI PaLM 2 in try to regain management of the pack, Alex Hern, The Guardian.
- Executives concern unintentional sharing of company knowledge with ChatGPT: Report, Victor Dey, Enterprise Beat.
- Letter from the editor: How generative AI is shaping the way forward for journalism and our newsroom, Michael Nuñez, Enterprise Beat.
- The within story of how ChatGPT was constructed from the individuals who made it, Will Douglas Heaven, MIT Tech Evaluation.
- A chatbot that asks questions may enable you to spot when it is unnecessary, Melissa Heikkilä, MIT Tech Evaluation.
- Constructing LLM functions for manufacturing, Chip Huyen.
- Generative AI Received’t Revolutionize Search — But, Ege Gurdeniz and Kartik Hosanagar, Harvard Enterprise Evaluation.
- If AI picture turbines are so good, why do they wrestle to write down and rely?, Seyedali Mirjalili, The Dialog.
- ‘It’s destroyed me utterly’: Kenyan moderators decry toll of coaching of AI fashions, Niamh Rowe, The Guardian.
- OpenAI launches net crawling GPTBot, sparking blocking effort by web site homeowners and creators, Bryson Masse, Enterprise Beat
- Why it’s inconceivable to construct an unbiased AI language mannequin, Melissa Heikkilä, MIT Expertise Evaluation.
- The way to Use Generative AI Instruments Whereas Nonetheless Defending Your Privateness, David Nield, Wired.
- Don’t stop your day job: Generative AI and the top of programming, Mike Loukides, Enterprise Beat.
- OpenAI provides ‘enormous set’ of ChatGPT updates, together with advised prompts, a number of file uploads, Carl Franzen, Enterprise Beat.
- Ageism, sexism, classism and extra: 7 examples of bias in AI-generated pictures, T.J. Thomson and Ryan J. Thomas, The Dialog.
- ‘Open’ options to ChatGPT are on the rise, however how open is AI actually?, Radboud College.
- Visible captions: Utilizing massive language fashions to reinforce video conferences with dynamic visuals, Ruofei Du and Alex Olwal, Google.
- Why watermarking AI-generated content material received’t assure belief on-line, Claire Leibowiczarchive web page, MIT Expertise Evaluation.
Experiences
- ChatGPT And Extra: Massive Scale AI Fashions Entrench Large Tech Energy, a part of AI Now Institute report.
Podcasts and video discussions
- The Limitations of ChatGPT with Emily M. Bender and Casey Fiesler, Radical AI Podcast.
- CLAIRE AQuA: “ChatGPT and Massive Language Fashions”, CLAIRE.
- Su Lin Blodgett on Creating Simply Language Applied sciences, The Good Robotic Podcast.
- The TWIML AI Podcast with Sam Charrington has numerous episodes on the subject of LLMs and generative AI.
Give attention to LLMs and schooling
- Opinion: ChatGPT – what does it imply for tutorial integrity?, Giselle Byrnes, Massey College.
- Debate: ChatGPT presents unseen alternatives to sharpen college students’ vital abilities, Erika Darics, Lotte van Poppel, The Dialog.
- ChatGPT and dishonest: 5 methods to vary how college students are graded, Louis Volante, Christopher DeLuca, Don A. Klinger, The Dialog.
- ChatGPT: college students may use AI to cheat, but it surely’s an opportunity to rethink evaluation altogether, Sam Illingworth, The Dialog.
- A Trainer’s Immediate Information to ChatGPT, @herfteducator.
- Ought to educators fear about ChatGPT?, interview with Jodi Heckel, Illinois College.
- Massive language fashions problem the way forward for greater schooling, Silvia Milano, Joshua A. McGrane & Sabina Leonelli, Nature.
- ChatGPT, (We have to discuss), Q&A with Vaughan Connolly and Steve Watson, College of Cambridge.
- Don’t fret about college students utilizing ChatGPT to cheat – AI is a much bigger risk to instructional equality, Collin Bjork, The Dialog.
- Massive Language Fashions in Medical Training: Alternatives, Challenges, and Future Instructions, Alaa Abd-alrazaq, Rawan AlSaad, Dari Alhuwail, Arfan Ahmed, Padraig Mark Healy, Syed Latifi, Sarah Aziz, Rafat Damseh, Sadam Alabed Alrazak, and Javaid Sheikh, JMIR Medical Training.
- Massive Language Fashions and Training, Maastricht College.
Referring to artwork and different inventive processes
- ‘ChatGPT mentioned I didn’t exist’: how artists and writers are preventing again towards AI, Vanessa Thorpe, The Guardian.
- AI and the way forward for work: 5 consultants on what ChatGPT, DALL-E and different AI instruments imply for artists and information employees, Lynne Parker, Casey Greene, Daniel Acuña, Kentaro Toyama Mark Finlayson, The Dialog.
- Is there a approach to pay content material creators whose work is used to coach AI? Sure, but it surely’s not foolproof, Brendan Paul Murphy, The Dialog.
- ChatGPT is the push greater schooling must rethink evaluation, Sioux McKenna, Dan Dixon, Daniel Oppenheimer, Margaret Blackie, Sam Illingworth, The Dialog.
- AI Artwork: How artists are utilizing and confronting machine studying, YouTube video from the Museum of Fashionable Artwork.
- ‘We bought bored ready for Oasis to re-form’: AIsis, the band fronted by an AI Liam Gallagher, Wealthy Pelley, The Guardian.
- Photographer admits prize-winning picture was AI-generated, Jamie Grierson, The Guardian.
- The folly of creating artwork with text-to-image generative AI, Ahmed Elgammal, The Dialog.
- Pc-written scripts and deepfake actors: what’s on the coronary heart of the Hollywood strikes towards generative AI, Jasmin Pfefferkorn, The Dialog.
- Actors are actually nervous about the usage of AI by film studios – they could have some extent, Dominic Lees, The Dialog.
Pertaining to robotics
- ChatGPT for Robotics: Design Ideas and Mannequin Skills, Microsoft.
- Inside Monologue: Embodied Reasoning by way of Planning with Language Fashions, Wenlong Huang et al., arXiv.
- PaLM-E: An embodied multimodal language mannequin, Danny Driess, Google.
- Consciousness, Embodiment, Language Fashions (with Professor Murray Shanahan), YouTube video from Machine Studying Road Speak.
- RoCo: Dialectic Multi-Robotic Collaboration with Massive Language Fashions, Zhao Mandi, Shreeya Jain and Shuran Tune, arXiv.
- Superior LLM robotics, GitHub repository which comprises a healing record of papers utilizing LLMs for Robotics and reinforcement studying.
- How can LLMs remodel the robotic design course of?, Francesco Stella, Cosimo Della Santina and Josie Hughes, Nature.
Misinformation, pretend information and the affect on journalism
- Misinformation Monitor: March 2023, deal with GPT-4, NewsGuard.
- A pretend information frenzy: why ChatGPT could possibly be disastrous for fact in journalism, Emily Bell, The Guardian.
- Defending In opposition to Neural Faux Information, Rowan Zellers et al, arXiv.
- Doctored Sunak image is simply newest in string of political deepfakes, Dan Milmo, The Guardian.
Regulation and coverage
- ‘Political propaganda’: China clamps down on entry to ChatGPT, Helen Davidson, The Guardian.
- Chatbots, deepfakes, and voice clones: AI deception on the market, USA Federal Commerce Fee weblog put up.
- ‘I didn’t give permission’: Do AI’s backers care about knowledge legislation breaches?, Alex Hern and Dan Milmo, The Guardian.
- Italy’s ChatGPT ban attracts EU privateness regulators, Supantha Mukherjee, Elvira Pollina and Rachel Extra, Reuters.
- Coaching massive generative AI fashions based mostly on publicly accessible private knowledge: a GDPR conundrum that the AI act may clear up, Sebastião Barros Vale, The Digital Constitutionalist.
- ChatGPT: what the legislation says about who owns the copyright of AI-generated content material, Sercan Ozcan, Joe Sekhon and Oleksandra Ozcan, The Dialog.
- ChatGPT and lawful bases for coaching AI: a blended method?, Sophie Stalla-Bourdillon and Pablo Trigo Kramcsák, The Digital Constitutionalist.
- How can we think about the generative AIs regulatory scheme? Views from Asia, Kuan-Wei Chen, The Digital Constitutionalist.
[ad_2]