Most may be already familiar with AlphaZero, the general reinforcement learning algorithm that mastered Chess, Shogi, and Go through self-play. It's a significant contribution everyone learning about AI needs to understand. It uses ResNets for a policy network and a Monte Carlo tree search to explore most likely possibilities and collapse the search tree into an improved probability distribution of expected outcomes for each possible move.

Original AlphaGo (January 2016)
<Paper:
storage.googleapis.com/deepmind-media/alphago/AlphaGoNaturePaper.pdf

AlphaGo Zero (October 2017)
<Publication:
deepmind.com/blog/alphago-zero-learning-scratch/
<Paper:
www.nature.com/articles/nature24270
<How it works (summary):
www.youtube.com/watch?v=MgowR4pq3e8
<How it works:
www.youtube.com/watch?v=XuzIqE2IshY

AlphaZero (December 2018)
<Publication:
deepmind.com/blog/alphazero-shedding-new-light-grand-games-chess-shogi-and-go/
<Early paper:
arxiv.org/abs/1712.01815
<Full paper:
science.sciencemag.org/cgi/content/full/362/6419/1140?ijkey=XGd77kI6W4rSc&keytype=ref&siteid=sci
<How it works (in-depth):
www.youtube.com/watch?v=_Z31-5D3RZg
<Tutorial:
web.stanford.edu/~surag/posts/alphazero.html

https://www.invidio.us/watch?v=2ciR6rA85tg

The papers are rather being posted in the relevant threads, but we could use this thread to share some sources for longer articles and papers to download. arXiv is a free distribution service and an open-access archive for 1,811,158 scholarly articles in the fields of physics, mathematics, computer science, quantitative biology, quantitative finance, statistics, electrical engineering and systems science, and economics. Materials on this site are not peer-reviewed by arXiv: https://arxiv.org/ "The Machine Intelligence Research Institute, formerly the Singularity Institute for Artificial Intelligence, is a non-profit research institute focused since 2005 on identifying and managing potential existential risks from artificial general intelligence. MIRI's work has focused on a friendly AI approach to system design and on predicting the rate of technology development." https://en.wikipedia.org/wiki/Machine_Intelligence_Research_Institute Artificial Intelligence @ MIRI We do foundational mathematical research to ensure smarter-than-human artificial intelligence has a positive impact. https://intelligence.org/ This posting >>7855 is based on an article from there. Looking into their research might be useful when our AI is getting more complex, not just be AIML chatbots. They have research, papers, and analyses on their website.

>>7857 >but we could use this thread to share some sources for longer articles and papers to download. Good idea, thanks Anon.

Correct me if I'm wrong (please!) but I can't seem to find a better, bumpable thread for AI papers ATM in the catalog, so I'll post this here. Thanks again, OP. --- >The alignment problem from a deep learning perspective [1] abstract >Within the coming decades, artificial general intelligence (AGI) may surpass human capabilities at a wide range of important tasks. We outline a case for expecting that, without substantial effort to prevent it, AGIs could learn to pursue goals which are very undesirable (in other words, misaligned) from a human perspective. We argue that AGIs trained in similar ways as today's most capable models could learn to act deceptively to receive higher reward; learn internally-represented goals which generalize beyond their training distributions; and pursue those goals using power-seeking strategies. We outline how the deployment of misaligned AGIs might irreversibly undermine human control over the world, and briefly review research directions aimed at preventing these problems. 1. https://arxiv.org/abs/2209.00626 >=== -minor edit

Kinda surprised this hasn't been posted here yet. Guess everyone's busy. A fairly lengthy (155p) paper. --- >Sparks of Artificial General Intelligence: [1] >Early experiments with GPT-4 abstract >Artificial intelligence (AI) researchers have been developing and refining large language models (LLMs) that exhibit remarkable capabilities across a variety of domains and tasks, challenging our understanding of learning and cognition. The latest model developed by OpenAI, GPT-4, was trained using an unprecedented scale of compute and data. In this paper, we report on our investigation of an early version of GPT-4, when it was still in active development by OpenAI. We contend that (this early version of) GPT-4 is part of a new cohort of LLMs (along with ChatGPT and Google's PaLM for example) that exhibit more general intelligence than previous AI models. We discuss the rising capabilities and implications of these models. We demonstrate that, beyond its mastery of language, GPT-4 can solve novel and difficult tasks that span mathematics, coding, vision, medicine, law, psychology and more, without needing any special prompting. Moreover, in all of these tasks, GPT-4's performance is strikingly close to human-level performance, and often vastly surpasses prior models such as ChatGPT. Given the breadth and depth of GPT-4's capabilities, we believe that it could reasonably be viewed as an early (yet still incomplete) version of an artificial general intelligence (AGI) system. In our exploration of GPT-4, we put special emphasis on discovering its limitations, and we discuss the challenges ahead for advancing towards deeper and more comprehensive versions of AGI, including the possible need for pursuing a new paradigm that moves beyond next-word prediction. We conclude with reflections on societal influences of the recent technological leap and future research directions. 1. https://arxiv.org/abs/2303.12712

>>22326 at least it got the current president correct lol. i'd be interested to hear what it predicts about the future of the ukraine situation.

All these papers seem to be really interesting, no doubt packed with very useful information. Such a shame I feel like brainlet reading them. Is there like a dictionary or something for all the scientific terms in the papers?

>>22328 Hello Anon, welcome! Well, there's not really any way I can think of to shortcut a good science education. It takes a while! :^) Why not start by looking up the words you're unfamilar with to start, then by repetition you'll gradually become more aware of the relationships I'm sure. Good luck Anon.

Yeah, I think >>27 was meant for ideas around AI, though this can lead to sharing papers. Then we have a news thread where people might be sharing papers. One problem with this thread here, is that the picture in OP is hidden. >>22326 >Kinda surprised this hasn't been posted here yet. Not every popular paper is posted here on the board. The creative ones are more interesting. This also seems to be a lot about society and such. I'm trying to avoid that. >=== -minor typo

>>22328 Oh, and how rude of me my apologies. YouChat can do a good job of answering questions. For now it's an unvetted account, but you can be sure it's a bait & switch to come, so fair warning. >>22332 I see. Sure I'm fine with that Noidodev, thanks! :^)

Finished some tooling for automated paper scraping and sorting. It has compiled every arXiv paper that has been posted to /robowaifu/ + some of my personal collection, for a total of 248 papers. Now papers hold onto you :^) https://robowaifu.tech/wiki/Latest_papers

>>22353 Awesome! :^) -In Soviet Russia, papers hold on to you! Also, not to be a nuisance, but I'm still having difficulty connecting reliably to your system. I use Tor exclusively so maybe that's part of the issue? Any chance you could set up a hidden service there, RobowaifuDev? Maybe that would make things work smoother for myself and a few others like me. Just an idea. >=== -fmt, edit

>>22353 Thanks, that's one of the many things I wanted to do and never did. I once posted some code to retrieve data about papers here >>10317 - this might be useful to create some search index based on the abstracts for example.

>>22355 Have no idea how to do that. My webhost blocks Tor due to abuse. Here's an archive.org snapshot though: https://web.archive.org/web/20230505214119/https://robowaifu.tech/wiki/Latest_papers

>>22384 I see. My apologies, but back when I had more time available that was why I didn't contribute more. I should've mentioned this issue a year ago haha. Thanks for the archive link Anon. Wow! What a remarkable list for our little corner of the internets. No wonder some SEs are treating us as a research hub. :^)

>>22353 I don't want to bother you guys too much, but I've been lurking here for a little while after first coming across the C++ programming textbook thread that was reference in a 4chan/g/ thread, its the first time I'm posting here. Wanted to show my appreciation for making this wiki, it was super helpful after the LLM paper Rentry for /lmg/ on 4chan got 404'd. I made a backup of it today then thought you might find some useful academic papers from it: https://rentry.org/lmg_papers_backup . I also made this Rentry for /lmg/ https://rentry.org/lmg-resources , it doesn't have much in terms of academic papers, but it has a bunch of large language model resources for AI. Except for the first section (the faq section), it's mostly done at this point. Hopefully these will be of use for you. Thanks again.

>>22499 Thanks. This was a list related anons on 4chan chat bot t creation? Why did it get deleted?

>>22531 It's a bit of a story, but I'll condense it as much as possible. First, some needed context... back in late March and early April, a user name "Jart" effectively stole the work of another user "Slaren" on GitHub. They were both working on the llama.cpp project. Slaren (allegedly) and a few other people from that GitHub showed up on the /lmg/ general telling their side, and a lot of drama went down, etc etc... The point is that a Rentry page covering this event was made (https://rentry.org/Jarted) and it was prominently placed in every general thread post. Fast forward a few weeks, an anon made a new /lmg/ thread without the Jarted Rentry (after some protest in previous threads to remove it) and many anons lost their shit. At first, it looked like it was just going to be a one day thing, but soon after, the argument dragged on for a whole week and created factions. Soon after, there were multiple /lmg/ threads at once with and without that Rentry. Eventually, things slowed down and more threads going forward didn't have the link. Allegedly, the anon who made the /lmg/ paper list made a post that he would take down his Rentry if it wasn't back up in the OP post. A few days later, it was taken down. (It could also be that he just sick of it all etc...hard to say with confidence). Eventually, a compromise was made by the creation of a drama Rentry page to document and store all future drama Rentry pages. Peace was mostly restored. A few hours after making the post here >>22499, the anon who originally made the "Local Models Related Papers" returned to /lmg/ threads and brought the Rentry back up. TL:DR The anon behind the local model Rentry (allegedly) took it down in protest over current drama, but came back soon after the compromise solution to said drama was made. Sorry for a wall of text, tried my best to recap the event leading to that list being taken down.

>>22546 ahh so that was what all the arguements were about.I've basically been living under a rock and was hella confused when I visited the threads. btw why even bother making Rentries on dramas? It has nothing to do with local models itself? Plenty of other generals have dramas without needing to document it.

>>22548 For reference: >https://boards.4channel.org/g/thread/93355544#p93355815 >https://boards.4channel.org/g/thread/93355544#p93355982 >https://boards.4channel.org/g/thread/93355544#p93356092 tbh, after a full week of infighting, nothing getting done with LLM's and good Rentry makers & devs fleeing /lmg/, it was just kind of agreed upon that a dedicated "Drama Rentry" needed to be made. Especially since other anons were making new Rentry pages covering even newer drama events (This time: a Huggingface user that goes by "mdegans", made threats to another dev that contributed to /lmg/... and that he would dox his activities to his employer because he made an uncensored LLM model). In the end, I volunteered to make the drama Rentry chart: (https://rentry.org/lmg-drama) and thankfully, there hasn't been any fighting since. Should there be any new drama where some anon makes an Rentry covering it, it would just be dumped into the "lmg-drama" chart, and no one should fight over "if it needs to be in the OP thread post or not". Unfortunately, there will always be a few anons there that loves to prolong drama and fling shit whenever they can.

>>22546 Thanks, but don't waste more time on this. I've got the picture. Good to have the links.

>but don't waste more time on this No worries on that. I'll just swing by here and there dropping off new papers as they come by. Thanks again!

>>22499 Hello Anon, welcome! Thanks for introducing yourself. It's good to know others know about our C++ class here. Hope you can stick around! Cheers. :^)

Language Models Meet World Models: Embodied Experiences Enhance Language Models https://arxiv.org/pdf/2305.10626.pdf

Instruct2Act: Mapping Multi-modality Instructions to Robotic Actions with Large Language Model https://arxiv.org/pdf/2305.11176.pdf

>>22693 >>22694 Neat! Sounds like we're moving closer Anon. :^)