Research

The page is dedicated to collecting all research that was collected in the past one year from various sources.

This is not an exhaustive list, and any PRs would be welcome

Research Papers

• [2024/06/04] Symbolic reasoning
• [2024/06/04] Transformers and episodic memory
• [2024/03/24] Graph Chain-of-Thought: Augmenting Large Language Models by Reasoning on Graphs
• [2024/03/24] Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention
• [2024/03/24] Compound AI systems
• [2015/07/30] Multilayer Network of Language
• [2023/12/12] Dense X Retrieval: What Retrieval Granularity Should We Use?
• [2024/01/05] Retrieval-Augmented Generation for Large Language Models: A Survey
• [2022/10/20] Cognitive modelling with multilayer networks: Insights, advancements and future challenges
• [2023/09/20] CoAla framework and relevant literature literature
• [2023/06/09] Mind2Web: Towards a Generalist Agent for the Web, Xiang Deng, et al. [code] [demo]
• [2023/06/28] AI Agents in Langchain https://docs.google.com/presentation/d/1L_CHsg26sDxPmKj285Ob5T2xsAUejBlfiGQSnsSHTk0/edit#slide=id.g254e571859c_0_164
• [2023/06/27] Agent infra https://lilianweng.github.io/posts/2023-06-23-agent/
• [2023/06/05] Orca: Progressive Learning from Complex Explanation Traces of GPT-4, Subhabrata Mukherjee et al.
• [2023/05/25] 📚Voyager: An Open-Ended Embodied Agent with Large Language Models, Guanzhi Wang, et al. [code] [website], Shishir G. Patil, et al.
• [2023/05/24] 📚Gorilla: Gorilla: Large Language Model Connected with Massive APIs
• [2023/05/17] 📚Tree of Thoughts: Deliberate Problem Solving with Large Language Models, Shunyu Yao, et al.[code] [code-orig]
• [2023/05/12] 📚MEGABYTE: Predicting Million-byte Sequences with Multiscale Transformers, Lili Yu, et al.
• [2023/05/09] 📚FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performance, Lingjiao Chen, et al.
• [2023/05/01] 📚Learning to Reason and Memorize with Self-Notes, Jack Lanchantin, et al.
• [2023/04/24] 📚WizardLM: Empowering Large Language Models to Follow Complex Instructions, Can Xu, et al.
• [2023/04/22] 📚LLM+P: Empowering Large Language Models with Optimal Planning Proficiency, Bo Liu, et al.
• [2023/04/07] 📚Generative Agents: Interactive Simulacra of Human Behavior, Joon Sung Park, et al. [code]
• [2023/03/30] Self-Refine: Iterative Refinement with Self-Feedback, Aman Madaan, et al.[code]
• [2023/03/30] HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in HuggingFace, Yongliang Shen, et al. [code] [demo]
• [2023/03/20] Reflexion: Language Agents with Verbal Reinforcement Learning, Noah Shinn , et al. [code]
• [2023/02/23] 📚Not what you’ve signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection, Sahar Abdelnab, et al.
• [2023/02/09] 📚Toolformer: Language Models Can Teach Themselves to Use Tools, Timo Schick, et al. [code]
• [2022/12/12] 📚LMQL: Prompting Is Programming: A Query Language for Large Language Models, Luca Beurer-Kellner, et al.
• [2022/10/06] ReAct: Synergizing Reasoning and Acting in Language Models, Shunyu Yao, et al. [code]
• [2022/07/12] 📚Inner Monologue: Embodied Reasoning through Planning with Language Models, Wenlong Huang, et al. [demo]
• [2022/04/04] Do As I Can, Not As I Say: Grounding Language in Robotic Affordances, Michael Ahn, e al. [demo]
• [2021/12/17] WebGPT: Browser-assisted question-answering with human feedback, Reiichiro Nakano, et al.
• [2021/06/17] 📚LoRA: Low-Rank Adaptation of Large Language Models, Edward J. Hu, et al.
• [2023/04/03] Generative Agents
• [2023/05/17] Three of thought: Deliberate Problem Solving with Large Language Models

Knowledge Graphs

• [2023/06/09] Taxonomies: Overview

Blog Articles

• [2023/04/29] AUTO-GPT: UNLEASHING THE POWER OF AUTONOMOUS AI AGENTS By Akash Takyar
• [2023/04/20] Conscious Machines: Experiments, Theory, and Implementations(Chinese) By Jiang Zhang
• [2023/04/18] Autonomous Agents & Agent Simulations By Langchain
• [2023/04/16] 4 Autonomous AI Agents you need to know By Sophia Yang
• [2023/03/31] ChatGPT that learns to use tools By Haojie Pan

Talks

• [2023/06/05] Two Paths to Intelligence by Geoffrey Hinton
• [2023/05/24] State of GPT by Andrej Karpathy | OpenAI
• [2024/03/15] Podcast on AI, Memory by Bill Gurley