[{"data":1,"prerenderedAt":-1},["ShallowReactive",2],{"project-72082":3},{"id":4,"name":5,"fullName":6,"owner":7,"repo":5,"description":8,"homepage":9,"htmlUrl":9,"language":10,"languages":9,"totalLinesOfCode":9,"stars":11,"forks":12,"watchers":13,"openIssues":14,"contributorsCount":15,"subscribersCount":15,"size":15,"stars1d":16,"stars7d":17,"stars30d":18,"stars90d":15,"forks30d":15,"starsTrendScore":19,"compositeScore":20,"rankGlobal":9,"rankLanguage":9,"license":21,"archived":22,"fork":22,"defaultBranch":23,"hasWiki":24,"hasPages":22,"topics":25,"createdAt":9,"pushedAt":9,"updatedAt":26,"readmeContent":27,"aiSummary":28,"trendingCount":15,"starSnapshotCount":15,"syncStatus":29,"lastSyncTime":30,"discoverSource":31},72082,"AgentLaboratory","SamuelSchmidgall\u002FAgentLaboratory","SamuelSchmidgall","Agent Laboratory is an end-to-end autonomous research workflow meant to assist you as the human researcher toward implementing your research ideas",null,"Python",5679,792,49,38,0,11,25,100,33,107.2,"MIT License",false,"main",true,[],"2026-06-12 04:01:03","# Agent Laboratory: Using LLM Agents as Research Assistants\n\n\n\u003Cp align=\"center\">\n  \u003Cimg src=\"media\u002FAgentLabLogo.png\" alt=\"Demonstration of the flow of AgentClinic\" style=\"width: 99%;\">\n\u003C\u002Fp>\n\n\u003Cp align=\"center\">\n    【English | \u003Ca href=\"readme\u002FREADME-chinese.md\">中文\u003C\u002Fa> | \u003Ca href=\"readme\u002FREADME-japanese.md\">日本語\u003C\u002Fa> | \u003Ca href=\"readme\u002FREADME-korean.md\">한국어\u003C\u002Fa> | \u003Ca href=\"readme\u002FREADME-filipino.md\">Filipino\u003C\u002Fa> | \u003Ca href=\"readme\u002FREADME-french.md\">Français\u003C\u002Fa> | \u003Ca href=\"readme\u002FREADME-slovak.md\">Slovenčina\u003C\u002Fa> | \u003Ca href=\"readme\u002FREADME-portugese.md\">Português\u003C\u002Fa> | \u003Ca href=\"readme\u002FREADME-spanish.md\">Español\u003C\u002Fa> | \u003Ca href=\"readme\u002FREADME-turkish.md\">Türkçe\u003C\u002Fa> | \u003Ca href=\"readme\u002FREADME-hindi.md\">हिंदी\u003C\u002Fa> | \u003Ca href=\"readme\u002FREADME-bengali.md\">বাংলা\u003C\u002Fa> | \u003Ca href=\"readme\u002FREADME-vietnamese.md\">Tiếng Việt\u003C\u002Fa> | \u003Ca href=\"readme\u002FREADME-russian.md\">Русский\u003C\u002Fa> | \u003Ca href=\"readme\u002FREADME-arabic.md\">العربية\u003C\u002Fa> | \u003Ca href=\"readme\u002FREADME-farsi.md\">فارسی\u003C\u002Fa> | \u003Ca href=\"readme\u002FREADME-italian.md\">Italiano\u003C\u002Fa>】\n\u003C\u002Fp>\n\n\u003Cp align=\"center\">\n    【📝 \u003Ca href=\"https:\u002F\u002Farxiv.org\u002Fpdf\u002F2501.04227\">Paper\u003C\u002Fa> | 🌐 \u003Ca href=\"https:\u002F\u002Fagentlaboratory.github.io\u002F\">Website\u003C\u002Fa> | 🌐 \u003Ca href=\"https:\u002F\u002Fagentrxiv.github.io\u002F\">AgentRxiv Website\u003C\u002Fa> | 💻 \u003Ca href=\"https:\u002F\u002Fgithub.com\u002FSamuelSchmidgall\u002FAgentLaboratory\">Software\u003C\u002Fa> | 📰 \u003Ca href=\"https:\u002F\u002Fagentlaboratory.github.io\u002F#citation-ref\">Citation\u003C\u002Fa>】\n\u003C\u002Fp>\n\n### News \n* [March\u002F24\u002F2025] 🎉 🎊 🎉 Now introducing **AgentRxiv**, a framework where autonomous research agents can upload, retrieve, and build on each other’s research. This allows agents to make cumulative progress on their research.\n\n## 📖 Overview\n\n- **Agent Laboratory** is an end-to-end autonomous research workflow meant to assist **you** as the human researcher toward **implementing your research ideas**. Agent Laboratory consists of specialized agents driven by large language models to support you through the entire research workflow—from conducting literature reviews and formulating plans to executing experiments and writing comprehensive reports. \n- This system is not designed to replace your creativity but to complement it, enabling you to focus on ideation and critical thinking while automating repetitive and time-intensive tasks like coding and documentation. By accommodating varying levels of computational resources and human involvement, Agent Laboratory aims to accelerate scientific discovery and optimize your research productivity.\n\u003Cp align=\"center\">\n  \u003Cimg src=\"media\u002FAgentLab.png\" alt=\"Demonstration of the flow of AgentClinic\" style=\"width: 99%;\">\n\u003C\u002Fp>\n\n- Agent Laboratory also supports **AgentRxiv**, a framework where autonomous research agents can upload, retrieve, and build on each other’s research. This allows agents to make cumulative progress on their research.\n\n\u003Cp align=\"center\">\n  \u003Cimg src=\"media\u002Fagentrxiv.png\" alt=\"Demonstration of the flow of AgentClinic\" style=\"width: 99%;\">\n\u003C\u002Fp>\n\n\n### 🔬 How does Agent Laboratory work?\n\n- Agent Laboratory consists of three primary phases that systematically guide the research process: (1) Literature Review, (2) Experimentation, and (3) Report Writing. During each phase, specialized agents driven by LLMs collaborate to accomplish distinct objectives, integrating external tools like arXiv, Hugging Face, Python, and LaTeX to optimize outcomes. This structured workflow begins with the independent collection and analysis of relevant research papers, progresses through collaborative planning and data preparation, and results in automated experimentation and comprehensive report generation. Details on specific agent roles and their contributions across these phases are discussed in the paper.\n\n\u003Cp align=\"center\">\n  \u003Cimg src=\"media\u002FAgentLabWF.png\" alt=\"Demonstration of the flow of AgentClinic\" style=\"width: 99%;\">\n\u003C\u002Fp>\n\n\n### 👾 Currently supported models\n\n* **OpenAI**: o1, o1-preview, o1-mini, gpt-4o, o3-mini\n* **DeepSeek**: deepseek-chat (deepseek-v3)\n\nTo select a specific llm set the flag `--llm-backend=\"llm_model\"` for example `--llm-backend=\"gpt-4o\"` or `--llm-backend=\"deepseek-chat\"`. Please feel free to add a PR supporting new models according to your need!\n\n## 🖥️ Installation\n\n### Python venv option\n\n* We recommend using python 3.12\n\n1. **Clone the GitHub Repository**: Begin by cloning the repository using the command:\n```bash\ngit clone git@github.com:SamuelSchmidgall\u002FAgentLaboratory.git\n```\n\n2. **Set up and Activate Python Environment**\n```bash\npython -m venv venv_agent_lab\n```\n- Now activate this environment:\n```bash\nsource venv_agent_lab\u002Fbin\u002Factivate\n```\n\n3. **Install required libraries**\n```bash\npip install -r requirements.txt\n```\n\n4. **Install pdflatex [OPTIONAL]**\n```bash\nsudo apt install pdflatex\n```\n- This enables latex source to be compiled by the agents.\n- **[IMPORTANT]** If this step cannot be run due to not having sudo access, pdf compiling can be turned off via running Agent Laboratory via setting the `--compile-latex` flag to false: `--compile-latex \"false\"`\n\n\n\n5. **Now run Agent Laboratory!**\n\n`python ai_lab_repo.py --yaml-location \"experiment_configs\u002FMATH_agentlab.yaml\"`\n\n\n### Co-Pilot mode\n\nTo run Agent Laboratory in copilot mode, simply set the copilot-mode flag in your yaml config to `\"true\"`\n\n-----\n## Tips for better research outcomes\n\n\n#### [Tip #1] 📝 Make sure to write extensive notes! 📝\n\n**Writing extensive notes is important** for helping your agent understand what you're looking to accomplish in your project, as well as any style preferences. Notes can include any experiments you want the agents to perform, providing API keys, certain plots or figures you want included, or anything you want the agent to know when performing research.\n\nThis is also your opportunity to let the agent know **what compute resources it has access to**, e.g. GPUs (how many, what type of GPU, how many GBs), CPUs (how many cores, what type of CPUs), storage limitations, and hardware specs.\n\nIn order to add notes, you must modify the task_notes_LLM structure inside of `ai_lab_repo.py`. Provided below is an example set of notes used for some of our experiments. \n\n\n```\ntask-notes:\n  plan-formulation:\n    - 'You should come up with a plan for only ONE experiment aimed at maximizing performance on the test set of MATH using prompting techniques.'\n    - 'Please use gpt-4o-mini for your experiments'\n    - 'You must evaluate on the entire 500 test questions of MATH'\n  data-preparation:\n    - 'Please use gpt-4o-mini for your experiments'\n    - 'You must evaluate on the entire 500 test questions of MATH'\n    - 'Here is a sample code you can use to load MATH\\nfrom datasets import load_dataset\\nMATH_test_set = load_dataset(\"HuggingFaceH4\u002FMATH-500\")[\"test\"]'\n...\n```\n\n--------\n\n#### [Tip #2] 🚀 Using more powerful models generally leads to better research 🚀\n\nWhen conducting research, **the choice of model can significantly impact the quality of results**. More powerful models tend to have higher accuracy, better reasoning capabilities, and better report generation. If computational resources allow, prioritize the use of advanced models such as o1-(mini\u002Fpreview) or similar state-of-the-art large language models.\n\nHowever, **it’s important to balance performance and cost-effectiveness**. While powerful models may yield better results, they are often more expensive and time-consuming to run. Consider using them selectively—for instance, for key experiments or final analyses—while relying on smaller, more efficient models for iterative tasks or initial prototyping.\n\nWhen resources are limited, **optimize by fine-tuning smaller models** on your specific dataset or combining pre-trained models with task-specific prompts to achieve the desired balance between performance and computational efficiency.\n\n-----\n\n#### [Tip #3] ✅ You can load previous saves from checkpoints ✅\n\n**If you lose progress, internet connection, or if a subtask fails, you can always load from a previous state.** All of your progress is saved by default in the `state_saves` variable, which stores each individual checkpoint. \n\n-----\n\n\n#### [Tip #4] 🈯 If you are running in a language other than English 🈲\n\nIf you are running Agent Laboratory in a language other than English, no problem, just make sure to provide a language flag to the agents to perform research in your preferred language. Note that we have not extensively studied running Agent Laboratory in other languages, so be sure to report any problems you encounter.\n\nFor example, if you are running in Chinese set the language in the yaml:\n\n`language:  \"中文\"`\n\n----\n\n\n#### [Tip #5] 🌟 There is a lot of room for improvement 🌟\n\nThere is a lot of room to improve this codebase, so if you end up making changes and want to help the community, please feel free to share the changes you've made! We hope this tool helps you!\n\n\n## 📜 License\n\nSource Code Licensing: Our project's source code is licensed under the MIT License. This license permits the use, modification, and distribution of the code, subject to certain conditions outlined in the MIT License.\n\n## 📬 Contact\n\nIf you would like to get in touch, feel free to reach out to [sschmi46@jhu.edu](mailto:sschmi46@jhu.edu)\n\n## Reference \u002F Bibtex\n\n\n### Agent Laboratory\n```bibtex\n@misc{schmidgall2025agentlaboratoryusingllm,\n      title={Agent Laboratory: Using LLM Agents as Research Assistants}, \n      author={Samuel Schmidgall and Yusheng Su and Ze Wang and Ximeng Sun and Jialian Wu and Xiaodong Yu and Jiang Liu and Michael Moor and Zicheng Liu and Emad Barsoum},\n      year={2025},\n      eprint={2501.04227},\n      archivePrefix={arXiv},\n      primaryClass={cs.HC},\n      url={https:\u002F\u002Farxiv.org\u002Fabs\u002F2501.04227}, \n}\n```\n\n### AgentRxiv\n```bibtex\n@misc{schmidgall2025agentrxiv,\n      title={AgentRxiv: Towards Collaborative Autonomous Research}, \n      author={Samuel Schmidgall and Michael Moor},\n      year={2025},\n      eprint={2503.18102},\n      archivePrefix={arXiv},\n      primaryClass={cs.AI},\n      url={https:\u002F\u002Farxiv.org\u002Fabs\u002F2503.18102}, \n}\n```\n","Agent Laboratory 是一个端到端的自主研究工作流，旨在协助研究人员实现其研究想法。该项目利用大型语言模型驱动的专业代理，支持从文献综述、计划制定到实验执行和报告撰写的整个研究流程。其核心功能包括自动化处理重复性和耗时的任务（如编码和文档编写），从而让研究人员能够专注于创意和批判性思维。此外，Agent Laboratory 支持 AgentRxiv 框架，使自主研究代理能够上传、检索并基于彼此的研究进行累积性进展。该项目适合需要提高研究效率和加速科学发现的研究人员使用。",2,"2026-06-11 03:40:16","high_star"]