Inspired by ComfyUI and CrewAI, this project aims to develop nodes within ComfyUI that enable the execution of multi-agent tasks without requiring any coding.
-
Crew, refer to Crews
-
LLM (OpenAI, Claude, Groq)
-
Agent, refer to Agents
-
Agent List
-
Task, refer to Tasks
-
Task List
-
Tool List
-
Various Search and Scraping Tools:
- Web Scraper (ScrapeWebsiteTool)
- Web Searcher (SerperDevTool)
- File Reader (FileReadTool)
- MDX Searcher (MDXSearchTool)
- PDF Searcher (PDFSearchTool)
- CSV Searcher (CSVSearchTool)
- Directory Reader (DirectoryReadTool)
- Browserbase Loader (BrowserbaseLoadTool)
- Code Docs Searcher (CodeDocsSearchTool)
- Directory Searcher (DirectorySearchTool)
- DOCX Searcher (DOCXSearchTool)
- EXA Searcher (EXASearchTool)
- Github Searcher (GithubSearchTool)
- JSON Searcher (JSONSearchTool)
- PostgreSQL Searcher (PGSearchTool)
- RAG Tool (RagTool)
- Element Scraper (ScrapeElementFromWebsiteTool)
- Selenium Scraper (SeleniumScrapingTool)
- Website Searcher (WebsiteSearchTool)
- XML Searcher (XMLSearchTool)
- Youtube Channel Searcher (YoutubeChannelSearchTool)
- Youtube Video Searcher (YoutubeVideoSearchTool)
- TXT Searcher (TXTSearchTool)
- LlamaIndex Tool (LlamaIndexTool)
- Install ComfyUI by following the instructions on their GitHub page
- Clone this repository to custom_nodes folder
- Install requirements by running
pip install -r requirements.txt
or if you use portable (run this in ComfyUI_windows_portable -folder):
python_embeded\python.exe -m pip install -r ComfyUI\custom_nodes\ComfyUI-CrewAI\requirements.txt
For showing text you will need this addon as well:
https://github.com/pythongosssss/ComfyUI-Custom-Scripts
- LLM Nodes: Connect these to Agent nodes to set the language model for each agent.
- Agent Nodes: Create multiple agents and connect them to an Agent List node.
- Task Nodes: Create tasks and connect them to a Task List node.
- Tool Nodes: Select the tools you need and connect them to a Tool List node.
- Crew Node: Connect the Agent List, Task List, and Tool List nodes to the Crew node to set up your multi-agent system.
Example workflow:
- Create LLM nodes (e.g., OpenAI LLM) and set API keys.
- Create Agent nodes and connect LLM nodes to them.
- Connect Agent nodes to an Agent List node.
- Create Task nodes with descriptions of what needs to be done.
- Connect Task nodes to a Task List node.
- Select necessary Tool nodes (e.g., Web Scraper, PDF Searcher) and connect them to a Tool List node.
- Connect Agent List, Task List, and Tool List to the Crew node.
- Run the workflow to execute your multi-agent task.
Some tools require API keys. Set these in your environment variables or provide them directly in the tool nodes:
- OPENAI_API_KEY: For OpenAI LLM
- ANTHROPIC_API_KEY: For Claude LLM
- SERPER_API_KEY: For Web Searcher (SerperDevTool)
- BROWSERBASE_API_KEY: For Browserbase Loader
- EXA_API_KEY: For EXA Searcher
- Add more examples demonstrating various multi-agent scenarios
- Improve documentation for each tool and its specific use cases
- Develop custom UI elements for better parameter input and visualization
- Implement error handling and validation for API keys and inputs