tom-doerr/dspy_nodes

WIP - Allows you to create DSPy pipelines using ComfyUI

DSPy Nodes

DSPy Nodes for ComfyUI.

This is still a work in progress

What is it?

This is an attempt to make all DSPy features available in ComfyUI. Using an UI to devlop DSPy programs should be way faster since it makes it easier to see what is happening and allows to quickly iterate on the DSPy program structure.

Installation

Clone this repository into your ComfyUI custom_nodes folder.

git clone https://github.com/tom-doerr/dspy_nodes.git

How to use it

You can add DSPy nodes by doing <right click> -> Add Node -> DSPy -> Node Name

Contact

Feel free to open an issue if you have any questions or suggestions or contact me:

E-mail: [email protected]

Twitter: @tom_doerr

dspy_nodes's Issues

Ollama / dspy.OllamaLocal support

https://ollama.com/ is a way to run llama locally. It serves models at a local url.

I'd like to use it in dspy_nodes but maybe some modifications would be needed
i'd be happy to make a pull request if you have an idea of how it could be done and talk me through it a little.

There's an object for it in DSPy: https://dspy-docs.vercel.app/api/local_language_model_clients/Ollama

Missing files

Hi:

Good idea! I am having some runtime issues - The string_list_viewer.py file referred to is not present in the repo. Any thoughts?

Traceback (most recent call last):
File "/root/ComfyUI/nodes.py", line 1931, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "/root/ComfyUI/custom_nodes/dspy_nodes/init.py", line 9, in
from .nodes.predict import *
File "/root/ComfyUI/custom_nodes/dspy_nodes/nodes/predict.py", line 4, in
from custom_nodes.dspy_nodes.nodes.global_file import server_settings
File "/root/ComfyUI/custom_nodes/dspy_nodes/init.py", line 21, in
from .nodes.string_list_viewer import *
ModuleNotFoundError: No module named 'custom_nodes.dspy_nodes.nodes.string_list_viewer'

Cannot import /root/ComfyUI/custom_nodes/dspy_nodes module for custom nodes: No module named 'custom_nodes.dspy_nodes.nodes.string_list_viewer'
Traceback (most recent call last):
File "/root/ComfyUI/nodes.py", line 1931, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 883, in exec_module
File "", line 241, in _call_with_frames_removed
File "/root/ComfyUI/custom_nodes/efficiency-nodes-comfyui/init.py", line 1, in
from .efficiency_nodes import NODE_CLASS_MAPPINGS
File "/root/ComfyUI/custom_nodes/efficiency-nodes-comfyui/efficiency_nodes.py", line 46, in
from .py import smZ_cfg_denoiser
File "/root/ComfyUI/custom_nodes/efficiency-nodes-comfyui/py/smZ_cfg_denoiser.py", line 7, in
from comfy.samplers import KSampler, CompVisVDenoiser, KSamplerX0Inpaint
ImportError: cannot import name 'CompVisVDenoiser' from 'comfy.samplers' (/root/ComfyUI/comfy/samplers.py)

Cannot import /root/ComfyUI/custom_nodes/efficiency-nodes-comfyui module for custom nodes: cannot import name 'CompVisVDenoiser' from 'comfy.samplers' (/root/ComfyUI/comfy/samplers.py)

Loading: ComfyUI-Manager (V2.46.3)

ComfyUI Revision: 1 [29c2e267] | Released on '2024-07-12'

Traceback (most recent call last):
File "/root/ComfyUI/nodes.py", line 1931, in load_custom_node
module_spec.loader.exec_module(module)
File "", line 879, in exec_module
File "", line 1016, in get_code
File "", line 1073, in get_data
FileNotFoundError: [Errno 2] No such file or directory: '/root/ComfyUI/custom_nodes/ComfyUI-Bedrock/init.py'

Cannot import /root/ComfyUI/custom_nodes/ComfyUI-Bedrock module for custom nodes: [Errno 2] No such file or directory: '/root/ComfyUI/custom_nodes/ComfyUI-Bedrock/init.py'