[Bug]: vllm 0.4.1 and transformers 4.40.1 have conflicting dependencies on pydantic

[AbbottKilig]

[Bug]: vllm 0.4.1 and transformers 4.40.1 have conflicting dependencies on pydantic

[simon-mo]

Hmm our current pin is

vllm/requirements-common.txt

Line 12 in a74dee9

pydantic >= 2.0 # Required for OpenAI server.

Is there places where vLLM needs to be changed?

[AbbottKilig]

Hmm our current pin is

vllm/requirements-common.txt

Line 12 in a74dee9

pydantic >= 2.0 # Required for OpenAI server.

Is there places where vLLM needs to be changed?

If I lower the version of pydantic to 1.9.0, the following error will occur again:
File /opt/conda/lib/python3.8/site-packages/vllm/model_executor/layers/quantization/schema.py:16
1 """
2 This file contains the Pydantic schemas for various quantization-related
3 parameters. When a relevant quantization technique is specified, these
(...)
11 scaling factors.
12 """
14 from typing import Dict, Optional
---> 16 from pydantic import BaseModel, ConfigDict, ValidationInfo, model_validator
19 class KVCacheQuantSchema(BaseModel):
20 dtype: str

ImportError: cannot import name 'ConfigDict' from 'pydantic' (/opt/conda/lib/python3.8/site-packages/pydantic/init.cpython-38-x86_64-linux-gnu.so）

[DarkLight1337]

I'm able to import transformers just fine using transformers==4.40.1, pydantic==2.7.1, and pydantic_core==2.18.2. Try updating your pydantic version.