안녕하세요?
항상 빠른 대응에 감사드립니다.
- 현재 상태는 다음과 같습니다.
- llama 3 8b instruct 모델은 양자화가 잘 되고 있습니다.
- gemma 모델 양자화는 오류가 발생하고 있습니다.
- gemma 3 27b 모델을 양자화하려고 하니 transformers 버전이 낮다는 오류가 발생하였습니다.
- pip install --upgrade transformers 를 수행시켰더니 아래와 같은 메시지가 나오고 있습니다.
- gemma 모델은 transformers 버전이 4.50 이상이어야 한다고 허깅페이스에 명시되어 있습니다.
google/gemma-3-27b-it · Hugging Face
Downloading transformers-4.57.1-py3-none-any.whl (12.0 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.0/12.0 MB 66.3 MB/s 0:00:00
Downloading tokenizers-0.22.1-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.3/3.3 MB 50.9 MB/s 0:00:00
Installing collected packages: tokenizers, transformers
Attempting uninstall: tokenizers
Found existing installation: tokenizers 0.21.4
Uninstalling tokenizers-0.21.4:
Successfully uninstalled tokenizers-0.21.4
Attempting uninstall: transformers
Found existing installation: transformers 4.48.1
Uninstalling transformers-4.48.1:
Successfully uninstalled transformers-4.48.1
ERROR: pip’s dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
furiosa-llm 2025.3.3 requires transformers==4.48.1, but you have transformers 4.57.1 which is incompatible.
furiosa-llm-models 2025.3.0 requires transformers==4.48.1, but you have transformers 4.57.1 which is incompatible.
furiosa-model-compressor-impl 2025.3.0 requires transformers==4.48.1, but you have transformers 4.57.1 which is incompatible.
furiosa-models-lang 2025.3.0 requires transformers==4.48.1, but you have transformers 4.57.1 which is incompatible.
furiosa-native-runtime 2025.3.2 requires transformers==4.48.1, but you have transformers 4.57.1 which is incompatible.
Successfully installed tokenizers-0.22.1 transformers-4.57.1
위와 같이 버전을 업그레이드하면 정상적으로 양자화가 되지 않고 있습니다.
4.50 버전을 지원하는 furiosa-llm은 언제 즈음 릴리즈 되는지 궁금합니다.