Train_Toolが動かせない
stable diffuion webUI自体を入れなおした方がいいかも
File "C:\webui\stable-diffusion-webui\extensions\sd-webui-train-tools\liasece_sd_webui_train_tools\sd_scripts\library\train_util.py", line 3085, in prepare_accelerator
accelerator = Accelerator(
TypeError: Accelerator.__init__() got an unexpected keyword argument 'logging_dir'
https://github.com/invoke-ai/InvokeAI/issues/3763
https://github.com/huggingface/accelerate/issues/1559
https://github.com/chatchat-space/Langchain-Chatchat/issues/306
https://aiacademy.jp/media/?p=3469
【PyTorch】Accelerateのインストールと設定
PS C:\Users\user> pip list
Package Version
------------------------- ------------
accelerate 0.18.0
aiofiles 23.2.1
altair 5.2.0
annotated-types 0.6.0
anyio 4.2.0
attrs 23.2.0
certifi 2023.11.17
charset-normalizer 3.3.2
click 8.1.7
colorama 0.4.6
contourpy 1.2.0
cycler 0.12.1
exceptiongroup 1.2.0
fastapi 0.109.0
ffmpy 0.3.1
filelock 3.13.1
fonttools 4.47.2
fsspec 2023.12.2
gradio 4.14.0
gradio_client 0.8.0
h11 0.14.0
httpcore 1.0.2
httpx 0.26.0
huggingface-hub 0.20.2
idna 3.6
importlib-resources 6.1.1
Jinja2 3.1.3
jsonschema 4.20.0
jsonschema-specifications 2023.12.1
kiwisolver 1.4.5
markdown-it-py 3.0.0
MarkupSafe 2.1.3
matplotlib 3.8.2
mdurl 0.1.2
mpmath 1.3.0
networkx 3.2.1
numpy 1.26.3
orjson 3.9.10
packaging 23.2
pandas 2.1.4
pillow 10.2.0
pip 22.2.1
psutil 5.9.7
pydantic 2.5.3
pydantic_core 2.14.6
pydub 0.25.1
Pygments 2.17.2
pyparsing 3.1.1
python-dateutil 2.8.2
python-multipart 0.0.6
pytz 2023.3.post1
PyYAML 6.0.1
referencing 0.32.1
requests 2.31.0
rich 13.7.0
rpds-py 0.17.1
semantic-version 2.10.0
setuptools 63.2.0
shellingham 1.5.4
six 1.16.0
sniffio 1.3.0
starlette 0.35.1
sympy 1.12
tomlkit 0.12.0
toolz 0.12.0
torch 2.1.2+cu118
torchaudio 2.1.2+cu118
torchvision 0.16.2+cu118
tqdm 4.66.1
typer 0.9.0
typing_extensions 4.9.0
tzdata 2023.4
urllib3 2.1.0
uvicorn 0.25.0
websockets 11.0.3
[notice] A new release of pip available: 22.2.1 -> 23.3.2
[notice] To update, run: python.exe -m pip install --upgrade pip
PS C:\Users\user>
PS C:\Users\user> python -m pip install --upgrade pip setuptools
Requirement already satisfied: pip in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (22.2.1)
Collecting pip
Using cached pip-23.3.2-py3-none-any.whl (2.1 MB)
Requirement already satisfied: setuptools in c:\users\user\appdata\local\programs\python\python310\lib\site-packages (63.2.0)
Collecting setuptools
Using cached setuptools-69.0.3-py3-none-any.whl (819 kB)
Installing collected packages: setuptools, pip
Attempting uninstall: setuptools
Found existing installation: setuptools 63.2.0
Uninstalling setuptools-63.2.0:
Successfully uninstalled setuptools-63.2.0
Attempting uninstall: pip
Found existing installation: pip 22.2.1
Uninstalling pip-22.2.1:
Successfully uninstalled pip-22.2.1
Successfully installed pip-23.3.2 setuptools-69.0.3
PS C:\Users\user> accelerate config
------------------------------------------------------------------------------------------------------------------------In which compute environment are you running?
This machine
------------------------------------------------------------------------------------------------------------------------Which type of machine are you using?
No distributed training
Do you want to run your training on CPU only (even if a GPU / Apple Silicon device is available)? [yes/NO]:yes
Do you wish to optimize your script with torch dynamo?[yes/NO]:no
Do you want to use DeepSpeed? [yes/NO]: no
------------------------------------------------------------------------------------------------------------------------Do you wish to use FP16 or BF16 (mixed precision)?
fp16
accelerate configuration saved at C:\Users\user/.cache\huggingface\accelerate\default_config.yaml
PS C:\Users\user> accelerate test
Running: accelerate-launch C:\Users\user\AppData\Local\Programs\Python\Python310\lib\site-packages\accelerate\test_utils\scripts\test_script.py
stdout: **Initialization**
stdout: Testing, testing. 1, 2, 3.
stdout: Distributed environment: NO
stdout: Num processes: 1
stdout: Process index: 0
stdout: Local process index: 0
stdout: Device: cpu
stdout:
stdout: Mixed precision type: fp16
stdout:
stdout:
stdout: **Test process execution**
stdout:
stdout: **Test random number generator synchronization**
stdout: All rng are properly synched.
stdout:
stdout: **DataLoader integration test**
stdout: 0 tensor([ 0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17,
stdout: 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31]) <class 'accelerate.data_loader.DataLoaderShard'>
stdout: Non-shuffled dataloader passing.
stdout: Shuffled dataloader passing.
stdout: Non-shuffled central dataloader passing.
stdout: Shuffled central dataloader passing.
stdout:
stdout: **Training integration test**
stdout: Model dtype: torch.float32, torch.float32. Input dtype: torch.float32
stdout: Model dtype: torch.float32, torch.float32. Input dtype: torch.float32
stdout: Training yielded the same results on one CPU or distributed setup with no batch split.
stdout: Model dtype: torch.float32, torch.float32. Input dtype: torch.float32
stdout: Training yielded the same results on one CPU or distributes setup with batch split.
stdout: FP16 training check.
stdout: Model dtype: torch.float32, torch.float32. Input dtype: torch.float32
stdout: BF16 training check.
stdout: Model dtype: torch.float32, torch.float32. Input dtype: torch.float32
Test is a success! You are ready for your distributed training!
torchとaccelerate が正しく入っているのですが、
なぜ解消しないのだろう
普通のLoRAが出来てないのに面倒くさくなるのか
https://tecsingularity.com/cuda/version_conf/
https://www.macnica.co.jp/business/semiconductor/articles/nvidia/136485/
https://haogadget.com/entry/2023/10/18/062844
https://note.com/blue_pen5805/n/n08c087967e0c
結局、起動すらできなくなってしまった
↓
tensorRTのインストールを中断したときから動かないので
Extensionのフォルダから該当のフォルダを削除したら
再度起動はできるようになった
