train.py

[mylesgoose]

I had to vary this code here in the Train.py to get it to work on my system

LoRA and DORA modules

sys.path.append("./scripts")
from scripts.lora import LORA
from scripts.dora import BNBDORA, HQQDORA, DORALayer, MagnitudeLayer

probably because i already had a module called dora and lora in the pip.

[MizuleGPT]

this fixed the problem for me too, you probably saved me a week of mindless scanning and screaming at AIs