The plus sign (+) means "ADD" in programming and on calculator keyboards. For example, 10 + 7 means 10 added to 7. It is also used as a concatenation symbol for text fields. For example, city + ", " + ...
A LoRA is tied to a specific model architecture — a LoRA trained on Llama 3 8B won't work on Mistral 7B. Train on the exact model you plan to use. You should also use Copy parameters from to restore ...