Segmentation faults.
#471
Replies: 1 comment
-
|
Can confirm this occurs to me too; M1 Max 32GB Ram, Master branch. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Using: M1 Macbook Pro, 16GB ram. Latest code. Using the 4bit models (7 or 13B) I reliably get segmentation faults after a few paragraphs of use. It doesn't seem to be an out of memory error ( there is plenty of swap available.) Any ideas?
Beta Was this translation helpful? Give feedback.
All reactions