I am running linux with cublast offload, and I am using the new 3 bit quant that... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		brucethemoose2 on June 6, 2023 \| parent \| context \| favorite \| on: GGML – AI at the Edge I am running linux with cublast offload, and I am using the new 3 bit quant that was just pulled in a day or two ago.

smiley1437 on June 6, 2023 | [–]

Thanks! I'll have to try the 3bit to see if that helps

LoganDark on June 7, 2023 | [–]

cuBLAS or CLBlast? There is no such thing as cublast

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact