llama: let the backend pick n_ubatch, and default to 2048 on RDNA3.5 - #77
Draft
roberteg16 wants to merge 1 commit into
Draft
llama: let the backend pick n_ubatch, and default to 2048 on RDNA3.5#77roberteg16 wants to merge 1 commit into
roberteg16 wants to merge 1 commit into
