feat: add init cache type opts#455

polvalente wants to merge 2 commits into

mainelixir-nx/bumblebee:mainfrom

pv-fix/gqa-cache-and-inference-optselixir-nx/bumblebee:pv-fix/gqa-cache-and-inference-optsCopy head branch name to clipboard