feat: allow setting KV cache type

This commit is contained in:
Sam 2024-11-06 08:10:52 +11:00
parent c3ec09bb69
commit af7d64b887