Does anyone have a sucess story with ROCm
I cannot for the life of me get a single vision model working with my xtx 7900, Phi 3, and 4. Qwen 2 and 2.5. Through various frameworks.
VLLM gives me an HIP_ _ DSA error.
Various breaks for flash atttention with the phi models and so on. Really breaking my back to get anything working if anyone has has any success.