feat(audio-car-cockpit): Improved ROCm GPU automatic detection and added CPU override#74
Open
ThomasGmeinder wants to merge 6 commits intoLiquid4All:mainfrom
Open
feat(audio-car-cockpit): Improved ROCm GPU automatic detection and added CPU override#74ThomasGmeinder wants to merge 6 commits intoLiquid4All:mainfrom
ThomasGmeinder wants to merge 6 commits intoLiquid4All:mainfrom
Conversation
added 6 commits
March 13, 2026 20:25
…ers for ROCm builds Auto-detect HIP_ARCH from rocminfo instead of hardcoding gfx1150, with fallback if detection fails. Pass --n-gpu-layers 9999 to the audio server when ROCm is present so model layers are offloaded to the GPU. Also add a clean target and a check_system.sh helper script. Made-with: Cursor
… server The audio server built from PR #18641 (ROCm path) returns the audio field as delta.audio with int16 PCM format, while the pre-built CPU binary uses delta.audio_chunk with float32 PCM. Handle both field names in server.py and auto-detect the PCM format (int16 vs float32) in the browser for correct playback on both build paths. Made-with: Cursor
…ng HIP build Replace the /opt/rocm directory check with rocm-smi --showproductname to verify a GPU is actually present and the driver is loaded. Falls back to CPU build if ROCm is installed but not functional. Also use rocm-smi for HIP_ARCH detection instead of rocminfo. Made-with: Cursor
The ROCm-built audio server (PR #18641) returns delta.audio with int16 PCM, while the pre-built CPU binary returns delta.audio_chunk with float32 PCM. Use the field name to set the format explicitly instead of fragile auto-detection probing that failed on quiet audio chunks. Made-with: Cursor
Allow users to bypass ROCm GPU detection and force a CPU-only build with make CPU=1. Useful for testing or when the GPU build is unwanted. Tested on ROCm (gfx1151) and on CPU with CPU=1 override. Made-with: Cursor
…at via env Separate build directories (llama.cpp-rocm, llama.cpp-cpu) and binaries (llama-server-rocm, llama-server-cpu) so switching between ROCm and CPU no longer requires make clean. Both builds coexist on disk. The Makefile passes AUDIO_PCM_FORMAT (int16 for ROCm, float32 for CPU) to server.py via env var. server.py sends it to the browser as a config message on websocket connect. The JS uses it directly — no data probing. This resolves the audio distortion issues caused by the two audio server binary versions returning different PCM encodings (int16 vs float32) while both reporting format as "pcm". Tested on ROCm (gfx1151) and CPU (make CPU=1) — audio works on both. Made-with: Cursor
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
rocm-smiand build llama.cpp with HIP acceleration when available, falling back to CPU-only build otherwiserocm-smiinstead of hardcoding gfx1150, and pass--n-gpu-layers 9999to offload model layers to the GPUdelta.audio, int16 PCM) and the pre-built CPU binary (delta.audio_chunk, float32 PCM)CPU=1make option to force a CPU-only build even when ROCm is availablemake cleantarget andcheck_system.shdiagnostic scriptTest report
make CPU=1 audioserver && make CPU=1 serveMade with Cursor