32gb VRAM - can we have some support?

[aresstokrat]

Hello! Could you support people with home labs of ai a bit?
we are 3090/4090/5080/5090 users also want to have some of your love ;-)

[xysmlx]

Hi, thanks for the ping! :-)

Right now TileRT is heads-down on exploring the upper bound of inference performance, and most of the team's bandwidth is going into that direction, which is why current efforts have been concentrated on a narrower hardware/model set.

Broader hardware coverage is definitely on our radar and something we'd like to expand into, but we don't have a concrete timeline to share yet. Really appreciate you flagging the home-lab use case!