i thought my post was already too long to include this, but to your point, you can run AI inference in this setup and the performance can be pretty good.
Yeah it is obviously actually useful for AI inference over which the pcie speed isn't particularly important and a single board computer gets you a small system.