Those cache attacks rely on accurate timing because the method of data exfiltration is faster access to array members that were cached in a speculative access.
By fudging the time (JS doesn't need ns or even µs accuracy) those issues are pretty much solved.
That's not true...at all. There are amplification techniques which work in JS and wasm that amplify a cache eviction into an over 1s delta [1]. Trying to restrict timing as a mitigation has been known to be ineffective since 2019, a bunch of people at Google who worked on the mitigation in Chromium wrote a paper [2] saying as much. Site isolation is the chosen mitigation because it actually works.