At the very least, the new [extension stores](https://chromewebstore.google.com/category/extensions). I think the point here is that Agents could redefine how we interact with the internet, even if they don't change the internet itself.
ChatGPT has their [GPTs](https://chatgpt.com/gpts) marketplace, which could be considered an app store, but I'm not sure if it'll take off quite like Google Play or Apple's App Store.