> We can try to improve this by implementing a streaming JSON parser.

In .NET land, Utf8JsonReader is essentially this idea. You can parse up until you have everything you need and then bail on the stream.

https://learn.microsoft.com/en-us/dotnet/standard/serializat...