This is absolutely true. Good idea.

However, if this network is to be useful for an extended time away from other networks it needs to support more complex tasks like downloading packages and OS images. 

These things could be implemented over LoRA however it makes it difficult to access documentation for the thing you just downloaded and are trying to use, etc.

I think reaching this level of compression is possible eventually but we are not there yet for every service and use case.