This only signals that GPUs are not solving some parts of inference as efficient as desired, and then new specialized microprocessors and eventually ASICs, are produced instead of keeping adapting the main core produced equipment to all problems (in this case the GPU).
You are extrapolating this too much. LPUs work because they are not as specialized as Taalas. You can switch the model that is running on them.
Taalas is too much specialized to only run the model it is designed to run. Sure this is very efficient at running that model, but it isn't efficient in a general sense. When you are getting new models every 3 months, not to even mention finetuning models.
An ASIC like Taalas is not very adaptable.
Maybe. Let's see in a few good months.
History told us that if it is too complex, it eventually dies or splits into more pieces. And that's how I feel this might happen.