> reducing delays and improving resolution (purpose-built ASICs will help)
How can you be sure? Investing in an ASIC seems like one of the most expensive and complicated solutions.
We wouldn't build it ourselves, but there are several companies like Etched, Groq, and Cerebras working on purpose-built hardware for transformer models. Here's more: https://www.etched.com/announcing-etched