We already pretty much know the solution to scientific computing: throw lots of cheap hardware on it (where "cheap" is then defined by what is mass-produced for other reasons).
Designing future hardware around the needs of scientific computing seems ass-backwards. It's putting the cart in front of the horse.
-- Linus