The 7700XT is much faster in compute but that's perhaps not as important as it having somewhat greater memory bandwidth (430 vs 380GB/s). That is going to help.
And as you say there's also the Wave Matrix Multiply Accumulate (WMMA) support which may give a nice boost too.
The RDNA3 part would seem to be the way to go unless pricing is very different.