QI play a follower and, since it has Rush due to this follower's passive ability, immediately declare an attack with it. If my opponent banishes this follower at Quick timing with a card such as Fall from Grace, causing the attacking follower to lose Rush, does the attack still go through?

AYes, it does.