Direct Push doesn't care about the type of connection. All it really does is leave a connection to the server open so that the server has a path back to the device. It may not dynamically change connections due to this, but you could initiate it over WiFi and it would work.

Direct Push is more accurately described as "Direct Connection so you can pull e-mail when it shows up."