This is mostly caused by DNS cache. First, delete the ipv6 entries on your DNS server. After that, clean up the cache with the following commands: ipconfig /flushdns nbtstat -R
Secondly, when there are multiple addresses on a network adapter the IPv6 addresses are preferred.
Note: To be sure to get the ipv4 response, use ping server1 -4