Uggg...that's the worst.
If you stick with hot glue, make sure your gun is super hot before using it. Let it heat for about 15-20 minutes. When you glue your center down, press and hold it for about 30 seconds. That's the technique I use and they stick awesome. Sometimes if I glue a rhinestone off center I'm unable to pull it off to fix it.