using tape instead of glue will be a big improvement if you aren't already. I found that with my white velvet.
I should also mention that my lighter coloured velvets -light pink and white, were purchased from Michael's and from UB. The quality wasn't nearly as good as the Swiss velvet from Artistic Ribbon. It's worth the extra $ (imho)