That's so frustrating!
I would try rubbing ice on the fibers to try to freeze the remaining gum, then scrape at it with a hard edge. You'll probably have to keep re-freezing it as best as you can and the scrape some more and repeat. Ice has always worked the best for me with gum problems.
Good luck!
-Heather