Wulf,
There is a backpack to the right of the teleporters on the 1st floor of my house where I always tossed regular gems dropped by the pushier of the NPC "visitors" to my house. Should be at least a couple hundred of each kind, as there wasn't much to craft from them before. Help yourself if those are the ones you need.
-Skylark