I just placed 200 granite on my stone crafting slave in the prison cell ( in stacks of 100 in case you cant carry the full 200 stones at once ).
The Slave Market is in West Umbra, just over the Bridge, and has a public soul forge!
He'll pass them to you through the bars.
I have another 140 granite available if you're interested.