The problem with that is the need to either add a reaction to turn them into boulders, or a reaction to accept gems as input.
Maybe if I added a category for gem weapons/ammo...
Take a look at Dark Ages II. It has reactions in it that allow dwarves to make weapons and armor using large gems. They aren't very effective, as I've seen myself, but they are cool.