Removing a gemstone

Is it possible to remove a gemstone once attached to equipment?

Yes, in this game it is relatively cheap to do so. You can select the equipment in your Armory and select the attached gemstone, there will be an option to remove it for 20g. Note that when disassembling a piece of equipment the gemstones will also be removed automatically, without paying gold.