Have a Cup UI to be like crystals, so you can change them out for Defensive/Offensive any time and swap between for PvP and PvE. Keep the same items if you want to take them out from the "cup inventory" similar to crystal extraction.
1-2b to swap around is kind've terrible.
I would agree, the system is too punishing. Add them to the crystal slot UI and be done with it.