The only way to remove default gear in Phasmophobia is by replacing it with better items as you unlock them. You cannot completely get rid of your gear since you must have one of all default items ...