Smart fields get added to a constituent record through an add or update approach but there is no way to remove them except individually. A global change would allow an individual to remove smart fields from constituent records when they no longer apply.