Thinking more about this, my moral intuitions here:
1. I take as a given (and I imagine you do too) that a future competitor's version of this technology (which, say, lacks guardrails and disclosures) will absolutely be used to great harm, either overtly (scams) or subtly