The Turing Police would already be up this AI's ass.
The user of the implement that causes harm should face both the loss of liberty and the loss of the implement. This applies even when the implement is borrowed & the user isn’t the owner of the implement. If a LLM is implicated in a criminal act, why would it be exempt from seizure and destruction?