Can I unpublish a form

If you have embedded the form you may remove the embedded code, if you have shared the direct form URL, then you would need to disable the form in order to avoid submissions, this guide will help you disabling the form: https://www.jotform.com/help/180-How-to-Enable-Disable-a-Form 

I hope this helps.