Is there a way for someone to save their progress in a form I create and put on my website if they want to return and finish later?

Yes, that's possible. Here's how: http://www.jotform.com/features/save-and-continue/

Basically, you will have to create a session URL for your users. Then they will have to open the session URL again whenever they want to continue the saved data.