How come when I change the form design I lose all imported Submissions?

Do you mean removing field? If yes, that is correct:

Whenever a field is deleted, associated data will be lost, so make sure you download your submissions top have a back up.