Is it possible to have the submission as a CSV file?

I know that I can access the CSV file by logging into Jotform, but is it possible for the Jotform email notification to have the CSV file sent as an attachment to the email notification?

You cannot include the CSV report in the email as attachment in the same way as you do with the PDF report, what I would suggest you is to create an CSV report and include the link to it in the email notification, do note that the CSV report will include all the submitted info. 

Please, check this guide in order to know how to create the CSV report: https://www.jotform.com/help/103-How-to-Create-a-CSV-Report 

Since it can be shared you could include the link in the email's body.