Calculated fields are not longer giving the right results in version 4 (but were always correct in version 3)

  • Profile Image
    CalderElearn
    Asked on December 15, 2017 at 08:25 AM

    We are facing a very annoying problem in our examforms which we can't solve ourselves. The problem didn't occur in version 3, but showed up at the same moment we were forced to upgrade to version 4.

    The problem:
    We have digitalised the paper and pencil exams for our vocational training center with JotForm. We use this method now over a year, and were very satisfied with the results - until now!

    How it works: 
    The examination and grading is partially done by the company where the students does his internship, and partially at school. The results are added together to complete the grading. Finally our examination-office (examenbureau) checks the results and makes them final.

    Each examination leads to only one submission (record or row) in Jotform.
    The grading-process starts at the internship company. 
    When the internship company submits his grading, the schoolexaminer gets an e-mail with an edit submission link so he can do his grading part.
    When the schoolexaminer submits his grading, the examination-office gets an e-mail with an edit submission link to make the grading final.
    Finally al participants (inclusing the student) are informed by mail about the final grade.

    In our forms we use calculated fields to calculate how many points a student has earned. These points are then translated to a letter grading: onvoldoende (fail), voldoende (pass) and goed (good). This is done by a calculation in JotForm.

    However, since we were forced to upgrade to version 4 the final result is no longer calculated correctly.
    We noticed that, when the examination office receives the submissions and tries to edit it, the letter grade is automatically changed from voldoende (pass) to goed (good) without us changing or doing anything.

    As you can see in the screenshot the grades were still calculated right at 14-10-2017 but were calculated wrong today. 5 Points should lead to 'voldoende' instead of 'good'

    We really dont't know what causes this. So i sincerely hope, that you can provide the answer very soon. 

    With regards
    H. Raaijman

  • Profile Image
    Ardian_L
    Answered on December 15, 2017 at 10:52 AM

     Hi,

    I analyzed the conditional logic that you determine "Dit werkproces is beoordeeld met". 

    Your conditional logic it is like this:

    if(score werkproces > Goed min 1)

    {

      Dit werkproces is beoordeeld met = good;

    }


    if(score werkproces > Voldoende min 1)

    {

      if(score werkproces < good)

      {

        Dit werkproces is beoordeeld met = voldoende;

      }

    }

    So lets take the submission with ID: 3837981569427453771 which has these scores:

    1513352940TestForma.png

    Based in the condition logic:

    if( 5 > 8)

    {

      Dit werkproces is beoordeeld met = good;

    }


    if(5 > 4)

    {

      if(5 < 9)

      {

        Dit werkproces is beoordeeld met = voldoende;

      }

    }

    In this case the Result of Dit werkproces is beoordeeld met will be voldoende.


    So the second result based in your highlights on that list it is correct. If this is not the correct calculation you may need to check your conditional logic.

    Please let us know if you have any other question.

  • Profile Image
    CalderElearn
    Answered on December 15, 2017 at 04:29 PM

    Hello Ardian,

    Thanx for your reply. Unfortunately you don't give a solution for the problem i described.
    In fact you only proved that the problem i face is a real problem.

    The submission with ID 3837981569427453771  (the one you analysed) leads to 'voldoende' . That is exactly what i exspected it to be (and should be).
    Note: At that moment we were still working under Jotform V3
    But I marked 2 submissions to show that the 2 marked submissions BOTH have a 'score werkproces' of 5 points but unfortunately lead tot a different grade.

    1513373251Capture 1.JPG

    1513373318Capture2.JPG

    Please look also at the submission with ID 3891472018127530791 (that is the first marked one) which has also a 'score werkproces' of 5 points BUT leads to 'goed' instead of 'voldoende'. WHY?
    Note: At this moment we were forced to work under Jotform V4

    So the question remains: what causes this problem? Am i doing something wrong, or (and that is what i assume) is the problem caused by an error in the code of Jotform V4?

    I hope that you can answer my question.

    H. Raaijman

  • Profile Image
    BDAVID
    Answered on December 15, 2017 at 05:23 PM

    I have revised those conditions, and there is no reason why "goed" should have been places instead of "voldoende". Have you had any other submission where this issue reproduces again? Probably it was related due to an isolated glitch. If it has reproduced more that one time, please share the submission IDs.

  • Profile Image
    CalderElearn
    Answered on January 11, 2018 at 08:13 AM

    Hello Ardian and BDavid,

    I'm still facing serious problems because some calculated fields suddenly are not longer giving the right results.
    The problem exists since we were forced to updgrade from version 3 to version 4 in the beginning of december.
    We never had these problems in version 3 - the calculated results were always correct,
    Because we are using the forms for our vocational examination, we have a real urge that the results are reliable. 

    How do we use the forms for examination?
    Each examination leads to only one submission (record or row) in Jotform.The grading-process starts at the internship company. 
    When the internship company submits his grading, the schoolexaminer gets an e-mail with an edit submission link so he can do his grading part.
    When the schoolexaminer submits his grading, the examination-office gets an e-mail with an edit submission link to make the grading final.
    So, the examination and grading is partially done by the company where the students does his internship, and partially at school.
    Both give points for the assessment. The points are added together and finally lead to a result. The result is a (calculated) 'letter grade'. 
    The letter grade is 'onvoldoende' (inadequate), 'voldoende' (satisfactory) or 'goed' (good) - depending on the sum of the points.

    So we made three fields to determine if the grading should lead to 'onvoldoende', 'voldoende' or 'goed'.
    If the points >= 'goed' then the result is "goed", if the points >= 'voldoende' then the result is "voldoende", otherwise the result is "onvoldoende"
    But because Jotfom doesn't know '>=' or '<=' we also made (calculated) fields 'goed - 1' and 'voldoende - 1'

    Finally our examination-office (examenbureau) checks the results and makes them final.
    And that is where it goes wrong. When the examination-office fills out their part of the form, we see the grading for no reason suddenly change from 'voldoende' to 'goed'.
    We can't figure out why. We tested all the condtions, but we can't find the problem that causes this.

    So, we asked you to look in the problem.
    Your answer "... there is no reason why "goed" should have been places instead of "voldoende". Probably it was related due to an isolated glitch. ..."
    But unfortunately it isn't an isolated glitch.

    I uploaded an Excel-file with all the submissions (in many different forms!) where the result as provided by Jotform (column Jotform_Result) doesn't match the calculated result (column Calculated_Result). In column 'vaststellingsdatum' you see that the (wrong) results did not occur before the 7. of december.

    If you want to check it yourself, you can use this URL:
    https://form.jotformeu.com/80023619398359?key=toegangscode&examenkandidaat=Marieke van den Beld&studentnummer=222222&leerweg=BOL&organisatie_bpv=Huisartsenpraktijk de Wit en de Jong&examinator_BPV=Geurtsen&email_bpv=heinie.raaijman@capabel.nl&examinator_COG=Heinie Raaijman&email_cog=heinie.raaijman@capabel.nl&email_exburo=heinie.raaijman@capabel.nl&beoordelaars=Beide&fileupload=BPV
    You only have to change the email-addresses (heinie.raaijman@capabel.nl) into your own email-addresses.

    What are we doing wrong?
    Has this to do with something i did (or not did) or has there been an change at your side that causes this problem?
    It is very important for us to solve this problem, because we currently are developing the new forms for the examination (2017-2018) and the form you are currently looking at will be used as our 'masterform'(and being cloned).
    Please help me out.

    With regards,
    H. Raaijman


    1515676297Answer from Teacher.JPG


    1515676390Answer from Examenbureau.JPG




  • Profile Image
    CalderElearn
    Answered on January 11, 2018 at 08:18 AM

    And here is the Excel-file i referred to...


  • Profile Image
    Ardian_L
    Answered on January 11, 2018 at 09:45 AM

    I was able to find the issue on this submission ID: 3909548241211922850

    Based on your conditional logic  if(score werkproces > Goed min 1){

      Dit werkproces is beoordeeld met = good;

    }


    if(score werkproces > Voldoende min 1){

       if(score werkproces < good)  {

         Dit werkproces is beoordeeld met = voldoende;

       }

    }

    if (8 > 8){

    Dit werkproces is beoordeeld met = good;

    }

    if(8 > 4){

    if(8 < 9)

    {

    Dit werkproces is beoordeeld met = voldoende;

    }

    }

    The result should be voldoende and it is appearing as goed;

    Note: You can use greater than, and less than if you use a number field. 

    I have submitted the issue to our developers and you will be notified on this thread as soon as possible. We are sorry for any inconvenience caused.

  • Profile Image
    CalderElearn
    Answered on January 12, 2018 at 03:30 AM

    Thanx, Ardian. I'm very glad you found the issue i referred to.

    I hope there will be a repair very soon.

    H.