Need failure reason in test results response from ACVP server

[jfigus]

Need failure reason in test results response from ACVP server

[atvassilev]

I am in favor.

[bfussell]

Sounds good to me. As we have discussed on a few occasions the error reporting is presently
pretty weak and we need to make sure we continue to enhance it. I still have an action item
to review the CAVS tool and make sure we cover all errors it detected.

Barry

From: John Foley [mailto:[email protected]]
Sent: Tuesday, November 22, 2016 11:15 AM
To: usnistgov/ACVP [email protected]
Subject: [usnistgov/ACVP] Need failure reason in test results response from ACVP server (#26)

Do we want to add a reason failure to the test results in section 11.4 for failed test cases? The JSON response would look something like this...

{
"version" : "0.2",
"results" : {
"vsId" : 1437,
"disposition" : "incomplete",
"tests" : [
{ "tcId" : 12340, "result" : "passed", "reason" : "" },
{ "tcId" : 12341, "result" : "incomplete", "reason" : "" },
{ "tcId" : 12342, "result" : "failed", "reason" : "Authentication tag failure" }
]
}
}

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHubhttps://github.com//issues/26, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AGnx9q7XPGqsUzXa_BX-KgVUut-MCko8ks5rAxUegaJpZM4K5oIk.

[sam1689]

Good idea - I think it will enhance the value of the testing and save everyone more time if we can include a decent failure reason in the results.

-Sam

On 11/22/16 11:15 AM, John Foley wrote:

Do we want to add a reason failure to the test results in section 11.4 for failed test cases? The JSON response would look something like this...

{
"version" : "0.2",
"results" : {
"vsId" : 1437,
"disposition" : "incomplete",
"tests" : [
{ "tcId" : 12340, "result" : "passed", "reason" : "" },
{ "tcId" : 12341, "result" : "incomplete", "reason" : "" },
{ "tcId" : 12342, "result" : "failed", "reason" : "Authentication tag failure" }
]
}
}

—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub #26, or mute the thread https://github.com/notifications/unsubscribe-auth/AHU6CPtj3Gs82JIggoVk9Lv1G_MEdSgNks5rAxUegaJpZM4K5oIk.

[atvassilev]

PR #31 resolves this.