termcomp / starexec-master Goto Github PK

View Code? Open in Web Editor NEW

4.0 4.0 15.0 2.83 MB

PHP 93.38% Shell 0.78% CSS 3.41% HTML 0.21% JavaScript 1.96% Dockerfile 0.25%

starexec-master's People

Contributors

Stargazers

Watchers

Forkers

jesusjda jwaldmann etiennepayet heizmann mthark ffrohn dieterhofbauer akihisayamada hezzel aprove-developers raulgut keigoi dio4ev j-c-kassing hiroshi-unno

starexec-master's Issues

KoAT & MuVal vs. LoAT conflict

https://termcomp.github.io/Y2023-1/Integer_Transition_Systems.html?filter1=c

@ffrohn @nilslommen @hiroshi-unno There is one case where KoAT and MuVal agree but LoAT doesn't. Analysis please!

Conflict in TRS Relative

https://termcomp.herokuapp.com/Y2023/TRS_Relative.html?filter1=c

conflict in C Integer

@nilslommen @juergengiesl @hiroshi-unno Please discuss!
https://termcomp.herokuapp.com/Y2023/C_Integer.html?filter1=c

Ultimate not working?

@Heizmann could you check if ultimate is working?

https://termcomp.herokuapp.com/Y2023/C.html

I suspect the JRE must be combined into the uploaded zip.

MuVal contradiction in C Integer

@hiroshi-unno I still observe MuVal self conflict on
https://termcomp.github.io/tpdb.html?ver=11.3&path=C_Integer%2FStroeder_15%2FChawdharyCookGulwaniSagivYang-ESOP2008-aaron12_true-termination.c

This is skeptical MuVal NO job: https://www.starexec.org/starexec/secure/details/pair.jsp?id=615216726

MuVal RL YES: https://www.starexec.org/starexec/secure/details/pair.jsp?id=615216727

AProVE's YES: https://www.starexec.org/starexec/secure/details/pair.jsp?id=615216725

cannot view prover output from results tables ( Failed to open stream: HTTP request failed! )

e.g. https://termcomp.verify.rwth-aachen.de/Y2024/TRS_Relative.html

links in that page are not working, example: https://www.starexec.org/starexec/services/jobs/pairs/629618913/stdout/1?limit=-1 "not available"

perhaps related, the page shows this at the top:

copy(https://www.starexec.org/starexec/secure/download?type=job&id=63716&returnids=true&getcompleted=false):
Failed to open stream: HTTP request failed! HTTP/1.1 400 400
copy(https://www.starexec.org/starexec/secure/download?type=job&id=63742&returnids=true&getcompleted=false):
Failed to open stream: HTTP request failed! HTTP/1.1 400 400

Conflict in C Integer

https://termcomp.herokuapp.com/Y2023/C_Integer.html?filter0=Stroeder_15/ChawdharyCookGulwaniSagivYang-ESOP2008-aaron12_true-termination.c

SRS-Std cert TTT2 postprocessor error (time-out for matchbound certificate?)

happens several time, e.g., https://www.starexec.org/starexec/services/jobs/pairs/615281563/log

starexec says this is a time-out (45 min) for ceta

for the same benchmark in uncert, ttt2 outputs a matchbound certificate.

perhaps it's similar to jwaldmann/ceta-postproc#25

[EDIT] same error happened in termcomp22

KoAT is inaccessible

@nilslommen Please make KoAT accessible from me, e.g. by linking it in a public space.

NTI logic programming issue

For the following benchmarks, NTI outputs 'MAYBE' instead of 'NO' because an exception is thrown (java.lang.UnsupportedOperationException):

Logic_Programming/BCGGV05/flat-fb.pl
Logic_Programming/BCGGV05/mergesort.pl
Logic_Programming/BCGGV05/permutation-fb.pl
Logic_Programming/BCGGV05/reverse-fb.pl
Logic_Programming/BCGGV05/slowsort-fb.pl
Logic_Programming/lpexamples/mergesort-oi.pl
Logic_Programming/SGST06/transpose2.pl
Logic_Programming/talp_apt/quicksort-oi.pl
Logic_Programming/talp_talp/slowsort-oi.pl

During last year's competition, NTI was able to disprove termination of these benchmarks. There is something weird here, because I did not modify the code that finds a non-termination witness for them.

I just rebuilt the executable jar file, and the problem was solved...

conflicts in ITS

http://termcomp.herokuapp.com/Y2023/Integer_Transition_Systems.html?filter1=c

@hiroshi-unno it seems at least one config of MuVal is buggy. Please check :)

AProVE is unsound on variable lhs

Pointed by @jwaldmann.

REJECT in SRS-Relative (certified) for matchbox

https://www.starexec.org/starexec/services/jobs/pairs/615271002/log

yeah of course this does not work:

error when applying the rule removal technique on 
rules: 
a(b(a(b(a(x))))) -> b(x) 
relative rules: 
x ->= a(a(b(b(x)))) 

to remove the rules 
a(b(a(b(a(x))))) -> b(x) 
x -> a(a(b(b(x))))

the rule x ->= ... cannot be removed, and it does not have to, to show relative termination. Must be some error in my proof output. I wonder why it does not happen more often.

After renaming modulo the bijection { a â†¦ 0, b â†¦ 1 },
  it remains to prove termination of the 1-rule system (1 strict rule)
{ 0 0 1 1 âŸ¶ 1 1 1 0 0 0 }

How it should look like:

After renaming modulo the bijection { a ↦ 0, b ↦ 1 },
  it remains to prove termination of the 1-rule system (1 strict rule)
{ 0 0 1 1 ⟶ 1 1 1 0 0 0 }

Conflict in ITS

@ffrohn @hiroshi-unno analysis please:

https://termcomp.herokuapp.com/Y2023/Integer_Transition_Systems.html?filter1=c

failed to copy ...

Hi, I am seeing

failed to copy https://www.starexec.org/starexec/secure/download?type=job&id=41485&returnids=true&getcompleted=false to /app/fromStarExec/FM3SX1

for http://termcomp2020.herokuapp.com/job_41485.html
and the overview page looks strange (the formatting is there, but no data)

CeTA version (for 2022)?

Will you use CeTA-2.42 (released recently)? René sped up the parser significantly, cf. jwaldmann/ceta-postproc#24 (comment)