Difference between revisions of "Termination Competition"

From Termination-Portal.org
Jump to navigationJump to search
(Florian, you deleted you name :))
(35 intermediate revisions by 5 users not shown)
Line 2: Line 2:
  
 
During the 90's a number of new, powerful termination methods
 
During the 90's a number of new, powerful termination methods
was developed. Thus, at the the beginning of the millennium
+
was developed. Thus, at the beginning of the millennium
 
many research groups started to develop [[:Category:Tools | tools for fully-automated termination analysis]].
 
many research groups started to develop [[:Category:Tools | tools for fully-automated termination analysis]].
  
After a tool demonstration at the 2003 [[WST|Workshop on Termination]] in Valencia,
+
After a tool demonstration at the Termination Workshop 2003 (Valencia),
the community decided to install an annual termination competition
+
the community then decided to install an annual termination competition, and to collect benchmarks,
 
to spur the development of tools and new termination techniques.
 
to spur the development of tools and new termination techniques.
 +
 +
== Upcoming Competitions ==
 +
 +
* The [[Termination Competition 2022]] will be affiliated with [https://easychair.org/smart-program/FLoC2022/IJCAR-index.html IJCAR 2022] and it will be part of the Olympic Games at the Federated Logic Conference [https://www.floc2022.org/floc-olympic-games FLoC 2022].
 +
 +
== Organization ==
 +
 +
Questions and suggestions regarding the competition
 +
should go to [[Termtools|the termtools mailing list]].
 +
Discussion is open and happens primarily on the list.
 +
Decisions will be made by votes among the [[Termination Competition Steering Committee]], with current members
 +
* [https://ffrohn.github.io Florian Frohn], RWTH Aachen
 +
* [https://verify.rwth-aachen.de/giesl/ Jürgen Giesl], RWTH Aachen
 +
* [http://cl-informatik.uibk.ac.at/users/georg/ Georg Moser], University of Innsbruck
 +
* [https://www.cs.upc.edu/~albert/ Albert Rubio],  Complutense University of Madrid
 +
* [https://group-mmm.org/~ayamada/ Akihisa Yamada] (Chair), AIST Tokyo Waterfront
  
 
From 2004 till 2007, the competition organizer was Claude Marché, [http://www.lri.fr/~marche/termination-competition/ Paris].
 
From 2004 till 2007, the competition organizer was Claude Marché, [http://www.lri.fr/~marche/termination-competition/ Paris].
 
From 2008 to 2013 the competition was run by René Thiemann, [http://termcomp.uibk.ac.at Innsbruck].
 
From 2008 to 2013 the competition was run by René Thiemann, [http://termcomp.uibk.ac.at Innsbruck].
Since 2014, the competition organizer is Johannes Waldmann. Jobs are run on the [https://www.starexec.org/ Star Exec] platform at U Iowa. Results are aggregated and displayed at [http://nfa.imn.htwk-leipzig.de/termcomp/competition/20 HTWK Leipzig].
+
From 2014 to 2017, the competition organizer was Johannes Waldmann. Jobs were run on the [https://www.starexec.org/ Star Exec] platform at U Iowa.
 
+
From 2018 on, the organizer is Akihisa Yamada. Jobs are run on Star-Exec.
== Upcoming Competitions ==
 
 
 
The [[Termination_Competition_2016|Termination Competition 2016]] will be affiliated with [http://cl-informatik.uibk.ac.at/events/wst-2016/ WST (Workshop on Termination)].
 
  
 
== Competition Categories ==
 
== Competition Categories ==
Line 28: Line 41:
 
* [[Higher_Order|termination of higher order rewriting]] (since 2010)
 
* [[Higher_Order|termination of higher order rewriting]] (since 2010)
 
* [[C_Programs|termination of C programs]] (since 2014)
 
* [[C_Programs|termination of C programs]] (since 2014)
* [[termination of integer transition systems]] (since 2014)
+
* termination of [[Transition_Systems|integer transition systems]] (since 2014)
 
* [[ITRS|integer term rewriting]] (since 2014)
 
* [[ITRS|integer term rewriting]] (since 2014)
 
* [[C_Integer_Programs|termination of C integer programs]]
 
* [[C_Integer_Programs|termination of C integer programs]]
 
* [[Cycle_Rewriting|termination of cycle rewriting]]
 
* [[Cycle_Rewriting|termination of cycle rewriting]]
 
Planned extensions for 2016:
 
 
 
 
Discussion is open and primarily happens on the termtools mailing list.
 
Decisions will be made by votes among the [[Termination Competition Steering Committee]].
 
  
 
== Termination Problems Data Base ==
 
== Termination Problems Data Base ==
Line 50: Line 56:
 
The following competitions have taken place:
 
The following competitions have taken place:
  
* [[Termination Competition 2015]], [http://nfa.imn.htwk-leipzig.de/termcomp-2015/competitions/4 Results of Competition], [http://www.cs.upc.edu/~albert/papers/termCompCADE2015.pdf Description paper at CADE-25] [http://www.cs.upc.edu/~albert/papers/termcomp2015_slides.pdf Report]
+
* [[Termination Competition 2021]] affiliated with [http://www.cs.cmu.edu/~mheule/CADE28/ CADE 2021], [https://termcomp.github.io/Y2021/ Results].
* [[Termination Competition 2014]], [http://nfa.imn.htwk-leipzig.de/termcomp/competition/20 Results of Competition], [http://nfa.imn.htwk-leipzig.de/termcomp/competition/23 Results of Demonstration]
+
* [[Termination Competition 2020]] affiliated with [https://ijcar2020.org/ IJCAR 2020], [https://termcomp.github.io/Y2020/ Results].
 +
* [[Termination Competition 2019]] affiliated with [https://tacas.info/toolympics.php Toolympics at TACAS 2019], [https://termcomp.github.io/Y2019/ Results].
 +
* [[Termination Competition 2018]] affiliated with FLoC 2018, Oxford, UK, July 13, 2018, [https://termcomp.github.io/Y2018/ Results].
  
*  [[Termination Competition 2013]], [http://termcomp.uibk.ac.at/termcomp/competition/competitionSummary.seam?comp=437763 Results][http://termcomp.uibk.ac.at/2013/competition2013.pdf Report]
+
* [[Termination_Competition_2017|Termination Competition 2017]] affiliated with [http://www.cs.ox.ac.uk/conferences/fscd2017/ FSCD], [http://termcomp.imn.htwk-leipzig.de/competitions/Y2017 Results of Competition], [http://termcomp.imn.htwk-leipzig.de/competitions/67 Results of demonstration].
 +
 
 +
* [[Termination_Competition_2016|Termination Competition 2016]] affiliated with [http://cl-informatik.uibk.ac.at/events/wst-2016/ WST (Workshop on Termination)], [http://termcomp.imn.htwk-leipzig.de/competitions/Y2016 Results of Competition]. [http://www.cs.upc.edu/~albert/papers/termcomp2016_slides.pdf Presentation at WST]
 +
 
 +
* [[Termination Competition 2015]], [http://termcomp.imn.htwk-leipzig.de/competitions/Y2015 Results of Competition], [http://www.cs.upc.edu/~albert/papers/termCompCADE2015.pdf Description paper at CADE-25] [http://www.cs.upc.edu/~albert/papers/termcomp2015_slides.pdf Report]
 +
 
 +
* [[Termination Competition 2014]], [http://termcomp.imn.htwk-leipzig.de/competitions/Y2014 Results of Competition], [http://nfa.imn.htwk-leipzig.de/termcomp/competition/23 Results of Demonstration]
 +
 
 +
*  [[Termination Competition 2013]], [http://termcomp.uibk.ac.at/termcomp/competition/competitionSummary.seam?comp=437763 Results], [http://termcomp.uibk.ac.at/2013/competition2013.pdf Report]
  
 
*  [[Termination Competition 2012]], [http://termcomp.uibk.ac.at/termcomp/competition/competitionSummary.seam?comp=362062 Results], [http://verify.rwth-aachen.de/giesl/competition2012.pdf Report]
 
*  [[Termination Competition 2012]], [http://termcomp.uibk.ac.at/termcomp/competition/competitionSummary.seam?comp=362062 Results], [http://verify.rwth-aachen.de/giesl/competition2012.pdf Report]
Line 68: Line 84:
 
* [http://www.lri.fr/~marche/termination-competition/2005/ Termination Competition 2005], [http://www.lri.fr/~marche/termination-competition/2005/TC.ppt Report]
 
* [http://www.lri.fr/~marche/termination-competition/2005/ Termination Competition 2005], [http://www.lri.fr/~marche/termination-competition/2005/TC.ppt Report]
 
* [http://www.lri.fr/~marche/termination-competition/2004/ Termination Competition 2004], [http://www.lri.fr/~marche/termination-competition/2004/slides-1jun2004.ps Report]
 
* [http://www.lri.fr/~marche/termination-competition/2004/ Termination Competition 2004], [http://www.lri.fr/~marche/termination-competition/2004/slides-1jun2004.ps Report]
 +
 +
At the "tool demonstration" in 2003, participating provers (including AProVe, Torpa, Matchbox)
 +
were run on the laptop computers of their developers in the room. Termination problems were announced
 +
on the spot by participants, then written on the blackboard, then typed in by everyone, and when a team's program
 +
could solve it, they shouted "solved".
 +
 +
== Static Backups of Results ==
 +
 +
For many previous competitions, static backups of the results are available [https://aprove-developers.github.io/termcomp_results/ here].

Revision as of 06:00, 17 June 2022

Annual International Termination Competition

During the 90's a number of new, powerful termination methods was developed. Thus, at the beginning of the millennium many research groups started to develop tools for fully-automated termination analysis.

After a tool demonstration at the Termination Workshop 2003 (Valencia), the community then decided to install an annual termination competition, and to collect benchmarks, to spur the development of tools and new termination techniques.

Upcoming Competitions

Organization

Questions and suggestions regarding the competition should go to the termtools mailing list. Discussion is open and happens primarily on the list. Decisions will be made by votes among the Termination Competition Steering Committee, with current members

From 2004 till 2007, the competition organizer was Claude Marché, Paris. From 2008 to 2013 the competition was run by René Thiemann, Innsbruck. From 2014 to 2017, the competition organizer was Johannes Waldmann. Jobs were run on the Star Exec platform at U Iowa. From 2018 on, the organizer is Akihisa Yamada. Jobs are run on Star-Exec.

Competition Categories

Currently, the competition features the following categories:

Termination Problems Data Base

The Termination Problems Data Base collects all the problems used in the competitions.

We welcome problem submissions from non-participants.

History of Termination Competitions

The following competitions have taken place:

At the "tool demonstration" in 2003, participating provers (including AProVe, Torpa, Matchbox) were run on the laptop computers of their developers in the room. Termination problems were announced on the spot by participants, then written on the blackboard, then typed in by everyone, and when a team's program could solve it, they shouted "solved".

Static Backups of Results

For many previous competitions, static backups of the results are available here.