Difference between revisions of "Termination Competition"

From Termination-Portal.org
Jump to navigationJump to search
(Added explanations for each of the category types)
(Added Link to new TRS Standard category page)
 
(One intermediate revision by the same user not shown)
Line 12: Line 12:
  
 
* The [[Termination Competition 2025]] will be held during [https://www.imn.htwk-leipzig.de/WST2025/ WST 2025], September 3-4, Leipzig, Germany.
 
* The [[Termination Competition 2025]] will be held during [https://www.imn.htwk-leipzig.de/WST2025/ WST 2025], September 3-4, Leipzig, Germany.
 
== Organization ==
 
 
Questions and suggestions regarding the competition
 
should go to [[Termtools|the termtools mailing list]].
 
Discussion is open and happens primarily on the list.
 
Decisions will be made by votes among the [[Termination Competition Steering Committee]], with current members
 
* [https://ffrohn.github.io Florian Frohn] (Chair), RWTH Aachen
 
* [https://verify.rwth-aachen.de/giesl/ Jürgen Giesl], RWTH Aachen
 
* [http://cl-informatik.uibk.ac.at/users/georg/ Georg Moser], University of Innsbruck
 
* [http://lim.univ-reunion.fr/staff/epayet/ Étienne Payet], Université de La Réunion
 
* [https://group-mmm.org/~ayamada/ Akihisa Yamada], AIST Tokyo Waterfront
 
* Dieter Hofbauer, ASW Saarland
 
 
From 2004 till 2007, the competition organizer was Claude Marché, [http://www.lri.fr/~marche/termination-competition/ Paris].
 
From 2008 to 2013 the competition was run by René Thiemann, [http://termcomp.uibk.ac.at Innsbruck].
 
From 2014 to 2017, the competition organizer was Johannes Waldmann. Jobs were run on the [https://www.starexec.org/ Star Exec] platform at U Iowa.
 
From 2018 to 2023, the organizer was Akihisa Yamada.
 
From 2024 on, the organizer is Florian Frohn.
 
  
 
== Competition Categories ==
 
== Competition Categories ==
Line 43: Line 24:
  
 
<div style="column-count:3; column-gap:2em;">
 
<div style="column-count:3; column-gap:2em;">
* [[Term Rewriting#TRS Standard|TRS Standard]]
+
* [[TRS Standard|TRS Standard]]
 
* [[Term Rewriting#TRS Relative|TRS Relative]]
 
* [[Term Rewriting#TRS Relative|TRS Relative]]
 
* [[Term Rewriting#TRS Contextsensitive|TRS Contextsensitive]]
 
* [[Term Rewriting#TRS Contextsensitive|TRS Contextsensitive]]
Line 111: Line 92:
 
</div>
 
</div>
  
== Termination Problems Data Base ==
+
== Competition Benchmarks ==
  
 
The [[TPDB|Termination Problems Data Base]] collects all the problems used in the competitions.  
 
The [[TPDB|Termination Problems Data Base]] collects all the problems used in the competitions.  
Line 117: Line 98:
 
We welcome problem submissions from non-participants.
 
We welcome problem submissions from non-participants.
  
== History of Termination Competitions ==
+
== Organization ==
  
The following competitions have taken place:
+
Questions and suggestions regarding the competition
 +
should go to [[Termtools|the termtools mailing list]].
 +
Discussion is open and happens primarily on the list.
 +
Decisions will be made by votes among the [[Termination Competition Steering Committee]], with current members
 +
* [https://ffrohn.github.io Florian Frohn] (Chair), RWTH Aachen
 +
* [https://verify.rwth-aachen.de/giesl/ Jürgen Giesl], RWTH Aachen
 +
* [http://cl-informatik.uibk.ac.at/users/georg/ Georg Moser], University of Innsbruck
 +
* [http://lim.univ-reunion.fr/staff/epayet/ Étienne Payet], Université de La Réunion
 +
* [https://group-mmm.org/~ayamada/ Akihisa Yamada], AIST Tokyo Waterfront
 +
* Dieter Hofbauer, ASW Saarland
  
* [[Termination Competition 2025]] affiliated with [https://www.imn.htwk-leipzig.de/WST2025/ WST 2025], [https://termcomp.github.io/Y2025/ Results].
+
From 2004 till 2007, the competition organizer was Claude March&eacute;, [http://www.lri.fr/~marche/termination-competition/ Paris].
* [[Termination Competition 2024]] affiliated with [https://merz.gitlabpages.inria.fr/2024-ijcar/ IJCAR 2024], [https://termcomp.github.io/Y2024/ Results].
+
From 2008 to 2013 the competition was run by Ren&eacute; Thiemann, [http://termcomp.uibk.ac.at Innsbruck].
* [[Termination Competition 2023]] affiliated with [[WST2023]], [https://termcomp.github.io/Y2023/ Results].
+
From 2014 to 2017, the competition organizer was Johannes Waldmann. Jobs were run on the [https://www.starexec.org/ Star Exec] platform at U Iowa.
* [[Termination Competition 2022]] affiliated with [https://easychair.org/smart-program/FLoC2022/IJCAR-index.html IJCAR 2022], [https://termcomp.github.io/Y2022/ Results].
+
From 2018 to 2023, the organizer was Akihisa Yamada.
* [[Termination Competition 2021]] affiliated with [http://www.cs.cmu.edu/~mheule/CADE28/ CADE 2021], [https://termcomp.github.io/Y2021/ Results].
+
From 2024 on, the organizer is Florian Frohn.
* [[Termination Competition 2020]] affiliated with [https://ijcar2020.org/ IJCAR 2020], [https://termcomp.github.io/Y2020/ Results].
 
* [[Termination Competition 2019]] affiliated with [https://tacas.info/toolympics.php Toolympics at TACAS 2019], [https://termcomp.github.io/Y2019/ Results].
 
* [[Termination Competition 2018]] affiliated with FLoC 2018, Oxford, UK, July 13, 2018, [https://termcomp.github.io/Y2018/ Results].
 
  
* [[Termination_Competition_2017|Termination Competition 2017]] affiliated with [http://www.cs.ox.ac.uk/conferences/fscd2017/ FSCD], [http://termcomp.imn.htwk-leipzig.de/competitions/Y2017 Results of Competition], [http://termcomp.imn.htwk-leipzig.de/competitions/67 Results of demonstration].
+
== History of Termination Competitions ==
 
 
* [[Termination_Competition_2016|Termination Competition 2016]] affiliated with [http://cl-informatik.uibk.ac.at/events/wst-2016/ WST (Workshop on Termination)], [http://termcomp.imn.htwk-leipzig.de/competitions/Y2016 Results of Competition]. [http://www.cs.upc.edu/~albert/papers/termcomp2016_slides.pdf Presentation at WST]
 
 
 
* [[Termination Competition 2015]], [http://termcomp.imn.htwk-leipzig.de/competitions/Y2015 Results of Competition], [http://www.cs.upc.edu/~albert/papers/termCompCADE2015.pdf Description paper at CADE-25] [http://www.cs.upc.edu/~albert/papers/termcomp2015_slides.pdf Report]
 
 
 
* [[Termination Competition 2014]], [http://termcomp.imn.htwk-leipzig.de/competitions/Y2014 Results of Competition], [http://nfa.imn.htwk-leipzig.de/termcomp/competition/23 Results of Demonstration]
 
 
 
*  [[Termination Competition 2013]], [http://termcomp.uibk.ac.at/termcomp/competition/competitionSummary.seam?comp=437763 Results], [http://termcomp.uibk.ac.at/2013/competition2013.pdf Report]
 
 
 
*  [[Termination Competition 2012]], [http://termcomp.uibk.ac.at/termcomp/competition/competitionSummary.seam?comp=362062 Results], [http://verify.rwth-aachen.de/giesl/competition2012.pdf Report]
 
 
 
*  [[Termination Competition 2011]], [http://termcomp.uibk.ac.at/termcomp/competition/competitionSummary.seam?comp=230715 Results], [http://termcomp.uibk.ac.at/2011/competition2011.pdf Report]
 
 
 
*  [[Termination Competition 2010]], [http://termcomp.uibk.ac.at/termcomp/competition/competitionSummary.seam?comp=185404 Results]
 
 
 
*  Termination Competition 2009 [http://termcomp.uibk.ac.at/termcomp/competition/competitionSummary.seam?comp=101722 Results], [http://lists.lri.fr/pipermail/termtools/2009-November/000778.html Announcement]
 
 
 
* [[Termination_Competition_2008|Termination Competition 2008]], [http://termcomp.uibk.ac.at/termcomp/competition/competitionSummary.seam?comp=15991 Results], [http://www.imn.htwk-leipzig.de/~waldmann/talk/09/wst/ Report]
 
* [http://www.lri.fr/~marche/termination-competition/2007/ Termination Competition 2007], [http://www.imn.htwk-leipzig.de/~waldmann/talk/07/wst/competition/ Report]
 
* [http://www.lri.fr/~marche/termination-competition/2006/ Termination Competition 2006], [http://www.lri.fr/~marche/termination-competition/2006/reportCompetition2006.pdf Report]
 
* [http://www.lri.fr/~marche/termination-competition/2005/ Termination Competition 2005], [http://www.lri.fr/~marche/termination-competition/2005/TC.ppt Report]
 
* [http://www.lri.fr/~marche/termination-competition/2004/ Termination Competition 2004], [http://www.lri.fr/~marche/termination-competition/2004/slides-1jun2004.ps Report]
 
  
At the "tool demonstration" in 2003, participating provers (including AProVe, Torpa, Matchbox)
+
A list of all competitions that have been taken place can be found [[Termination Competition History|here]].
were run on the laptop computers of their developers in the room. Termination problems were announced
 
on the spot by participants, then written on the blackboard, then typed in by everyone, and when a team's program
 
could solve it, they shouted "solved".
 
  
== Results ==
+
==== Results ====
  
 
The results of (almost) all competitions are available [https://termcomp.github.io/ here]
 
The results of (almost) all competitions are available [https://termcomp.github.io/ here]

Latest revision as of 09:31, 9 March 2026

Annual International Termination Competition

During the 90's a number of new, powerful termination methods was developed. Thus, at the beginning of the millennium many research groups started to develop tools for fully-automated termination analysis.

After a tool demonstration at the Termination Workshop 2003 (Valencia), the community then decided to install an annual termination competition, and to collect benchmarks, to spur the development of tools and new termination techniques.

Upcoming Competitions

Competition Categories

Currently, the competition features the following categories. Since 2007 some of the categories also have certified categories, where an additional certifier checks the output of the tools. Categories that were used in the past but not included in the three most recent competitions are marked with an .

Termination of Rewriting

These categories consider the termination of rewrite systems, a foundational computational model used to represent symbolic computation and program transformations. The goal is to automatically prove that no infinite rewrite sequences are possible for the given system. Different categories capture variations of rewriting such as relative rewriting, context-sensitive rewriting, conditional rules, or restrictions on the rewriting strategy (e.g., innermost or outermost rewriting).

Termination of Probabilistic Rewriting

These categories address probabilistic rewrite systems , where rewrite rules are applied according to probability distributions. Instead of classical termination, the goal is to prove almost-sure termination, i.e., that infinite executions occur with probability zero, or strong almost-sure termination, i.e., that the expected runtime is finite. This lifts termination analysis to models that capture randomized algorithms or stochastic behavior.

Currently, there are only categories regarding probabilistic rewrite systems, but an extension to probabilistic imperative programs may be possible in future competitions.

Termination of Programs

These categories focus on proving termination of actual programming languages used in industry. The categories differ by the source programming language or program model.

Complexity of Rewriting

These categories evaluate tools that automatically analyze the asymptotic complexity of rewrite systems . Instead of only proving termination, the goal is to derive upper bounds on the length of rewrite sequences, typically expressed as functions of the input size. Different categories measure difference runtime complexities under various rewriting strategies and different restrictions on the initial start term.

Complexity Analysis

These categories focus on automatically determining time complexity bounds for programs written in concrete programming languages . Tools analyze the program’s control flow, data dependencies, and loops to derive asymptotic upper bounds on runtime with respect to the input size.

Competition Benchmarks

The Termination Problems Data Base collects all the problems used in the competitions.

We welcome problem submissions from non-participants.

Organization

Questions and suggestions regarding the competition should go to the termtools mailing list. Discussion is open and happens primarily on the list. Decisions will be made by votes among the Termination Competition Steering Committee, with current members

From 2004 till 2007, the competition organizer was Claude Marché, Paris. From 2008 to 2013 the competition was run by René Thiemann, Innsbruck. From 2014 to 2017, the competition organizer was Johannes Waldmann. Jobs were run on the Star Exec platform at U Iowa. From 2018 to 2023, the organizer was Akihisa Yamada. From 2024 on, the organizer is Florian Frohn.

History of Termination Competitions

A list of all competitions that have been taken place can be found here.

Results

The results of (almost) all competitions are available here