The Timpson Lyceum seal

The Timpson Lyceum · Computation Theory

Lecture 18 (Computation Theory) Undecidable Problems and Mapping Reducibility

Overview

This lecture turns the informal "reduction" we have been using into a precise tool: mapping reducibility. We first warm up by re-proving that the equality problem for Turing machines is undecidable using a general reduction, then define a computable function and use it to give an exact definition of A≤mBA \le_m B. From this single definition we get a family of transfer theorems: a mapping reduction lets us push decidability, undecidability, recognizability, and unrecognizability between problems. We re-prove the halting problem undecidable as a clean mapping-reduction example, and finish by showing that the equality problem EQTMEQ_{TM} is neither recognizable nor co-recognizable — an entirely new complexity class beyond anything seen so far.

Key Concepts

Reduction (high-level idea). We say AA reduces to BB when any solution to BB yields a solution to AA. The intuition: BB is at least as hard as AA. So if AA is known to be unsolvable, BB must be unsolvable too — because a solution to BB would hand us one for AA. This is exactly why the relation is written with a ≤\le sign.

The standard undecidable problems (reused as the "hard core" we reduce from):

Computable function. A function f:Σ∗→Σ∗f : \Sigma^* \to \Sigma^* is computable if some Turing machine MM, on every input ww, halts with exactly f(w)f(w) written on its tape. Example: squaring is computable — input 66, the machine halts with 3636 on the tape.

Mapping reducibility (the exact definition). A language AA is mapping reducible to a language BB, written A≤mBA \le_m B, if there is a computable function f:Σ∗→Σ∗f : \Sigma^* \to \Sigma^* such that for every string ww, w∈A  ⟺  f(w)∈B.w \in A \iff f(w) \in B. Such an ff is called a reduction from AA to BB. It relabels instances of AA as instances of BB: things in AA map into BB, and things not in AA map outside BB.

The transfer theorems. Once A≤mBA \le_m B via some ff:

Why the directions work. To decide AA given a decider MM for BB and a reduction ff: build NN that on input ww runs MM on f(w)f(w) and copies its answer. Since w∈A  ⟺  f(w)∈Bw \in A \iff f(w) \in B, NN accepts exactly the strings of AA. The recognizer version is identical (replace "decider" with "recognizer"). The upward (undecidable / unrecognizable) versions are the contrapositives.

Complement symmetry. A≤mBA \le_m B is the same statement as A‾≤mB‾\overline{A} \le_m \overline{B} — the same computable ff works, because w∈A  ⟺  f(w)∈Bw \in A \iff f(w) \in B is logically identical to w∉A  ⟺  f(w)∉Bw \notin A \iff f(w) \notin B. This lets us flip a reduction to talk about complements.

Co-recognizable. A language is co-recognizable if its complement is Turing-recognizable. Showing a language is neither recognizable nor co-recognizable places it strictly above ATMA_{TM} (which is recognizable but not decidable) in the hierarchy.

Worked Example

Goal: prove the halting problem is undecidable via a mapping reduction ATM≤mHALTTMA_{TM} \le_m HALT_{TM}.

We construct a computable ff that sends ⟨M,w⟩\langle M, w\rangle to ⟨M′,w⟩\langle M', w\rangle, where M′M' is a new machine that halts on ww exactly when MM accepts ww:

f(⟨M,w⟩)=⟨M′,w⟩,M′ on input x:run M on x; accept if M accepts, else loop forever.\begin{aligned} f(\langle M, w\rangle) &= \langle M', w\rangle, \\ M' \text{ on input } x:\quad &\text{run } M \text{ on } x;\ \text{accept if } M \text{ accepts, else loop forever.} \end{aligned}

Now check the defining equivalence of a mapping reduction:

⟨M,w⟩∈ATM  ⟺  M accepts w  ⟺  M′ halts on w  ⟺  ⟨M′,w⟩∈HALTTM.\begin{aligned} \langle M, w\rangle \in A_{TM} &\iff M \text{ accepts } w \\ &\iff M' \text{ halts on } w \\ &\iff \langle M', w\rangle \in HALT_{TM}. \end{aligned}

Since ff is computable and satisfies ⟨M,w⟩∈ATM  ⟺  f(⟨M,w⟩)∈HALTTM\langle M,w\rangle \in A_{TM} \iff f(\langle M,w\rangle) \in HALT_{TM}, we have ATM≤mHALTTMA_{TM} \le_m HALT_{TM}. Because ATMA_{TM} is undecidable, upward transfer gives that HALTTMHALT_{TM} is undecidable. ■\blacksquare

Second example (reduction map for EQTMEQ_{TM}). To show ETM≤mEQTME_{TM} \le_m EQ_{TM}, define f(⟨M⟩)=⟨M,M∅⟩f(\langle M\rangle) = \langle M, M_\varnothing\rangle, where M∅M_\varnothing is a fixed machine that rejects every input (its start state is also a reject state, so L(M∅)=∅L(M_\varnothing)=\varnothing). Then L(M)=∅  ⟺  L(M)=L(M∅)  ⟺  ⟨M,M∅⟩∈EQTML(M)=\varnothing \iff L(M)=L(M_\varnothing) \iff \langle M, M_\varnothing\rangle \in EQ_{TM}. So ETM≤mEQTME_{TM} \le_m EQ_{TM}, and since ETME_{TM} is undecidable, EQTMEQ_{TM} is undecidable.

Summary