Exeter's whimsical "fish barn" sparked controversy, then was demolished. Here's why.