In places with “hard” water (lots of calcium) you tend to get a calcium plaque in the pan after several years. It will absorb any iron in the water and turn brown.

It’s pretty much a rock growing on the porcelain. A brush won’t move it.