The first paragraph is incorrect. We do not expect white dwarf progenitors to have iron cores. The majority will have cores of degenerate carbon and oxygen.
The story of white dwarf cooling is as follows:
White dwarfs are "born" with interior temperatures of a few $10^{7}$ K (and if hotter, then neutrino losses ensure they cool to this temperature on timescales of a million years). Their interiors are approximately isothermal (degenerate electrons have a long mean free path, hence thermal conduction is highly effective) and contain thermal energy only in the non-degenerate carbon and oxygen nuclei (the degenerate electrons have essentially zero heat capacity). If the nuclei behaved as an ideal gas (with heat capacity $3k_B/2$ per ion, we can see that a $\sim 1 M_{\odot}$ white dwarf contains of order $10^{41}$ J of thermal energy. It is this that makes them "shine" as this thermal energy is gradually radiated into space.
To get out of the white dwarf interior, this energy must be transferred across a thin, non-degenerate layer at their surfaces. This acts like an insulating blanket and restricts the energy flow, that is mainly due to radiative diffusion. Calculations and models suggest that the effective surface temperature of a white dwarf is a factor of $\sim 100$ less than the interior as a result.
When they are "born" white dwarfs have surface temperatures of $\sim 100,000$ K. This radiates across the whole visible spectrum and our eyes would perceive this as a blue-ish-white. Even after a billion years, the surface temperature would be of order 10,000 K and the white dwarf would still appear white.
The cooling rate of a white dwarf slows down drastically with age because it turns out that the luminosity is proportional to the interior temperature to the power of 3.5 (and surface temperature to the power of 4). This means it takes many billions of years to cool to temperatures where the white dwarf surface might appear yellow or orange. In addition, the interior of a white dwarf crystallises as it cools, and this (i) increases the heat capacity to $3k_B$ per ion and (ii) releases latent heat of crystallisation; both of which significantly delay the white dwarf cooling further.
The coolest (and hence oldest) isolated white dwarfs in our Galaxy have luminosities of $10^{-5} L_{\odot}$ and radii of about 5000 km. A quick blackbody calculation suggests surface temperatures of 3800 K - which might appear vaguely reddish to the eye.
In fact there maybe some cooler, massive white dwarfs in the Galaxy. Theoretically, there may be isolated white dwarfs formed up to about $1.1M_{\odot}$ and white dwarfs in binary systems may accrete mass and grow to about $1.38 M_{\odot}$ (before exploding as type Ia supernovae or collapsing - see below). These can cool more quickly - their higher interior densities (more massive white dwarfs are smaller and much denser) mean that their interior temperatures can fall below the Debye temperature of their extremely dense ($\geq 10^{12}$ kg/m$^3$) crystalline interiors. Their heat capacity then falls rapidly with temperature and they can quickly fade out of sight. An example that may only have a surface temperature of 3000K has recently been found in a binary system with a pulsar.
Some representative cooling curves are shown below (from Althaus et al. 2010) that illustrate these arguments. It seems quite likely that there could be white dwarfs out there that are essentially invisible in the visible spectrum, but these would likely have to be very massive ($1.2<M/M_{\odot}<1.38$) companions to other stars.

It is highly unlikely that most white dwarfs will turn into neutron stars. They will just cool at almost constant radius, since the electron degeneracy pressure that supports them is independent of temperature. However, if they were to accrete matter, such that they eventually exceed their Chandrasekhar masses, they will become unstable (actually this takes place before the "classic Chandrasekhar mass" because of GR and inverse beta decay) and they could collapse. The outcome could be a type Ia thermonuclear supernova detonation that blows the white dwarf apart, but it might be possible in some circumstances to have an accretion induced collapse to a neutron star.