There is a nice paper on this topic by Riazuelo, http://arxiv.org/abs/1511.06025 . The following are three simulated images I produced using some open-source software I wrote. I also produced a video showing the motion, with a little bit of didactic text and some spooky space music. My images seem to match up pretty well with Riazuelo's simulations. All of these are the simulated views of an observer who free-falls into a Schwarzschild black hole, starting from rest at infinity. In these simulated wide-angle panoramas, the black hole is to the left, and to the right you can see the constellation Orion. The bluish star Rigel (Orion's "foot") is directly above us, but we can still see it in the same frame as the black hole because the field of view is greater than 180 degrees.
This image is constructed for the time when the observer is at a radius equal to three times the Schwarzschild radius:

The most obvious optical effect is that there are many stars that look bright and blue-shifted close to the silhouette formed by the black hole's event horizon. Qualitatively, this is the same thing you would see based on special relativity if you were simply flying through outer space at relativistic speeds. Doppler shifts affect both wavelength and intensity. Relativistic aberration alters the direction from which rays appear to arrive, so stuff crowds in to the part of the field of view in the direction of motion (in this example, near the black hole).
This image is after you've passed through the horizon and are at a radius equal to half the Schwarzschild radius:

The effects look qualitatively the same. The black hole appears to cover less than 180 degrees of our field of view, but this is because of aberration. Stars like Rigel are very dim due to Doppler shifts.
Here is an image from shortly before you hit the singularity:

The very bright ring is from stars that are mostly quite dim in reality, but because of the angles they're at, their light gets Doppler shifted to very high intensities. The significant width of the ring is just an artifact of the way my software tries to visually represent high intensities.
In the limit as you approach the singularity, this ring moves to occupy an apparent great circle, i.e., the images of the interior and exterior universe each cover exactly half of your field of view.
I exchanged emails with Riazuelo, who pointed me to this lecture (in French), which shows several animations that he made. My poor ability at understanding spoken French makes it difficult for me to understand exactly what all the different videos are, but I think there are some animations of radial infall starting at 1:18. The one at 46 minutes looks like a demonstration of special relativistic acceleration, with no black hole. At 1:01 it looks like the observer is in an elliptical orbit around a black hole.
Riccardo Antonelli has created two open-source software projects for this purpose: starless and schwarzschild.