The answer is no, but for the weak-field, slow moving, Newtonian limit, the far away light can be thought of as deflected by the mass as concentrated in two dimensions to the Barycenter, when the mass distribution has a spherically symmetric 2d projection.
You can see that The deflection cannot only depend on the Barycenter using two orbiting two black holes. Then the light which is off-center can swing by the black holes and get deflected an enormous amount, while light going through the center mostly goes straight through.
But in the weak field limit, the deflection of light as it passes through a gravitating region is small, and the angular deflection is given by the sum of
$$ \Delta\theta = \sum_i {4GM_i\over c^2R_i} $$
Where $M_i$ is the i-th mass, and R_i is the impact parameter--- the distance of closest approach of the light to the mass. All but the factor of 2 in the formula is simple to derive, and a quick run through is contained in this answer, which has a detailed description of the weak-field bending of light by gravity: How does gravitational lensing account for Einstein's Cross? .
The upshot of the weak field limit is that light is deflected by a collection of nearby compact masses as if all the mass were squashed in a two dimensional sheet perpendicular to the direction of motion, and the light felt an impulsive force equal to the two-dimensional gravitational potential that would be produced by this source.
This means that if light is going in the z-direction, and it passes by a blob of matter, the deflection is according to the projection of that blob of matter to the x-y plane. If this blob of matter is spherically symmetric, a light ray passing through the center is undeflected. The precise deflection at any distance goes as the solution to the 2d Laplace equation, and it can be solved exactly in many circumstances. The linked answer works out many cases.