I am going to give you some basic things you should consider as a couple of hints. I think proving the invariance in a rigorous way would be clearer and probably trivial after making the following correspondences.
First of all in mathematics, a principal $G$-bundle on a manifold, $\mathcal{M}$, is a fiber bundle, $\pi : P\rightarrow \mathcal{M}$, associated with a group action, $G \times P \rightarrow P$, that preserves the fibers. So, a point $p \in P_x$ should map to a point $gp \in P_x$ in the same fiber.
In terms of your question, the group is $SO(1,3)$, the manifold is the flat Minkowski spacetime, $\mathbb{R}^{1+3}$, and the group transformation is the Lorentz transformations. In your case, the fiber over a point $x \in \mathcal{M}$ could be regarded as the set of all frames (i.e. ordered bases) for the tangent space, $T_x \mathcal{M}$.
A vector, $A_\mu (x)$, on the manifold should transform by the transformation,
$$
A_\mu (x) \mapsto \Lambda_\mu^\nu (x) \, A_\nu (x)
$$
where $\Lambda (x)$ is the Lorentz transformation, but the frame fibers, i.e. the frames, should be preserved.
If the question were about the gauge transformations, instead of Lorentz transformations, then the group associated with the principal bundle would be $U(1)$ symmetry group and each fiber at a point would be the set of all phase configurations (i.e., a smooth real function), and the transformation would be as follows:
$$
A_\mu (x) \mapsto A_\mu (x) - \partial_\mu \theta (x)
$$
where $\theta (x)$ is the phase parameter. Also here $A_\mu (x)$ would be the connection, and $F_{\mu\nu} (x)$ would be the curvature (since $F=dA$).