The 4 dimensional case contains the 3d, so closed orbits exist if exist in three dimensions. On contrary, if non-closed orbits exist in 3d, there exist obviusly also in 4d. According to Bertrand theorem, the two only potentials that in three dimensions admit stable closed orbits are the the harmonic and the newtonian, so it remains to prove that in dimension 4 these two potential admit non-closed orbits, for simplicity I will do the calculation for the newtonian but the proof for the harmonic is equally simple.
Introducing cylindrical coordinates for $x,y$ and $z,w$ separately the lagrangian becomes:
$$
Lag=m(\dot{r_1}^2+\dot{r_2}^2+r_1^2\dot{\theta_1}^2+r_2^2\dot{\theta_2}^2)/2-V(\sqrt{r_1^2+r_2^2})
$$
or, introducing the angular momenta:
$$
Lag=m(\dot{r_1}^2+\dot{r_2}^2+L_1^2/(m r_1)^2+L_2^2/(m r_2)^2)/2-V(\sqrt{r_1^2+r_2^2})
$$
changin again to cylindrical coordinates ($(r_1,r_2)\to(\rho,\phi),\phi \in (0,\pi/2))$ we have ($L_{complex}=L_1+i L_2=Le^{i \Phi}$):
$$
Lag=m(\dot{\rho}^2+\rho^2\dot{\phi}^2+(\cos^2\Phi/\cos^2\phi+\sin^2\Phi/\sin^2\phi)(L/(m\rho))^2)/2-m k/\rho
$$
by choosing
$$\phi(0)=\arctan{\tan^{2/3}\Phi}=\phi_0,\,\dot{\phi}(0)=0, $$$$ \rho(0)=(1+\tan^{2/3}\Phi)(\cos^2\Phi+\sin^2\Phi/\tan^{4/3}\Phi)L^2/(2 k m^2)=\rho_0,\,\dot{\rho}(0)=0,\,\theta_1(0)=0,\,\theta_2(0)=0$$ we obtains:
$$
x(t)=\rho_0\cos\phi_0\cos(\omega_1 t)
$$
$$
y(t)=\rho_0\cos\phi_0\sin(\omega_1 t)
$$
$$
z(t)=\rho_0\sin\phi_0\cos(\omega_2 t)
$$
$$
w(t)=\rho_0\sin\phi_0\sin(\omega_2 t)
$$
where $\omega_1=L\cos\Phi/(m\cos\phi_0\rho_0^2),\omega_2=L\sin\Phi/(m\sin\phi_0\rho_0^2)$, now if we choose $\Phi$ such that:
$$
\tan \Phi=q\tan\phi_0=q\tan^{2/3}\Phi,\;q\notin \mathbb{Q}
$$
condition that is even less stricter than $\tan\Phi$ irrational.
This is an example of non closed bound orbit. The harmonic case is analog with a different $\rho_0$. This construction is possible for $d\ge 4$ by simply ignoring coordinates. The question at this point is: for non-harmonic or non-newtonian ($1/r$ to be clear) are the stable orbits non-closed for every $d$?