I suspect that certain problems regarding the base 10 representation of natural numbers may be undecidable simply because there's no way to even start.
Take any exponentially growing sequence like $16^n.$ We may ask whether this sequence ever contains a palindrome. If we check the first 100 terms and there's no palindromes, it's unlikely there will ever be. An $m$ digit number where the digits are roughly random has probability $10^{-m/2}$ of being a palindrome, so the probability of at least one palindrome after the first hundred terms is $$\sum_{n \ge 101} 10^{-\log_{10}(16^n)/2} = \sum_{n \ge 101} 4^{-n} < 2^{-200}. \tag{$*$}$$ However, this is not a rigorous proof.
Looking up other simple questions regarding base 10 representations, it seems no one has an idea on how to start, people can only add more and more conjectures to the pile. As a result, the subject doesn't receive serious attention. If we do see someone claim progress of the sort, it's usually a crank writing nonsense.
If this is unprovable, how do we show it's unprovable? For the specific problem of showing there's no palindromes in a fast growing sequence for which we have ruled out enough terms that the probability computed like in $(*)$ of one appearing later on is low, maybe we can emulate a Turing machine within the digits. However, I don't think there's a way to do this with just one base and exponent, maybe $c_1^{p_1} + \dots + c_n^{p_n}$ for polynomials $p_i(x_1, \dots, x_n)$ and $x_i \ge k_i$ could contain enough information inside the digits of the sum.
In the case it turns out that even showing unprovability is unprovable, we get a general hierarchy of unprovability indexed by ordinals where $0$ is the original statement, $\alpha + 1$ is the statement that $\alpha$ is undecidable, and $\lambda$ is the statement that $\lambda_n$ is undecidable for all $n$ where $\lambda = \lim\limits_n \lambda_n$ is a limit ordinal. Can any ordinal be established? The standard remark here is if we show undecidability on any level, the statement is true since if it's false, there's a counterexample (palindrome or other undesired structure appearing), so a proof which consists of stating the counterexample and checking it exists.