It doesn't need to be. You could equally well have an International Prototype Gram, say, and then (just to make things more confusing, of course) define your base unit, the kilogram, as one thousand times the mass of the IPG.
Why wasn't it done this way originally? Mostly, because history. At the time that the IPK was made, it was easier to do precision manufacturing on the kilogram scale than on the gram scale, so the IPK was built with the best that the cutting-edge technology of the day could provide (said entirely without tongue in cheek: it was an honest-to-goodness technological achievement).
Why aren't we doing it this way now? Because we're not setting up any artifact kilograms at all. The details are detailed in this longer thread, but the upshot is that the kilogram is being redefined by fixing the value of Planck's constant (with standards for length and time assumed as pre-existing dependences). The main mise en pratique as currently envisioned is via Kibble (a.k.a. watt) balances, which means that the Avogadro Project is unlikely to play that big of a role in practical implementations of the new kilogram, i.e. there generally won't be a kilogram-scale object as an ultimate mass reference in most national metrology labs.
However, it's important to note that the Avogadro Project also falls in this scheme: the goal is not to create a new artifact kilogram (which would be just as problematic as the IPK), it is instead to create a reference mass which can be (directly, accurately and stably) traced to the fundamental constants $\hbar$, $N_A$, $c$ and $\Delta \nu(\rm Cs)$. The rough route to doing this looks like this:
First off you make your object. Say, a big shiny sphere manufactured out of a silicon-28 monocrystal.
Then you characterize its volume (which requires a length standard), via optical interferometric techniques.
Then you characterize the lattice constant of the monocrystal via x-ray crystallography, which together with the volume gives you the number of atoms in the sphere.
Then you measure the mass of an individual silicon-28 atom in terms of Planck's constant via recoil spectroscopy (in essence, you take a photon with known wavelength $\lambda$ and therefore known momentum $p=h/\lambda$, and you measure how much of a kick it gives to the atom, which produces a measurable frequency shift proportional to $h/m(^{28}\rm Si)$).
This then gives you the mass of your sphere.
None of the above particularly singles out the one-kilogram scale as special, and neither does it single out silicon (over, say, carbon). If you wanted to repeat the whole process with a twenty-gram synthetic carbon, there's no fundamental definition to stop you ─ only technological hurdles.
So, why aren't we doing this? Because it's expensive, and because the Avogadro Project's main value (or at least, the way I see it) is act as a crucial independent-method test of the accuracy of the results obtained via Kibble-balance methods. Making a twenty-gram diamond is liable to be even more expensive than the Avogadro Project without offering substantially more accuracy, and you need a good reason to go through the whole thing. Wouldn't you rather spend the money on a couple of top-of-the-line watt balances, which offer much more flexibility and which create a framework of technological assets, both material and know-how, that can be used for other things?