It's difficult to say, really. Going by normal genetics, differently colored animals are rare for a reason... but there's really nothing normal about how Pokemon operate, so I can imagine a shiny Caterpie having just as much of a chance as a regular Caterpie even if it stands out more.
[video]