also crimine, 1680s; it looks like Italian crimine "crime" but likely is simply another euphemism for Christ as a swear-word.
Online Etymology Dictionary, © 2010 Douglas Harper
Examples from the Web for criminy
Historical Examples of criminy
"Criminy, the ol' campus sure does look good," said Hugh ecstatically.The Plastic Age