The Rakokivet caves were formed between group of granite, mica gneiss and veined gneiss boulders leaning against one another when the boulders split and cracked into smaller parts. The cave system contains three clearly cave-like spaces, as well as nooks and crevices formed between the smaller boulders. The boulders were glacially transported to their current place around 11,500 years ago.