While the pecans are cooking, put the olive oil, cinnamon, nutmeg, cloves, brown sugar, and rosemary in a medium bowl and mix until combined. Remove the pecans from the oven and immediately transfer them to the bowl. Season with salt and a generous amount of black pepper and toss, making sure to coat all the pecans.