Preheat the oven to 350°F. Butter a large loaf pan and set aside.
In a medium bowl, combine the flour, baking powder, and salt. Set aside.
In a standing mixer with the paddle attachment, beat together the sugar and the eggs until combined. Add the milk and olive oil. Mix for an additional 1 minute. Add the flour mixture to the bowl and mix until combined. Stir in the olives, almonds and saffron.
Transfer the batter to the loaf pan and place in the oven. Bake for 45-50 minutes. Remove from the oven and let cool for 10 minutes. Remove the bread from the pan, brush the top with a little olive oil and serve.