The pimento doesn’t really have all that much flavor, espec next to the olive. You should definitely try some green olives again, it is one of this things that it’s not uncommon to dislike as a child and later acquire a taste for.