Hi Alain,
The ribbon:PopupButton will use the Office2007Blue theme in that case. So it will have the orange highlights, since that what Office popup buttons look like. You'd have to retemplate the control to get a different appearance there.
That being said, our shared:PopupButton is more like a normal WPF button in appearance and might be more what you are looking for in this case.