I was in Spain a few years ago, and decided against certain mementos for this reason. Sorry, it may not be KKK, but I won't display a whirling log in my house for similar reasons..
I got a wonderful Buddhist hanging charm for my car with a nice big 卍 (wàn) on it and you better believe I don't give a fig what people are gonna think about that!