Samurai 8 has multiple personality syndrome, don't let him bother you
Japanese people call anyone who is not 100% Japanese "gaijin".
It illustrates their thinking pretty well.
If you are foreign, you are foreign.
Unless your Japanese language skills are perfect, they will know you are not Japanese as soon as you speak.
Some people will want to know you and some wont.