I wouldn't worry about it! Plus you will drop the weight!

I was somewhat similar, while I travelled Japan I lost 2 stone (28lbs) in weight over 5 weeks. I wasn't even overweight, I was quite muscular but not exactly lean and 6'1 in height. Came back 2 stone lighter and ripped as hell haha . I wasn't even restricting myself, granted I ate less than I usually did but while you are there the weight just drops off you.

I did get stares but as Petina said they usually stare at all foreigners, you might stick out a bit more though height wise!