there are some shops in shibuya and shinjuku but majority can be found in ochanomizu.
Ochanomizu (aka guitar street) is a must to go bro... try this 2nd hand store Shimokura Gakki : http://www.shimokura-gakki.com/e_index.html. Also there are about 10+ guitar stores on the same street....