You head down the strange track and encounter a few strange things like a large bird sleeping in a pit of ashes, a small leather pouch filled with dead flies and a man sitting on the side of the track screaming "THEY'RE IN THE TREES!!!" over and over again, but finally you reach what you are looking for, the shrine of the samuri which has the long sword inside it's walls.
You have a few options to enter
Through the front door like a normal human being
Through the roof to drop in without the various guards of the sword noticing
Kill one of the guards and sneak through disguised as one of them
