Aston has been telling Davies about his plans to build a shed out in the garden and explains that
Start: I used to go there quite a bit. Oh, years ago now. But I stopped. I used to like that place.
End: I’ve often thought of going back and trying to find the man who did that to me. But I want to do something first. I want to build that shed out in the garden.
For full, extended monologue see:
Pinter, Harold. The Caretaker. London: Methuen & Co. Ltd., 1960. Act Two; pp.54-57.