Not sure if the short line owns the ROW or CSX. I have walked back there a couple of times and nobody has bothered me, however, I walked through a farm field to get close, where I did have permission to be.
My first visit was cut short by a swam of angry hornets.