In situ imaging of ultrafast plasmonic near-field excited by picosecond laser pulse irradiation in silver block was carried out by using photoemission electron microscope (PEEM). By rotating polarization angle of the incident ultrafast laser pulse, active control of the near-field is achieved on the block structure. The experimental results show that distribution of the near-field in the silver block can be changed under linearly polarized laser irradiation with different polarization angle. In particular, it is found that when the polarization angle of the laser is changed from 45 to 135 degree, position of the localized near field will switch from the upper edge to the lower edge in the silver block. Our findings pave the way for ultrafast plasmon application in the fields such as optical switches, logic operation and others.