During the morning shift (7am - 3pm), we couldn't take any meaningful data due to the issue of power glitch which caused the beam permission error (AIBS) and down of SASE2 Karabo / Online-GPFS due to the lack of cooling in the rack room.
During the late shift (3 pm - 11 pm), after these issues were solved thanks to PRC/DOC/ITDM/EEE at 5 pm..., we could get back in operation relatively quickly. Although there were a bunch of issues here and there (most of the devices needed to be instantiated and recover the correct parameters, loss of XGM, DAQ issue etc), Theo (XGM) and DOC helped us promptly.
Fortunately, the x-ray axis was not changed much. The beam was still exactly on the FEL imager cross. After the recovery of M2/M3 feedback (needed to recover the correct parameters which was a bit of time consuming though), the beam correctly went to the HED popin cross. The beam height at the sample location was about 30 um off in height. The temporal synchronization between the x-ray and laser was changed to about 4 ps compared to that of the morning.
We started taking data at ~ 9 pm. Since then, until the shift handover at 11pm, users could acquire data very smoothly. They will continue acquiring data with the night shift (11pm - 7 am) members.
|