Achievements:
-Collecting TR-RIXS data for different fluencies and delay range
Problems
-No major problems

Morning shift Summary 22.10.2023

Achievements

• Checked beam alignment and overlap

• confirmed sample integrity with static rixs on other sample locations
  Problems

• beam down after 11 am. No chance to resume till at least 18:00h

Achievements
-Check XAS and static RIXS after the beam was back
-Do the warm up cycle to remove ice from the sample surface
-Check coarse timing after the beam drop
Problems
-Could not see the fine timing signal so far

06:45

Night shift summary

Achievements:
- Recovered time0 on SiN (time0 moved >20ps after FEL beam loss in the evening)
- Collected static RIXS (actually with laser but negative delay) at the CDW at 113 kHz for different temperatures to investigate the effect of heating from the x-rays and from the laser

Problems:
- during late shift and after a beam dump in the evening, trRIXS signal could not be recovered. By checking the rough timing, they found a change in the x-ray arrival time of the order of >20 ps. 
- We checked the beamline alignment and found that the pointing from the machine was off, requiring BKR to tune We also found that the photon energy offset between mono and undulators changed. Beam looked horizontally diffracted and the beam pointing moved in horizontal and was hitting the horizontal slits. We translated the open horizontal slits and pitch the beam properly into SCS branch with M5.

# Shift Summary

Achievements
 - Found RIXS signal from CuO as well as off-resonant elastic line signals from NiO and CoO
 - Found a potentially optimal exit arm setting and checked theta angle of sample
 - Determined energy calibration

Problems
 - Overall signal levels were quite low of CoO and NiO samples. This meant we had to work with open exit slits. Long scans would be required for optimization at HR conditions
- Interpolation procedure was giving lower signal as compared to direct integration. Algorithm needs to be checked. Analysis with no interpolation and curve correction is available in Software folder LLG/elastic_line_analysis.ipynb

Plan for next shift
- continue with optimization of hRIXS resolution

# Shift Summary

Achievements
 - Measured elastic line with 3000 l/mm and 1000 l/mm grating on NiO sample

Problems
- only 50% of trains with jungfrau data in burst mode are saved in the DAQ. Likely an issue with DAQ configuration.
- we couldn't achieve a good focus on the sample and in the spectrometer. Reason unclear.

Problem: Beam operation in SASE2 is prohibited by SEPS / MPS
Origin of problem: HED-CRL3
(this was already an issue during the past weekend)

HED (Karen) today realigned CRL3 and brought the lenses into the safe OUT state, see entry https://in.xfel.eu/elog/OPERATION-2023/2
In karabo then everything seemed find, SEPS switches all green / OUT, see ATT#1.
Nevertheless, in DOOCS the signal safety_HED_CRL_OPT was still red, see ATT#2.

The MPS safety_HED_CRL_OPT signal from the Beckhoff HED PLC was missing.
Onsite investigation by EEE (Leandro and Bernard) revealed that the Beckhoff crate BKF000476 was offline (switched off).
Switching the crate ON fixed the missing signal problem.

Presumably crate BKF00476 was not powered back on since after the planned power-cut in December 2022,
and because it is not part of PLC EtherCAT loop, the Nagios system didn't inform EEE about the crate status.

Result: Problem solved, beam operation in SASE2 can resume normally.

SASE1 blocked to 1 bunch/train by EPS interlock (sic, not 2 but 1) --- PARTIALLY RESOLVED

Several issues:

1) MODEM device is broken, in state UNKNOWN, see ATT#1 and ATT#2. Fixed with deinstatiating and then using BECKHOFF_ASSISTANT to re-instantiate. --> ATT#3

2) Several devices in XTD9 are causing that MODES is interlocked: I restart broken devices of the FXE-PBLM and SPB-PBLM.
Then there is a broken MDL of SPB_XTD9_SCR called SPB_XTD9_SCR/MDL/BIU. This MDL is not in the SA1-topic system topology but shown with (X) on the SA1_MAIN scene, and this screen is blocking the interlock (see ATT#4)

SPB_XTD9_SCR/VSWITCH/HOLSTER_X_LIMITL is triggering the interlock SA1_SYS_EPS2MPS/DCTRL/MODES and causing that the machine cannot go to more than 2 bunches per train.
Even when going to SPB-topic this issue cannot be solved - all devices in SPB-topic related to this SCR seem fine.

3) To allow SASE1 tuning by the machine, BKR is closing shutter XS3. This avoids any beam into XTD9, resolved the interlock problem and allows the machine to continue SASE tuning.

4) We don't know what had blocked the beam not only to 2 but actually to 1 bunch / train (no traces of problems in Big Brother).

Status of machine SASE tuning (just before switching off for monday maintenance):

Dear all,

please find here a summary of the status on this critical topic provided yesterday evening (around 19:15) by Zunaira Ansari (extract from her e-mail).

"Dear colleagues,

Thank you very much for your cooperation. SEPS interlock tests are completed in all SASEs except SASE3. AIBS interlock tests are complete in all hutches.

SASE3 SEPS interlock will be tested on Monday the 30th of January strating from 9a.m.

I kindly request the use of the SQS control hutch for the testing.

All SASE3 hutches will be interlocked on Monday morning.

@Maurizio and Bernard/ Nerea: Could you please be present during the testing? IIt will be much appreciated.

I would very much like to thank Eric, Nerea and especially Bernard for helping with the interlock tests today.

Best regards,

Zunaira

Dear all,

last evening Suren Karabekyan and myself did a short notice ZZ access to XTD1. The reason is that machine operators detected the lack of response on the Cell 17 Phase Shifter. The intervention was successful and around 20:30 we left the tunnel.

Regards,

R.

15:15  SCS called and reported an issue with one of the motors of the SCS exit slit. DOC already looked at the problem and could not make the motor move. XRO (Maurizio) is now informed and looks at the problem

17:10 ZZ access to XTD by Maurzio and Mikako

18:00 ZZ finished. Unfortunatly the motor is completely blocked, even with cables disconnected one cannot move it. 

Gun Modulator Problems

Gun Trip at 11:23 and since then the Modulator trips after each restart.
Accelerator Shift Crews and On Call personnel working on fixing the issue.