At 9h46 

Broken Radiation Interlock

Beam was down for all beamlines due to a broken radiation interlock in the SPB/SFX experimental hutch.
The interlock was brocken accidently with the shutter open, see https://in.xfel.eu/elog/OPERATION-2024/203
Beam was down for 42 min (from 3h00 to 3h42) but the machine came back with same perfomrmance.

End of in-house 8496

X-ray delivery

15.13 keV 30 pulses @0.5 MHz and 64 pulses (customized pattern), 0.85-1.0 mJ stable delivery

Achievements/Observations

• We used the customized pattern and it worked well, thanks to everyone involved
• One fuse was blew, TS OCD had to come on site
• Interlock was brocken accidently with the shutter open, which tripped the beam in all SASEs

Broken Bridges

Around 21h20 the XPD group notices that several karabo-to-DOOCS bridges are broken.
The immediate effect is that in DOOCS all XGMs in all beamlines show warnings
(because they don't receive important status informations from karabo anymore, for instance the insertion status of the graphite filters nrequired at this photon energy).

PRC contacts Tim Wilksen / DESY to repair these bridges after PRC check with DOC, who confirmed that on karabo side there were no issues.
Tim finds that ALL bridges are broken down. The root cause is a failing computer that hosts all these bridges, see his logbook entry;
https://ttfinfo.desy.de/XFELelog/show.jsp?dir=/2024/47/22.11_a&pos=2024-11-22T21:47:00
That also explains that HIREX data was no longer available in DOOCS for the accelerator team tuning SA2-HXRSS.

The issue was resolved by Tim and his colleagues at 21h56 and had persisted since 20h27 when that computer crashed (thus 1.5h downtime of the bridges).
Tim will organize with BKR to put a status indicator for this important computer hosting all bridges on a BKR diagnostic panel.

20h16: beam down in all beamlines due to a gun problem
20h50: x-ray beams are back
Shortly later additional 5 min down (20h55 - 21h00) for all beamlines, then the gun issue is solved.

After that, SA1 and SA3 are about back to same performance, but SA2 HXRSS is down from 130 uJ before to 100 uJ after the downtime.
Additionally, MID informs at 21h07 that no X-rays at all arrive to their hutch anymore. Investigation with PRC.

At 21h50, all issues are mostly settled, MID has beam, normal operation continues.
Further HXRSS tuning and preparation for limited range photon energy scanning will happen in the night.

SA2 cell#5 undulator segment moved at ~09:45AM Fri to 25mm without aparent reason and undulator experts need a ZZ to exchange power supply; FEL instensity dropped from 230uJ to 60uJ s consequence.

RCs are preparing south branch for the iminent ZZ. HED is informed.

**Update: ZZ finished by 12:10; recovered performance and re-started delivery by 13:30.

- While FEL IMG with YAG screen was inserted in SA1, EPS/MPS was not limited to the expected 2 bunches, but to 30 bunches; 
- It was found the condition #3 ("SA1_XTD2_VAC/Switch/SA1_PNACT_Close") at the EPS Mode-S was disabled which should be always enabled; 
- Condition #3 has been enabled again and now SA1 is limited to 2 bunches, as expected when YAG screen is inserted. 

Further investigations will be done to find why and when it was disabled. 

Dear MID colleagues, Svitozar (PRC), Bolko and Shan (RCs),
This morning we faced the situation where MID was limited to 400 pulses (mode M) via the EPS signals. The current RF window set at the machine allows to the requested 450 pulses.
The limiting conditions were the inserted graphite filter (#2) and the diamon screen at the MID Pop-in (#17). After a discussion with experts (and thanking Naresh, Wolfgang and Andreas), both conditions in EPS mode F (see attached) are now disabled, as the current SA2 beam offer safe condition for both devices.
This special situation with disabled EPS signals in mode F is in place until Tuesday 05.Nov as MID will stay at ~12.28keV and with HXRSS (500-600uJ). Please note that in case of either a change in photon energy, substantial increase of photon flux, longer SA RF window or the wish to insert YAG screen at the SA2 Pop-in, these two mentioned conditions have to be enabled again at the SA2 EPS Mode F prior these actions take place.
After the beamtime ends on Tuesday 7AM, either me, Naresh or the PRC will make sure these two EPS conditions are re-enabled.
In case of questions please do not hesitate in contacting me.
Best wishes,
Frederik

**Update Mon 15:00: The beamtime delivery to MID is extended up to Tuesday 9AM. At this moment the EPS signals will be enabled again by Frederik W.-F.

X-ray delivery

12.5 keV, ~1.6 mJ

Achievements/Observations:
Collected almost 40 runs of the priority sample with 7 pulses per train using the Polypico injection system.

Issues:
Jungfrau controller issue when changing back to single cell adaptive to collect powder data with new geometry (solved together with DOC).
Pipeline issue after requesting single cell correction - still the same bug in the calibration pipeline, the pipeline has to be re-instantiated after the change.

12.389keV, HXRSS, 1-400+ bunches, 450uJ

• Seeding alignment
• Beamline alignment (Mirror + foccussing)
• Measured energy and moved it the requested value
• Cryos for sample and monochromator are prepared
• Aligned DES spectrometer
• Started with DCCM characterization (440)

This is to report some findings during operation that should be looked into (mostly to avoid in the future, because both negatively affect data quality of the user expt at FXE):

• At the moment, the 99:1 mode affects 4 to 5 pulses out of 100 in SA1, see first screenshot that shows in the top right the IPM reading with each blue point denoting the average pulse energy in a train. This was not always the case. After initial setup on thursday it did affect only a single train out of 100.
• On 27.10., the switching of SA2 between 1 and multiple bunches affected SA1 beam heavily, see the jumps in SA1 pulse energy in the second screenshot shown here:
  • The pulse energy dropped by 15% and
  • the pointing changed vertically by 150 um on the FXE PI (data not shown, but available from karabo trendlines)

Edit 8.11.: Added screenshot (grafana/ctrend) to show that the vertical displacement was permanent (not corrected by the feedback)

X-ray delivery

12.4 keV, ~1.4 mJ

Achievements/Observations

Beam was focused on a YaG, alignment finished up to JF4M

Desy Laser group has fixed the issue about the laser Synchronization.

https://ttfinfo.desy.de/XFELelog/show.jsp?dir=/2024/41/07.10_M&pos=2024-10-07T14:51:12

Naresh

PRC

wk41

14:40hr

FXE and HED reported the laser synchronization issue. Informed to Machine RC. 

LbSync team couldn't fixed this issue remotely and on there way to Schenefeld to fix this issue.

Naresh 

PRC wk 41

X-ray delivery

    6 keV, ~2.8 mJ, continuous beam drift in both direction

Optical laser delivery

    ns laser for particle visualization

Achievements/Observations

    DAta collection for CDI
    Julabo chiller (AGIPD) is still on target (-32 degree)

Issues

    Continuous beam drift in the both direction: NKB focus was optimized almost every 2 hours

01:49

Worked on the XPCS analysis packages
measured the TetraPack samples
continued with the levitation device

issues:

1. Jungfrau detector had an error - R. Shayduk restarted the device - it should be power cycled as described in the manual
2. The bunch number selctor does not work - the system didn't accepted 150 pulse but moved it back to 30 pulses - the machine switched off the user selection - should be followed up tomorrow

**X-ray delivery**

- 6 keV, ~2.8 mJ, continuous beam drift in vertical direction (both XTD2 & XTD9 XGMs)

**Optical laser delivery**
- ns laser for particle visualization

**Achievements/Observations**
- measured sample for almost whole day (about 100 runs x 5 minutes)
- Julabo chiller (AGIPD) is still on target (-32 degree)

**Issues**
- Continuous beam drift in the vertical direction: NKB focus was optimized almost every 2 hours
- Sudden intensity drop in SA1 when SA2 or SA3 changes the number of pulses.

X-ray beam is continuously drifting in the vertical direction (XTD9_XGM)
It affects our NKB focus and focused beam is also drifting continuously.

Beam is back. Current status:

SASE1 (SPB/SFX)

• 2.72 mJ, 352 bunches/train, 6 keV

SASE2 (MID)

• 880 uJ, 1 bunch/train, 8 keV

SASE3 (SQS)

• 4.56 mJ, 1 bunch/train, 400 eV (3.1nm)