• Data taken from 11 to cryo failure
• Beam conditions stable
• Timing scan for different energy
• Operation stopped after cryo failure
• Cryo jet was heated up then
• Improvements of optical diagnostics (far field monitor)

Shift summary from Monday 18th 7am until Saturday 7am

MONDAY

• Aligned beamline until the beamstop. Macro for recovering mirror positions worked well. Minimal fine tuning required.
• Changed energy to 8.4 keV to align spectrometes on Ni kalpha emission.
• Characterized focal spot of the x-rays at interaction point via edge scans. Focus of ~4 um as requested by users.
• Aligned all laser imaging systems to the interaction point

TUESDAY

• Verified the xfel photon energy with the HED spectrometers. The energy was off by 30 eV. Tuned the energy for real 7.9 keV, in the BKR screen appears as 7.87 keV
• Beamline transmission scans. Focusing CRLs in the optics hutch give 55% transmission. This means from the 700 uJ from XGM1 we get around 250uJ at the interaction point (accounting also for ~75% transmission through the mirrors)
• First ReLaX + X-ray test shots. Fine tuned some timings, filtering on the Streaked Optical Pyrometry, etc...
• Cancelled night shift, due to no X-rays on Wednesday. Usually at this point we would align targets over night and shoot them during the day.

THURSDAY

• Beam was not exactly at the same position at the XFEL imager as Monday. We needed to recheck the beamline alignment and overlap of all our beams at the interaction point. (We need to overlap in a 5x5 um2 beamspot.
• Rechecked the X-ray energy. This time it was 110 eV off. The BKR number is 7.79 keV for real 7.9 keV.
• Further checkes on spatial and timing overlap.
• Essentially, we could recover the conditions from Tuesday evening at Thursday late afternoon.
• Late evening: uTCA1 stopped working We switched the Mastertimer to uTCA2 waiting for an opportunity on Friday to solve it. We also observed an issue with an outdated trainId from the PPU being stored in the DAQ. We contacted DOC for both issues.
• Late evening, series of laser shots to estimate the optimal laser conditions for the experiment.
• First full data sequence collection.

FRIDAY

• We are in data collection mode. Aligning targets and shooting them.

SATURDAY

• Power glitch at 6:50 am on Saturday morning. HED is minimally affected, beam goes down
• Beam comes back after ~1hr, but down again 30 mins later due to MPS issue (only for SASE2) which requires a server "DIXHEXPS1.3" to be reset, which could not be located.
• Simultaneously SASE2 karabo broker has pile up issues resulting in extreme latency. DOC begins to work on the problem and the whole SASE 2 topic goes down, services do not reappear. We are informed that this may require a restart of the whole broker.

During the morning shift (7am - 3pm), we couldn't take any meaningful data due to the issue of power glitch which caused the beam permission error (AIBS) and down of SASE2 Karabo / Online-GPFS due to the lack of cooling in the rack room.

During the late shift (3 pm - 11 pm), after these issues were solved thanks to PRC/DOC/ITDM/EEE at 5 pm..., we could get back in operation relatively quickly. Although there were a bunch of issues here and there (most of the devices needed to be instantiated and recover the correct parameters, loss of XGM, DAQ issue etc), Theo (XGM) and DOC helped us promptly.

Fortunately, the x-ray axis was not changed much. The beam was still exactly on the FEL imager cross. After the recovery of M2/M3 feedback (needed to recover the correct parameters which was a bit of time consuming though), the beam correctly went to the HED popin cross. The beam height at the sample location was about 30 um off in height. The temporal synchronization between the x-ray and laser was changed to about 4 ps compared to that of the morning. 

We started taking data at ~ 9 pm. Since then, until the shift handover at 11pm, users could acquire data very smoothly. They will continue acquiring data with the night shift (11pm - 7 am) members. 

• the initial 600-700 uJ of pulse energy at the beginning of the user beamtime dropped down to 300-350 uJ over night from 14th to 15th. The operators did not seem to be able to bring the pulse energy above 500 uJ, which is where it was after the RC's intervention in the morning. Is it possible to bring up the energy in the morning?

Beam parameters: 18.8 keV, 350-600 uJ, 1 pulse

Experiment: Shock compression experiments using DiPOLE 70 J + XRD

- run through most of the users targets, largely succesful

- photon delivery very stable on Sunday until Monday morning

- the beam went down on Monday 6am for an hour but got an extra hour until 8am, which is appreciated

Issues:

- HED XGM stopped showig controlData.slowTrain from about 4:30 AM. There seems to be some problem with the fast data

Vacuum issue at HED

At 18:26 the vacuum failed in the HED CRL3 chamber in the OPTs hutch. The vacuum failed in the section and tripped the valves in the OPT hutch; it went from 1e-8 to 5 mbar in seconds. The leak is confined to the CRL chamber -- the sections upstream and downstream are not compromised and still have good vacuum. Therefore we believe the leak to be in one of the bellows of the CRL arms. This needs to be investigated tomorrow by the technicians.

The late shift is cancelled since we cannot continue with lens alignment. The night shift may continue with work on the DiPOLE laser - up to them.

BKR is informed that they may use the time for tuning.

Beam parameters: 18 keV, 1 pulse, 600 uJ

- user beamtime started Friday, the 27th and going smoothly until now and we are in data collection mode

- shock compression setup with XRD and DiPOLE

- machine performance very stable in pulse energies with little downtimes

• stable 18 keV SASE delivery
• measurement of siemens star in the morning
• alignment of phase plate for the nano focussing lenses
• testing and debugging of the pulse on demand macro
• holography test measurements and optimization of online analysis
• alignment of user samples

Problems:

• FSSS ScannerX had to be shutdown and initiated quite often
• We lost the output of the pp laser at 22:30. Laser OCD could solve the problem and the laser was back at 23:45.

FXE bring-up, summary of shifts 31.1. and 1.2.:

Beam delivery (11.5 GeV)

• 9.3 keV, 1.5 mJ (31.1.)
• 7.1 keV, 1.7 mJ (1.2.)
• Horizontal beam jitter 200 µm (RMS), a bit more than usual

Tunnel alignment

• Align X-ray trajectory according to "fixed source" protocol with fixed TX of M3 in XTD9
• References saved for two offset configurations
• Beam transport diagnostics data taken to estimate source of jitter

Instrument Alignment Performed

• After WMP, calibrate slits, lenses and attenuators to the beam trajectory
• Check CRL performance after swap to new batch
• Prepare beam focus for next user expt at 9.3 and 7.1 keV
• Re-aligned FXE mono1 after 1st xtal swap

Issues

• Camera FXE_XTD9_MONO-1 BEAMVIEW could not be instantiated: Solved by DOC (suggested restarting the KaraboGUI)
• Issue with heater control on FXE mono: When switching ON in LOCAL mode it will apply max power; need to be in REMOTE first to control power via karabo
• FXE_XTD9_MONO-1/MDL/PITCH could not be instantiated: Solved by DOC (default config was wrong)
• SA1 DAQ PBM: DA01 in unknown state: Solved by DOC (IP misconfig.)

Instability observed today at 14:05, reported to PRC and BKR, including RC: We saw RMS jitter amplitude of up to 4 mm at FXE imager. The jitter was also seen by the upstream XGM with 100 um RMS amplitude. So it is something from the source.

This instability is suddenly appearind/disappearing and was absent over night and started this morning at 7h to occasionally turn on. It appear approx. everz ~30 mins for a few minutes.

After receiving beam from SPB, we noticed that there is a werid shape of beam in the FEL imager which was not observed yesterday.

Maybe someone left X-ray component in the beam.

We notice that 0.5 mm Silicon ATT in SASE1 causes holo beam profile in FEL imager. Maybe this silicon att has been damaged.

User proposal 3273:

• X-ray delivary
  • We use several deliveraly modes:
    • Continous single pulse
    • Continous 30 pulses
    • POD: 1 pulses / 30 pulses
  • All works fine, FXE is sastificed with X-ray delivery
• DA:
  • Few minor issues with offline calibration, DOC helped to solve it
  • Error with LPD. Solve remotlyh thanls to Hazem

In general very good perfomances

• We found that the x-ray pulse energy dropped a lot when we changed the undulator from 5.5 keV to 5.45 keV. We called BKR to optimise it (attachment 1)
  => There is a problem with the phase shifter of the undulator. It stacks sometime. If the x-ray intensity drops, we need to ask BKR to optimise it.
  => We were suggested not to change the undulator value by 100 eV. 5 - 10 eV step should be fine.

On the other hand, we had a user experiment 3435 Feb 2023, and we could perform photon energy scan from 5.7 keV to 6.1 keV without problem. (attachment 2)

Connerning the phase shifter adjustment after undulator gap scan via karabo:

At 19:30 FXE tested the scan change via Karabo with BKR. When the energy was changed with step size of 100 eV, the intensity of X-ray stays unchanged. This means the phase shifter adjusment is corrrected and it is working now.

Many thanks for your help.

FXE interlock in fault state. See photo attached with original error message from 6:53h. It cannot be reset by acknowledging. BKR is informed and they are contacting MPS OCD.

Summary for sept., 23rd

6:55 SPB just handed the beam over to FXE when the power glitch killed the interlocks and brought down ACC

11:30 After a lot of communication with PRC, Wolfgang Clement and DOC, the beam is back in SA1. We request change to 5.5 keV

• It took most time to get the AIBS recovered
• Interlock was reset by Wolfgang Clement on-site
• Pandora X-05 in SXP hutch had no power, but recovered after TS restored power in SA3

12:30 We finished alignment and collected some user data (XRD)

16:00 Failure of the optical laser shutter in ILH. Seems not operational.

• Adhoc procedure is being established to circumvent the faulty laser shutter (coordinated with SLSO, LSO, GL and Management)

18:00 FXE is able to take user data again (XAS)

23:30 Beam handed over to SPB (thanks for the extra time to finish a promising measurement)

7:00 Power glitch during SPB operation - they were supposed to hand the beam back at 7:30h

• Power glitch brought down FXE interlock system with beam stop monitor alarm that could not be reset
• SA1 PPL running fine, seems unaffected

9:10 Beam back in SA1, but still at 7 keV and cannot be changed by BKR to the req'd 5.8 keV, 94 kHz.

10:00 Beam back with FXE at req'd photon energy

Collected pump-probe diffraction and XAS data for the user expt. No further issues.

stable beam at 9kev (about 1.1 mJ)

checks of the sample environment required for the upcoming user experiment

test data aquisition of SiO2 samples  (data analysis still ongoing)

commissioning of Jungfrau detectors & XTD6_ATT (closed loop operation)

test of operation with two different AGIPD triggers - normal one and an early one (leaving out the first 71 cells of AGIPD)

issues:

spectrometer motor XTAL_RX still not usable

first arm of XTD1_CRL is interlocked and cannot be used