In SASE2 undualtor cell 10 has issues. Suren K. will do a ZZ at 11:30 to fix it (if possible). Estimated duration: 1-3 hours. 

Update 12:30: The problem is more severe than anticipated. Suren needs to get a replacement driver from the lab and then go back into the tunnel at about 14:00 

In principle, the beam could be use dby HED until 14:00

Update 13:30: Beam was not put back, because energizing and de-energizing the magnets would take too much time. Whenever Suren is ready, he will go back into XTD1 and try to fix the problem. 

Udate 17:30: Suren and Mikhail could do the repair and finish now th zz. A hardware piece (motor driver) had to be exchanged and it turned out that the Beckhoff software on it was outdated. To get the required feedback from Beckhoff took considerable time, but now everything looks good.  

The control rack of the soft mono at SASE3 has some failure. Leandro from EEE will enter the XTD10 at 12:00. 

Beam will be interupted for SAS1 and SASE3.

Estimate to fix it (if we are lucky) is one hour. 

Udate 12:30: Problem is solved (fuse was broken, replaced, motors tested)

Update 13:30: Beam is still not back, because BKR has problems with their sequencer

SASE1: Solid attenuator att5 is in error. When it is tried to move it out, the arm lifts, but does not reach the final position before the software time-out. We  increased the software time-out from 4 seconds to 7 seconds, which didn't help. We suspect that there is a mechanical problem that prevents the att5 actuator to reach the out position. 

SPB states that it is ok to leave the attenuator arm in over the weekend, because they run mostly detector tests and don't require full intensity.  

The SASE1 HIREX interlock is not working as expected.

At the position 'OUT' (step 2 in HIREX scene) and while none of the motors are moving, the interlock SA1_XTD9_HIREX/VDCTRL/HIREX_MOVING is triggered, which prevents the use of more than two pulses.

SA1_XTD9_HIREX/VDCTRL/HIREX_MOVING remains in INTERLOCKED state while moving HIREX in (expected behaviour) and finally goes to ON state when HIREX is inserted, thus releasing the MODES and MODEM interlocks and allowing normal beam operation.

We observe a continuous horizontal beam drift in SA1 after the M1 incident. It seems not to converge, so one can wonder where this will go....

Attached screenshot shows the M2 piezo actuator RY that keeps the beam at the same position on the M3 PBLM. These are about 130 m apart, The drift is 1V/12 hours. 0.01V corresponds to a beam motion by 35 um. So the drift velocity is 0.3 mm/hour. In the past days this had at least once lead to strong leakage around M2. But the two feedbacks in the FXE path are keeping the beam usable most of the time.

Finally, the drift velocity of the pointing reduced approx a factor of 2 as compared to yesterday, see attached. Possibly it will still converge...

Issue with SA3 Gas attenuator (SA3_XTD10_GATT)

9h06: SQS informs PRC that the Argon line in GATT is not reacting on pressure change commands, no GATT operation, which is required to reduce pulse energies for alignment. VAC-OCD is informed.

ZZ access is required to check hardware in the tunnel XTD10.
SA1 / SPB is working on other problems in their hutch (water leaks) and don't take beam.
SA3 / SQS will work with the optical laser.
SA2 / MID will not be affected: there is also an issue in the hutch and MID currently doesn't take beam into the hutch, and would anyhow only very shortly be affected during the moment of decoupling the beamline branches.

9h45: BKR decouples North Branch (SA1/SA3) to enable ZZ accesss for the VAC colleagues.

ZZ access of VAC colleagues.

10h12: The problem is solved. A manual intervention in the tunnel was indeed necessary. VAC colleagues are leaving the tunnel.

• Beam down SASE1: 9h43 until 10h45 (1 hour no beam), tuning done at 11h45, then 1.7mJ at 6keV single bunch.
• Beam down SASE3: 9h43 until 10h56 (1.25 hours no beam). Before intervention 4.2mJ average with 200 bunches, afterwards 2.5mJ at 400 eV / 3nm single bunch.

Issue with SA3 Gas attenuator (SA3_XTD10_GATT) - SOLVED

Dear all,

after the reported issue by SQS colleagues regarding the impossibility to inject Argon, and after a first remote evaluation, we (VAC) have entered XTD10 to assess the status and verify the most probable working hypothesis: a manual valve in the supply line was closed (otherwise as expected). Joshua and Benoit confirmed it and the showstopper is now gone. The system is back to normal and standard operation can be resumed in any moment. 

A small remark: as Argon (or any other gas different from Nitrogen) is not the default operation mode, it is important that if needed, there should be an explicit request during the preparation of the operation tables with XO. This would help to avoid this kind of situations. Unfortunately sending a short notice e-mail just before the next run is clearly not recommended.

With best regards.

600um thick CVD diamond (XTD2 attenuator) seems damaged

Attachment 1: 600um thick CVD diamond (Arm 4) OUT

Attachment 2: 600um thick CVD diamond (Arm 4) IN

A2 failure - downtime

The machine / RC informs (11h22) that there is an issue with the accelerator module A2 (first module in L1, right after the injector).
This causes a downtime of the accelerator of 1 hour (from 10h51 to 11h51), affecting all photon beamlines.

14:40hr

FXE and HED reported the laser synchronization issue. Informed to Machine RC. 

LbSync team couldn't fixed this issue remotely and on there way to Schenefeld to fix this issue.

Naresh 

PRC wk 41

- While FEL IMG with YAG screen was inserted in SA1, EPS/MPS was not limited to the expected 2 bunches, but to 30 bunches; 
- It was found the condition #3 ("SA1_XTD2_VAC/Switch/SA1_PNACT_Close") at the EPS Mode-S was disabled which should be always enabled; 
- Condition #3 has been enabled again and now SA1 is limited to 2 bunches, as expected when YAG screen is inserted. 

Further investigations will be done to find why and when it was disabled. 

SA2 cell#5 undulator segment moved at ~09:45AM Fri to 25mm without aparent reason and undulator experts need a ZZ to exchange power supply; FEL instensity dropped from 230uJ to 60uJ s consequence.

RCs are preparing south branch for the iminent ZZ. HED is informed.

**Update: ZZ finished by 12:10; recovered performance and re-started delivery by 13:30.

X-ray delivery

• 0.25nC, 14 GeV, rep rate 2.25 MHz, 9300 eV, 1 to 100 pulses, ~2000 uJ
• M1 and M2 mirrors are aligned and beam trajectory to SPB.

Goal

• Commissioning of the Gotthard-II 25um MHz detector on SA1-HIREX.

Achievements

• Aligned the HIREX using bent diamond crystal C110 and no gratings used.
• 2D camera(Bragg/photonic science) aligned and spectral data is collected.
• Trigger delay scan of Gotthard-II detector. The best trigger delay setting was found at 1952637.
• Calibration Pipeline is established and can load/inject the constants
• Online preview of Gotthard-II corrected data is successfully tested and commissioned.
• successfully able to load calibration constants and dark runs in myMDC.
• Successfully able to start the calibrated data after completion of runs in myMDC.
• Calibration/corrected and dark data reports are successfully generated in the proposals
• New filter stage commissioned and tested. Updated the positions in the MDL.
• Intensity scan output for strips 2150 and 2151, obtained varying the SA1 diamond attenuators. I_0 is calculated integrating the output from strip 2000 to strip 2300.
• Different gain setting data was collected.
• Gotthard-II tested and commissioned with different rep. rate: 4.5 MHz, 2.25 MHz, 1.125 MHz, 0.5 MHz. The test was sucessfull and we can record spectrum for different rep. rate.
• There are no visible aritfacts around the gain switching region, and the correction seems to work well.
• spectral data is collected with 2.25 MHz with pulses 2, 30 and 100.
• Attachment 1: Fisrt results from Gotthard-II with spectral data in MHz rep rate.

Issues:

• Calibration pipeline of pulses/train (ASSEMBLE_STREAK) couldn't able to instance. DRC and OCD DA group helped to fix (Thank you)
• Adhoc data sources were added in SA1 COMM with support from DRC and CTRL (Thank you)
• beam lost at ~12:30hr today due magnets issues and till now no beam. Unable to continue the rest of the program planned for commissioned of the Gotthard-II.

Thanks to Marco, Jiaghuo, DRC(Monica), CTRL OCD (Andrea), DA OCD (Karim) for there support and help.

*Achievements :
- Generally rather successful with very high quality beam parameters
- We had a nearly steady 800 uJ+ HXRSS flux during the user run and ~ 4mJ SASE during the setup at HED.
- Beampointing was rather stable throughout the HXRSS operation.
- Users took several shots (>2600 FEL and FEL+ReLAX shots) on target. The beamline setup was very quick prior to that and users were able to get preliminary data to prototype parameters already a day before formal handover to them and could straight go to harvest mode on Saturday morning.  
-----------------------------------
* Issues :
- Users still found large Bremsstrahlung fluxes on their background, but this is rather on our side, in conjunction with the users.
- On the last day, we had issues with JF calibrations due to the high run numbers in the proposal. DOC promptly helped out.  
- Initially, we observed fluctuations in the FEL flux. BKR was very prompt to correct for this and user operation was not impacted seriously. Slow drifts in pulse energy were also observed, but again, could be compensated from time to time by them.
-----------------------------------

• proposal 5700 finished on 04.05. The experiment used 352 pulses at 4.5 MHz and 18 keV to X-ray heat pressurized samples in diamond anvil cells. Overall succesful on several samples.
• Issues:
  • the requested 20.5 keV photon energy had too low pulse intensities so we had to go down to 18 keV
  • pulse energies at 18 keV (300-400 uJ) were insufficient for some samples
  • the ramp in pulse envelope has not been delivered consistently throughtout the experiment (eventually we gave up due to the average low pulse energies)

We plan to put the piezos of M2 off, in the (unprobable) case that this is the reason of the "jumps" in SASE3 trajectory.

Therefore, I measured the change on RY and RZ motors, to correct all the positions

Fig 1: initial position, Motors Ry=10.5425 and RZ=-14.7200  Piezo Ry =5 and Rz=5

Fig 2: Ry is compensated, Motors Ry=10.4990 and RZ=-14.72  Piezo Ry =0 and Rz=5

Fig 3: Rz is compensated, Motors Ry=10.4990 and RZ=-14.7574  Piezo Ry =0 and Rz=0

Differential values: RY needs to be adjusted by -0.0435 and Rz by -0.0374

EPS Interlock change for Mode30:
the 3 HIREX Interlock conditions had been disabled

We had some trouble with the DAQ. It was not able to start runs properly.

We got the following error messages:

initially:

[00:01:27]: Problem of communication with data manager

[00:01:30]: Start new run ...

[00:01:38]: Failed starting data recording

DM: error at registerRun (Request to MDC timeouted)

after trying to start the run again:

[00:05:35]: Start new run ...

[00:05:35]: Failed starting data recording

DM: error at registerRun (Problem of communication with MDC

#Info: MDC-1100: MDC web server error: Error creating run

#Details: {'run_number': ['must be unique per proposal', 'has already been taken'], 'experiment_id': ['has already been taken']})

Cycling the DAQ resolved the issue.