Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Technical integration and coordination logbook, Contact: A. Violante, G. Wellenreuther, Page 17 of 29  Not logged in ELOG logo
ID Date Author Location Severity Subject
  256   01 Sep 2021, 10:36 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 01.09.2021
General Announcement:
- A change of meeting room occupancy will happen soon (increase by some %) and will be posted at each meeting room door. 

CTRL:
- Together with EEE, CTRL updated the pnCCD system and is working again. Hardware train-IDs acquisition was used by SQS yesterday afternoon and was successful.

DA:
- Nothing to report.

EEE:
- Nothing special to report.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- Follow up for the pnCCD today (offline calibration fixed). Detector is being cooled down and then data will be collected. DET supports CTRL that one had to make better plan earlier.

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- Nothing to report.

UNSYS:
- Nothing to report; Cell#16 in SA3 got repaired on Monday.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- All fine at MID.

HED:
- Yesterday the beam was available for delivery later than 15:00 due to issues with machine tuning.

SCS:
- Not present.

SQS:
- Not present.
  255   30 Aug 2021, 10:08 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 30.08.2021
General Announcement:
- XO will send next Wednesday the call for the Winter maintenance tasks. This time there will be a ticketing system and the call will be also send to Readiness list but please check with your group leader 
to submit a single task list per group.
- Please we ask instruments to place shift summaries at the Operations E-log.
- Suren K. asks TS for the trainings of TS staff as some people do not have access to tunnels areas. Lorenz K. will verify with TS members.

CTRL:
- Broker pileup issue at FXE on Wednesday: resolved with tracing on specific devices. Work is ongoing to prevent future incidents.

DA:
- Nothing to report.

EEE:
- Test on turbo pump on SQS to take place (by Bernard B. and VAC).

VAC:
- Nothing to report besides the test. This morning also a PLC test takes place.

XPD:
- Nothing to report.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- Nothing to report.

UNSYS:
- There is a problem with cell#16/SA3. A ZZ is currently ongoing to fix it.

SPB:
- Nothing to report apart of the intensity slope last week. It was improved during the weekend but still an issue for data collection.

FXE:
- Nothing to report.
- BYU trigger delay change was observed: it was fixed but root cause still to be found.

MID:
- Problem with AGIPD processing data (automatic calibration did not work): under analysis/fix.

HED:
- Not present.

SCS:
- Strong contribution of SA1 dedicated bunches last week; one need to have zero bunches at SA1 to be able to see the SA3 beam. Not interleaved mode may solve it but was not yet tested/tried.

SQS:
- Nothing to report.
  254   25 Aug 2021, 10:08 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 25.08.2021
General Announcement:
- A power glitch happened this morning at around 5:46AM. The drop of voltage was seen in two stations (about 0.6kV) and it's smaller than the last Monday's one. In case groups find affected systems, please 
let XO know.

CTRL:
- Last night DOC informed on a Broker pileup at FXE. The FXE loop was restarted and mitigated the situation. Further investigations are ongoing and will be coordinated with FXE.

DA:
- Nothing to report.

EEE:
- EEE helps on the Loop 6 pileup reported by CTRL.
- Call from DOC reporting connection issue to Karabo (broker PLC was replaced and had to be configured the connection).

VAC:
- Effects of power glitch seem to be none. Cooling water for the vacuum systems was not affected.

XPD:
- XGM in SCS being offline due to surge of pressure. This was informed by e-mail from SCS last night; interlock tripped due to high-voltage. XPD checked and put back during the night. 
Laurent M. says it was not clear why the pressure was increased. It is under investigation and SCS will inform XPD.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- Amphos were not switched OFF due to power glitch. PP-laser in SA3 are under maintenance.

UNSYS:
- Nothing to report.

SPB:
- Issue with EPS at 14:10 yesterday: beam permission was blocked by EPS despite both shutters closed and all gate valves open. The signals had to be manually restarted (this info was not transmitted and 
EPS blocked beam permission). 
Issue appeared when they use beam for the first time; EEE / Nerea J. will further investigate.

FXE:
- Nothing to report.

MID:
- After the power glitch the SA2 beam intensity decreased by 10%. BKR will not do any interaction right now. It is still fine for MID to work in such conditions.

HED:
- Nothing to report.

SCS:
- Apart of the XGM issue, nothing else to add.

SQS:
- Nothing to report.
  253   23 Aug 2021, 10:03 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 23.08.2021
General Announcement:
- There were two minor power glitches on Saturday morning but with negligible effects to machine.

CTRL:
- Nothing to report.

DA:
- Nothing to report.

EEE:
- Update of EPS-SA1 loop was done this morning in order to enable the FXE imagers modes.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- DSSC is installed back to SCS and put into operation last Friday.

ITDM: 
- Nothing to report.

XRO:
- Not present.

LAS:
- All AMPHOS are ON and LAS is preparing PP-lasers for instruments today.

UNSYS:
- Issue with cell5/SA1 phase shifter: M. Yakopov confirms a power cycle was made to recover it.

SPB:
- Problem with Karabo (misread 2 of vacuum gauge values): the problem was a terminal of the crate was broken. After the terminal has changed, it works fine. 

FXE:
- Nothing to report.

MID:
- All fine at MID.

HED:
- Nothing to report.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  252   18 Aug 2021, 10:48 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 18.08.2021
General Announcement:
- In the aftermath of the severe power glitch, XO will be grateful if groups drop a message of what was affected in your groups. This will help us to understand effects of the latest power glitch.
- Status of machine: last night we had 2.3mJ in SA3 and 0.5mJ in SA1. Right now machine is under tuning - good chance of beam available for FDs today.

CTRL:
- Follow-up to the power glitch. CTRL had to restart the Karabo systems due to the main network to the brokers being down for minutes. Few follow-ups later that day but in general things have recovered. 
If groups experience troubles after running systems, please write ticket to CTRL.

DA:
- DA has deployed at SPB the latest Karabo 2.11.4. This concludes the cycle to all instruments.

EEE:
- Nerea J. informs Andreas K. detected that FXE imagers needs to be debugged by restarting the EPS loop. This will take out beam permission and may be organized for Monday morning. 
- Clock and control system was downgraded (confirmation from Bruno F.).

VAC:
- Nothing to report.

XPD:
- XPD had to restart manually many devices, macros and MDLs. One had to fix the broken Karabo bridges.
- No hardware and XGM gas supply were affected; they are running fine.
- SASE recovery only happened Tuesday afternoon and FD in SA2 was cancelled.
- A. Koch asks if Monday it is a good day for the IMG intervention. XO will check with MXL.

DET:
- AGIPD in SPB was the only detector ON during the power outage. It quickly recovered as it was in power voltage.
- DSSC being moved this week among SA3 instruments.

ITDM: 
- Network issue due to the power glitch (distribution layers switchers); connectivity of different parts of network affected. This in turn affected Karabo. 
- Gitlab upgrade today at 13:00.

XRO:
- M. Vannoni informs that to evaluate better tunnel devices (initially seems OK), one needs the beam back to check them in full.

LAS:
- PLCs and Karabo issues were found; in touch with EEE to make redundant power supply to PLCs. 
- Lasers went OFF and plan is to have PP-Ls available by Friday evening.

UNSYS:
- Problem with SA1/cell27 on Monday as motor drivers went in error state after the power glitch. It was recovered remotely. 
- Tables for 3keV @ 14GeV were updated on Monday.

SPB:
- Problem with Karabo and vacuum gauges (EEE is working on them).
- Problem with PP-laser shutter last week (unable to set interlock). It is now solved.

FXE:
- Detectors were OFF and therefore no issues due to the power glitch.
- Similar Karabo problems as described earlier.

MID:
- All fine at MID. Summary will of the effects of power glitch will be sent soon to XO.

HED:
- Lost the tests for the wavefront sensor as machine was down (FD). Plan to use beam tonight if it comes back. On Friday Karen A. plans to use beam for tests.
- Ulf Z. has sent a report to XO; Detectors were OFF and unaffected.

SCS:
- Not present.

SQS:
- Not present.
  251   16 Aug 2021, 10:07 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 16.08.2021
General Announcement:
- On frequent power glitches: it happened twice over the weekend. Machine was not affected and maybe this time the PP-lasers also. The origin is on the electrical power grid of Vatenfall and it is unclear 
how long it takes to fix it.
- TS requires location knowledge of all office chairs. In case you have taken yours to home, please let TS know.

CTRL:
- Reports from DOC with delayed train of DOOCS XGM for HED. It will be investigated.
- Reminder that it is a blue week and the DOC does not run. The DRC is available via phone.

DA:
- Issues with the offline calibration system: changes of data migration (how it works). Hot fixes are ready to be deployed (probably today); please check the migration and the auto-run; DA will update 
after the deployment.

EEE:
- Nothing to report.

VAC:
- No problems with power glitches.

XPD:
- XPD side: all fine.
- As PRC, Jan G. says that pump-probe laser at FXE was affected on Friday morning (Laser unavailable until the night). On Saturday and Sunday the lasers were not affected due to the power glitches.

DET:
- Nothing to report.

ITDM: 
- Gitlab update taking place this week.

XRO:
- Not present.

LAS:
- None of the PP-lasers went down this weekend in relation to the power glitches.

UNSYS:
- Nothing to report.

SPB:
- Adrian M. asks that, in case supply problems continue to happen, would that mean EuXFEL makes proactive action for operations? 
A. Galler comments that DOB will discuss the issue with lasers (exchange of pumps that are vulnerable to the power glitches is planned for the winter shutdown). From machine side, as it is largely 
unaffected, the operations calendar won't change.

FXE:
- Nothing to add, no news on clock and control upgrade.

MID:
- All fine at MID.

HED:
- Not present.

SCS:
- Nothing to report.

SQS:
- Dismount the DSSC and give back to SCS this week. 
- SQS expect beam for the safety tests on Wednesday and Thursday.
  250   11 Aug 2021, 10:45 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 11.08.2021
General Announcement:
- There was another power glitch last night. It seems that accelerator was not affected. If XFEL groups find affected devices, please contact XO.
- From healthy task force the Covid-19 measures stay in place as they are.

CTRL:
- Nothing major to report.

DA:
- Nothing to report.

EEE:
- Nothing to report.

VAC:
- Nothing to report.

XPD:
- Running at SA3 at the edge of the energy range (3keV is at limit of the undulator tables (K near 4)). Sara C. says that with higher electron beam energy this won't be a problem. 
In addition, the problem was with only few cells and Suren A. is in contact with BKR. Jan G. says that will get in touch with Suren A.
- HED reported problems with beam pointing being instable. XPD and XRO will take a look on it and include XO for the analysis.

DET:
- Small hiccups but nothing major. Follow-up on the pipeline for DSSC and firmware for other detectors.
- Jolanta S.-D. is not aware of LPD/FXE update and will check with EEE/CTRL/FXE.

ITDM: 
- Announcement: ITDM would like to upgrade GitLab on next Wednesday 18.08 from early afternoon 13:00 and may take until the evening. Users of GitLab are contacted and no access to GitLab during that 
action.

XRO:
- Nothing to report. Maurizio V. will follow the HED beam instability.

LAS:
- Affected by power glitch: all PP-lasers / AMPHOS went down and warmed. LAS would need a solution for power glitches, considering power backups, UPS or batteries, as the controllers for this type of the 
pump goes down. 
- Jan G. says that XPD has a bunch of unused UPS and could offer to LAS.

UNSYS:
- Problem with cell6#SA3 quad mover is solved. Coupler was exchanged and it works. UNSYS has more spare parts and is in touch with Beckhoff.
- Sara C. says P. Gessler informed Karen had problem when changing undulator energies. Suren A. could not find any issue with Doocs / Unsys side. 
Patrick G. talked to Olaf H. and firstly BKR must try to change energies and if it works, then instruments shall try. Karen A. says BKR could moved energy and had no issues - the issue was in HED side. 
P. Gessler proposes that Unsys check with Olaf H. Further discussion will follow offline.

SPB:
- Couple of issues: 1. SBP Pop-in reached limit switch and had to be changed; 2. Affected by the PP-laser downtime overnight.
- A. Koch says there was about 0.5mm steps lost. He is looking into it if it is mechanical, motor, or control issue.

FXE:
- Wajid E. says work on the clock and control is ongoing for the LPD.

MID:
- Al fine and use of PP-laser is not needed currently.

HED:
- Nothing else to report besides of what was discussed during Unsys report.

SCS:
- Not present.

SQS:
- Not present.
  249   09 Aug 2021, 10:26 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 09.08.2021
General Announcement:
- XO reminds that the timing system maintenance is taking place now.
- Power glitch happened at around 5:15AM today. Accelerator had a downtime; please check components that use cooling water / pumps to check if they were affected or not.
- Liubov S. reported that the PRC phone could not be started and maybe calls were not answered.

CTRL:
- Follow-up on the timing downtime maintenance: CTRL advices instruments to please check DAQ afterwards. 
- Bug reports for cameras - 1. For Lima Cameras updated for new Karabo 2.1: new library has new features on rotation (a fix can be deployed); 2. Rotation in non-instantiated cameras won't work: one has to 
instantiate them initially.

DA:
- Nothing to report.

EEE:
- Downgrading clocking and control firmware today after this meeting. For questions please talk to Bruno F.

VAC:
- Power glitch propagated to the tunnel (shortage of cooling water) but it did not affect VAC systems 
(update 10:30AM: GATT-SA3 injection of gas stopped due to the water shortage being above 5-10seconds but less than 30s, as pumps continue running - SCS could set it up again quickly). 
- GATT loop: Steffen H. and Raul V. are setting up update and please refrain to use it today.

XPD:
- Issue with XGM in SCS hutch: it got shock vented with N2 last week. Fortunately, high voltage was not ON. Turbo pumps have issues with controller; on Thursday and Sunday the pressure gauge dismounted. 
XPD is on contact with SCS on it. 
Remark: Theo M. is on holidays and for XGM issues please contact Jan G.
- A. Koch asks Steffen H. if the Lima/Bassler camera fixes uses only DAQ and not GUI. Steffen H. says this is correct and for Karabo 2.11 only. A. Koch will send a list of cameras to Steffen H. 

DET:
- Nothing to report. DET aware of clock control downgrade.

ITDM: 
- Today afternoon ITDM starts activities in Influx: downtime of few minutes.
- Reminder on closing proposals: Please do it ASAP. If not done by next week a policy on non-accessed data will be done.

XRO:
- Nothing to report.

LAS:
- The cooling water for SA1 and SA3 AMPHOS went down on Saturday morning, bringing PP-lasers - due to another power glitch on SAT early morning. 
- Cooling water in the LAS R&Dlab remains down as of now.
- PP-Lasers will come up this afternoon but requires time to thermalize. It was put OFF in a controlled way this morning due to the timing system maintenance. The AMPHOS was not OFF during today's power 
glitch.

UNSYS:
- Issue with cell6/SA3: power cycle of whole cell is ongoing. Suren K. asks if a possibility to go to tunnel can be done. ZZ is not yet requested but will contact PRC to fix the coupler.

SPB:
- Complications with the delivered bunch pattern last week: coincidence of needing to drop bunches for detectors commissioning at same time SCS use particular bunch pattern. 
Nevertheless, it worked well enough for getting data, apart of few lost time to set the pattern.

FXE:
- Nothing to report.

MID:
- All fine at MID.

HED:
- Nothing to report.

SCS:
- Not present.

SQS:
- All good at SQS.
  248   04 Aug 2021, 10:19 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 04.08.2021
General Announcement:
- There was a power glitch last night around 10:30PM at the Desy power distribution. XHQ and XHEXP1 seemed to be not affected - probably devices that gets cooling water from Desy could be affected. 
Please inform XO if it is found any affected equipment in the XHEXP1 side.
- Raul V. asks on the fix CTRLs has applied to the vacuum issues last week. Steffen H. will give details offline.

CTRL:
- Bi-directions of clones may not have been working properly and CTRL is investigating and preparing a solution for it. 

DA:
- Nothing to report.

EEE:
- Small issue with FXE timing (strange behavior of RTMs). It happens when communication to main timing system is interrupted and it affects mainly the FXE PLCs. Result is that devices may not correct 
trigger.
- Cable installation currently ongoing in HED and scheduled at FXE (cw33). 

VAC:
- Last night status of critical pumps was checked and seems that there was not water interruptions (very first time for a power glitch). These pumps stay working normally during the night.

XPD:
- No issues to report due to the power glitch.

DET:
- Jungfrau activities at SPB were delayed because of beam delivery issues with the number of bunches.

ITDM: 
- Nothing to report, also regarding to the power glitch.

XRO:
- Not present.

LAS:
- Unaffected from the power glitch. PP-Lasers are working.

UNSYS:
- Everything is fine with Undualtors.
- SA3/cell6 quad mover has a problem unrelated to the power glitch. As agreed with BKR, it stays as it is Monday when corrective actions to recover it will be made.

SPB:
- Beam delivery problems yesterday regarding the bunch number: A. Galler says that accordingly to W. Decking, when running in interleaved mode it may cause that problem if the suppressions does not work 
correctly. 
Further investigations are under way by MXL. If this is an issue for equipment BKR can install an interlock on the Big Brother and probably a detailed discussion with interleaved mode instruments can help 
in this direction.

FXE:
- Nothing to add.

MID:
- Looks like the beam today is very unstable. Data were collected and the stability task force will be contacted.

HED:
- Nothing to report.

SCS:
- Not present.

SQS:
- Yesterday a situation happens when 1 PLC went OFF unintentionally, causing a pump went OFF afterwards. SQS asks if this can be followed in a way the pump does not goes OFF in such events. 
Raul V. comments that 5Hz turbopumps at the tunnel have a configuration to prevent it by disabling the automatic switch in the component configuration. 
Nerea J. says that they can take both tunnels and SQS used configurations to bring them together. 
  247   02 Aug 2021, 12:06 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 02.08.2021
General Announcement:
-	 

CTRL:
- Deployment announcement: there are two more motors to be updated on ARAVIS cameras (photonic and Bassler). CTRL proposes to do this afternoon. 
Cameras devices will be down after update, aimed to enable train-ID corrections. Please instruments check on Tuesday if cameras are back.

DA:
- Nothing to report.

EEE:
- uTCA CPU in SA1 balcony room is not reachable. Bruno F. is investigating.
- CPU of LOOP16-SQS is not reachable. Nerea J. will check it today.
- Issues with LPD and AGIPD are being tested in the lab and the check at FXE will be done later today.

VAC:
- Some OCD calls related to instability of SA3 vacuum loop. DOC is informed and shall be working on that.

ME:
- Alberto De Fanis asked if ME is present, willing to discuss topics. A. Galler says group was around a couple of times and if groups have questions please use this meeting series to address.

XPD:
- No issue to report.
- Steffen H. will check if some XPD tunnel devices are affected by the ARAVIS update.

DET:
- Nothing to report.

ITDM: 
- Influx problem on Thursday (disabling live-view on Karabo): with help of Influx data support this was fixed. The cluster is up and running well. 
The part of the old data during the time it was down was written by Grafana and will be synchronized back to the cluster during this week (tests are needed).
- Following on Friday for the Influx third node that went down (not related to the previous incident): DOC was blind for a couple of hours. Investigation ongoing. It's not related to Grafana. 
Instruments were not affected.
- Reminder of reviewing and closing proposals for the second half of this year. Please look at the sent e-mail and make a cleanup. 

XRO:
- Not present.

LAS:
- All PP-lasers are running.

UNSYS:
- Issue with phase shifter in SA3 for the 3keV use: problem is that at 14 GeV the tables of phase shifters go to 25.3mm gap and this is in the upper limit for making 3 keV. 
Phase shifter tables will be extended to a larger gap. Better to use 3keV at higher electron energies.
- For the UOM's mention on the update of phase shifters on the chicanes, this has to be prioritized. XO will discuss with Sara C.

SPB:
- Minor issues with SPB imager being saturated. A. Koch adds that it will be followed up and he is aware and will analyze better.
- Organization limitation: RF discussion for last weekend. The BKR / Operators were not aware they would use 404 bunches and costed 2 hours.

FXE:
- Nothing to report.

MID:
- All fine at MID.
- Laser went down for 12 hours due to the issues with HED interlocks on Wednesday (action taken due to the restart of laser interlock performed by SRP).

HED:
- Not present.

SCS:
- Issue on the scanning speed of monochromator. Parameters will be adjusted with Marijan S. today.

SQS:
- Loop for moving DSSC got a fault but has been addressed by EEE.
  246   28 Jul 2021, 09:29 Arvid GebhardtGeneralInformationNotes XO Integration Meeting 28.07.2021

General Announcement:

- No general announcement.

CTRL:

- Problem with cameras / DAQ: fixed yesterday and tested at SA2/MID.

- Issues with SA3 vacuum loop: work ongoing and further investigations are needed.

DA:

- Nothing to report.

EEE:

- Cables available for HED to be installed next week – date to be discussed offline.

- Fast electronics side: working on FXE and HED issues;

- Nerea J. reports on the VAC/SA3 issues: instability with devices going into an unknown state. Alessandro S. works at the night shift in the DOC and will try to fix a permanent fix during the night.

VAC:

- SA3 issues are affecting also the gas attenuator (not only general SA3 vacuum loop but also GATT is affected, which has its own loop). There are no physical events - seems to be electronic. Stability issues to connect devices; Seems to be more related to infrastructure (PLCs). Further investigations are needed.

ME:

- Not present.

XPD:

- SPB imager: change setting of motors (it shall work now) and next week when A. Koch is back further investigations will be done.

DET:

- During the night after 02:00AM: SPB AGIPD K-bridge went OFF. Under investigation. Detector recovered this morning.

ITDM:

- Nothing to report.

XRO:

- Not present.

LAS:

- Nothing special to report.

UNSYS:

- Nothing to report.

SPB:

- Issues with wings of Agipd, causing also interlock trigger. Under investigation.

- 11PM last night: laser interlock triggered. It happened also in the past and SPB will get in touch with Safety today.

- XTD9 IMG: currently working but a permanent fix is welcome in the future.

FXE:

- Not present.

MID:

- All fine.

HED:

- Major issues with Agipd detector yesterday (thanks to DOC for help): 1. Could not kill the service and CTRL investigated; 2. Clock and control did not work (it has worked at CFEL last week). The issue was solved by changing the clock controller back to old configuration (EEE helped). Bruno F. comments that the clock control had to be downgraded in this detector (it worked in other detectors, only this one did not work). Further investigations will follow.

SCS:

- Change of speed from the monochromator was not possible. EEE and CTRL are working on it.

- Next week will run with a special train picker / bunch sequence pattern as the one used last week.

SQS:

- Vacuum problem as mentioned.

- Commissioning DSSC for future beamtimes.

  245   26 Jul 2021, 09:20 Arvid GebhardtGeneralInformationNotes XO Integration Meeting 26.07.2021

General Announcement:

- Power glitch 3 times at night, what brought down the beam for 1,5 hour each time. Please report to XO if you find devices affected.

CTRL:

- Datalogger update to take place today between 16:00-17:00. Please inform CTRL in case of problems with this schedule.

- Aravis camera and bunch pattern decoder to be updated at around 14:30. Please inform CTRL in case of problems with this schedule.

DA:

- OCD side: no new problems.

- Follow up last Wednesday: better is to use the new Karabo with the fix and not to downgrade the Karabo version.

EEE:

- Ticket from SCS was solved.

VAC:

- Some trouble with the pumps in the gas attenuator SA3. It needs to be fixed today in the tunnel with a ZZ (30 mins).

ME.

- Not present.

XPD:

- Are investigating, if something is affected by the power glitch. So far nothing was found.

DET:

- Nothing to report.

ITDM:

- Two issues to follow with MID: 1. Bassler camera seems to be the data wrongly recorded at DQA. Tests need to be done; it’s a camera used for feedback. Ulrike B. will talk offline with K. Wrona.

- Second issue: on Friday there was one ADC from tunnels to be used from MID was requested a bit late. Data comes from the uTCA from Desy network. If this device is going to be used in full, it has to be set inside Desy network.

XRO:

- Not present.

LAS:

- Two incidents: the power glitch at 19:23 yesterday took Amphos in SA1 down. It is back and operational; In SA3 LAS is further investigating the Amphos.

UNSYS:

- No problem with the power glitch.

- The temperature in SA3 Undulators is stable.

SPB:

- SPB imager at XTD9: is not working and has to be changed the outcome needs to be fixed of XPD. Naresh K. will contact SPB.

FXE:

- Not present.

MID:

- All good at MID – not heard on affected systems due to the power glitch.

- Friday afternoon confusion with the fix of Extra Foam bridge. Probably DA is aware.

HED:

- Vacuum system ok after power glitches.

- Nothing to report.

SCS:

- Not present.

SQS:

- Not affected by the power glitch.

  244   21 Jul 2021, 10:05 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 21.07.2021
General Announcement:
- XO would like to remind instruments that in case it is planned to use beam after 23:00, please put this information in the delivery table for that all involved parts are aware of it.

CTRL:
- CTRL has prepared the fix for the new Camera and would like to apply it. Instruments are in process to be contacted to arrange the best suitable time (10min downtime).

DA:
- MID observed incompatibility in Karabo bridge and framework. Two fixes can be done and will be arranged with instrument contacts. Upgrade of Karabo bridge must be less invasive. 
Steffen H. adds that on MID the hot fix did not make the expected result, so the less invasive is better option.

EEE:
- Nothing to report.

VAC:
- Not present.

ME:
- Not present.

XPD:
- Not present.

DET:
- Tests with LPD are being carried on (for the electronics; at FXE hutch last Monday). Detector has a small issue with configuration. If LPD runs correct, then it will be available. More information to 
come until next week.

ITDM: 
- K. Wrona mentions on the internal proposals. If one wants to have a logbook this has to be requested in advance as it is not automatically created. 
The procedure for the internal proposals is set in a way that a request for the creation of logbook has to be made (and not at the last minute).

XRO:
- Not present.

LAS:
- All laser available for delivery.
- SA1 laser timing system was changed last Monday morning. If someone wants to change timing system (or accidently has changed), please contact LAS.

UNSYS:
- Klima PKG in SA3 must be still OFF. Temperatures in the vacuum chamber are being monitored.

SPB:
- Nothing to report.

FXE:
- Started preparation for commissioning and user experiment. LPD test is prevented by issue with broker control.
- PLC crates installation/update is ongoing with Loop2. This has to be coordinated as they get beam today at 15:00. Nerea J. says there are issues with that crate and it is planned to be done today.
- Access into Doocs for changing XGM settings were not permitted (due to access rights). Desy colleagues from BKR explained that the mapping to accounts have been lost. The BKR colleagues are making the 
changes when requested by FXE.

MID:
- Not present.

HED:
- Thomas P. asks if the operators table had been discussed with XO as he was absent last couple of weeks. A. Galler confirms Ulf Z. had contacted XO and the tables have been shown at the recent UOMs.

SCS:
- Commissioning phase and looking forward to the beamtime.

SQS:
- Nothing to report.
  243   19 Jul 2021, 11:37 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 19.07.2021
General Announcement:
-  A. Galler asks the instruments to also take a look at the operators table as they have a shift-by-shift information for X-ray delivery, not only into the delivery tables.

CTRL:
- Influx logging update: CTRL might have found the couple of devices producing the problem. Solution has been found by restarting and synchronizing the timing clock.

DA:
- Nothing to report.

EEE:
- Nothing to report.
- MID cabling is done.

VAC:
- Nothing to report.

ME:
- Not present.

XPD:
- Nothing to report. 

DET:
- Assessment of the humidity issue; minor problem with the control humidity (power supply) interlock.
- A. Galler asks when PP will be available to FXE. Answer is that there is not yet a fix date.

ITDM: 
- Nothing to report.

XRO:
- Harald Sinn says the three SASEs were aligned, excluding the Monochromators. Beam is available at the end of the tunnels.
- Issue 1: at HED the M3 mirror was with Platinun strip inserted for sometime and may be damaged (it has been changed). 
- Issue 2 with backlash: running in a single mode and must be two backlash – ticket issued to CTRL and may affect the MC motors. Nerea J. is aware and get in touch with Harald Sinn (info from Jorn 
R.).

LAS:
- Trouble with humidity changes and can't guarantee beam pointing. Next few days one must be able to get back the proper operation. Changes from Desy originated the change and TS was not informed.
	
UNSYS:
- Suren K. informs that the PKG in SA3 does not work. A ZZ is needed by TS (Christian Holz). A ticket has been written for ZZ. TS has only one person allowed to go to tunnel but one UNSYS technician can 
accompany TS.

SPB:
- Nothing to report.

FXE:
- Not present.

MID:
- All fine.

HED:
- Not present.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  242   14 Jul 2021, 09:28 Andreas GallerGeneralInformationNotes XO Integration Meeting 14.07.2021

General Announcement:

  •  

CTRL:

  • InlFlux logging, some statisitics had been gathered --> but no root cause had been found.
    • Load Balancer would needed to be restarted --> data inside buffer would be

DA:

  • all good

EEE:

  • PLC team is still busy with check up of the "fuse" issue
  • MID cabling going

VAC:

  •  

ME:

  •  

XPD:

  • one XGM didn't ecevice a signal
    • quickly resolved
  • downstream XGM's are running as well

DET:

  • AGIPD
    • dark procedure fixed and seems to be working now at SPB/SFX, has to be installed at HED and MID
  • LPD
    • 3 supermodules had been moved to the DET LAB --> so far visual inspection does not show major issues
    • no module powered yet
       

ITDM:

  • nothing to report

XRO:

  • SA1 was aligned
    • SPB/SFX done

LAS:

  • humidty in PPLAS
    • TS working on it
      • PKG after maintenance did not come back to specs

UNSYS: 

  • nothing to report

SPB/SFX:

  • nothing to report

FXE:

  • nothing to report --> shutter porblem solved

MID:

  • nothing to report

HED:

  • nothing to report

SCS:

  • triggers

SQS:

  • nothing to report

AOB:

  •  

  241   12 Jul 2021, 09:29 Andreas GallerGeneralInformationNotes XO Integration Meeting 12.07.2021

General Announcement:

  •  

CTRL:

  • InFlux, still experiencing delay with querying the database (20min, karaba; 5min Grafana)
    • Jan reports that in the XGM trendlines a similar effect is seen

DA:

  • nothing to report

EEE:

  • Friday call from BKR, because of MPS blocking
    • FXE SHUT MPS signal was not reset
    • ZA comments, that the reason is not yet clear --> ZA is contact with Rathjen and MPS experts

VAC:

  •  

ME:

  •  

XPD:

  • For the FXE SHUT it seems MPS and karabo data are differeing
  •  

DET:

  • LPD
    • Hazem is back on Friday --> Supermodules will be tested then in the Lab
  • AGIPD
    • special dark procedur currently not working well

ITDM:

  • nothing to report

XRO:

  • This week, component check in all SASE tunnels
  •  

LAS:

  • nothing to report

UNSYS: 

  • Friday
    • SA1 cell 10, Suren exchanged the coupler

SPB/SFX:

  • nothing to report

FXE:

  • nothing to report
    • PLC issues loop4 and loop7 solved

MID:

  • nothing to report

HED:

  • nothing to report

SCS:

  • nothing to report

SQS:

  • nothing to report

AOB:

  • Zunaira --> beam shutter keys

  240   07 Jul 2021, 09:14 Andreas GallerGeneralInformationNotes XO Integration Meeting 07.07.2021

General Announcement:

  •  

CTRL:

  • nothing to report

DA:

  • Nothing to report

EEE:

  • XTD 10 ZZ uTCA excahange

VAC:

  • nothing

ME:

  • nothing

XPD:

  • within next three days XPD equipment to be checked with x-rays
  • DAQ test next Monday
  •  

DET:

  • LPD
    • communication with RAL and STFC, no sign of corrosion --> single module to be taken out and test in the lab

ITDM:

  • nothing

XRO:

  • nothing
  •  

LAS:

  • redmine tickets

UNSYS: 

  • nothing to report

SPB/SFX:

  • ITDM DAQ test today

FXE:

  • nothing --> hutch being prepared
  • PLC loops 4 and 7 are down due to hardware issues on the PLC --> EEE on it.
    • sample stack --> loop4 preparation delayed

MID:

  • pre is going on, everything

HED:

  • nothing

SCS:

  • nothing

SQS:

  • nothing to report

AOB:

  • Zunaira --> beam shutter keys

  239   07 Jul 2021, 09:07 Andreas GallerGeneralInformationNotes XO Integration Meeting 05.07.2021

General Announcement:

- User Operations Meeting will resume on Friday

CTRL:

- Last week found small bug for the fastADC – short down time requested

DA:

- Nothing to report.

EEE:

- Fast electronics – are planning a ZZ

- Fuses issue – MID & HED medium priority crates fixed

- SASE 3 vacuum loop has to be updated – today afternoon or tomorrow around lunch timewill be coordinated by XO with EEE and MXL

VAC:

- Nothing to report

XPD:

- Start up of equipment

DET:

- Nothing to report.

ITDM:

- Nothing to report.

XRO:

- Nothing to report.

LAS:

- Alignment Laser interlock issue at SA3, being investigated

UNSYS:

- Nothing to report.

SPB:

- some motor issues after crate restarts in connection with but not caused by the works adressing the fuse issue

FXE:

- Nothing to report.

MID:

- all fine

HED:

- nothing.

SCS:

- Nothing to report.

SQS:

- Nothing to report.

  238   30 Jun 2021, 10:55 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 30.06.2021
General Announcement:
- D3 starts the radiation interlock / TUV tests at XHEXP1 today. Initially by SA1, followed by SA3 area. 
Torsten Schoen will be available to bridge SA2 power supply only when tests are to be done in these instruments. One can work in SA2 until RPOs arrive to start tests in that hutches.
- Accelerator will start next week and first delivery beam to instruments is on cw29.
- First UOM starts on July 9th possibly discussing X-ray delivery parameters.

CTRL:
- Influx logger stress tests taking place this morning between 10:00 and 11:00. 
- Karabo 11.2 is out and instrument contacts will get in touch for deployment.
- Fix for the time zone configuration together with EEE: hopefully by the end of the week this will be fixed automatically otherwise it is done manually.

DA:
- Nothing to report.

EEE:
- PLC modifications at SQS is done; then followed at SCS and FXE.

VAC:
- Nothing to report.

ME: 
- Working together with VAC, XRO, XPD and UNSYS.

XPD:
- Andreas K.is working in XTD9, testing synchronization signal for Shimadzu camera (sync signal comes from PLC).

DET:
- LPD detector at FXE had water condensation yesterday. The chiller was ON with low temperature set (15 C). Together with EEE put detector in safe state (detector was OFF but not the chiller). 
Responsible person will be back in two weeks. Martin K. adds says that temperature setpoint was then set to 22 C and there is no apparent reason for the 15C set.

ITDM: 
- Nothing to report.

XRO:
- Info to SA3 instruments: XRO would like to test SA3 mirror motors from 10:30-11:30. Please do not touch mirrors in this timeframe. SQS and SCS do not see problems with it.

LAS:
- SA1 and SA3 PP-lasers are restarted and preparing for operation.
- Trigger for SA3 PP-L after Karabo upgrade does not work. The feedback also does not regulate. Tickets were sent to CTRL. After feedback it may contact also EEE.
- SA2 Seeder oscillator is exchanged and sync has to be restarted.
- A. Galler asks about spares for Seeders. Man J. says the spare was installed in SA2; one remaining oscillator is used in the lab and then LAS must stop R&D projects in case it is used as spare for one of 
the PP-lasers.

UNSYS:
- Nothing to report.

SPB:
- Richard B. says tunnels trigger that XPD works in tunnel have no relation to the timing trigger board.

FXE:
- LPD issue: chiller appears to be dry again this morning after setting it to 22 C.

MID:
- Nothing to report.

HED:
- Fuses activity to start today. EEE and Bruno F. confirm this plan. 

SCS:
- All fine at SCS.

SQS:
- Nothing to report.
  237   28 Jun 2021, 10:28 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 28.06.2021
General Announcement:
- A. Galler reminds that Interlock tests are coming this week to the hutches. D3 did not make a schedule with respect to each hutch and when. 
As soon as the interlock tests are done in one instruments this will be informed to XO which in turn will communicate to the respective instrument.
- Thomas P. asks if there is a way to bridge instruments only for the tests and not for the whole two days. XO will check with TS and SRP; during the tests one can't access the hutches; 
in case one has the bridge done for the two days one can also work there with the presence of the EQP.

CTRL:
- Scheduling announcement: 
1. Bug in the current fast ADC devices. This is applied at LAS and will be deployed for the whole facility. Proposition for the tunnels is today afternoon; 
2. uTCAs in general: time zone is set to Greenwich time; it is not a major issue but CTRL will ty to fix that; 
3. CTRL will use the Influx logging by testing with the Interlock signals; 
4. Legacy Read the docs will be switched OFF.

DA:
- Nothing to report.

EEE:
- Today start cabling installation at SQS.
- Fuse changing currently ongoing in SQS and to start afterwards at SCS.

VAC:
- Information for tunnels: XTD9 may open again Tuesday afternoon for other works.

XPD:
- XPD is interested to work in XTD9 when it can be opened again.

DET:
- DSSC detector activities at SQS: commissioning without beam is over and was successful. Commissioning with beam to be done on cw30.

ITDM: 
- Nothing to report.

XRO:
- Not present.

LAS:
- Nothing to report.

UNSYS:
- Nothing to report.

SPB:
- Finished all fuse works at SPB. Few issues were found on Friday and other tests are still ongoing. Richard B. will inform other groups on the issues via XO.
- Received DAQ test request from Parthasarathy T. and shall be ready for Wednesday.

FXE:
- Issue with uTCA bug on the 10Hz trigger appeared but has been fixed.

MID:
- All fine at MID.

HED:
- All fine.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
ELOG V3.1.4-7c3fd00