Group Selection Page HELP Controls Group Data Analysis Group ITDM WP76 DET Vacuum EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Operation PSPO XO TS Migrated2Zulip
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Technical integration and coordination logbook, Contact: A. Violante, G. Wellenreuther, Page 5 of 31  Not logged in ELOG logo
ID Date Authordown Location Severity Subject
  184   07 Dec 2020, 11:08 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 07.12.2020
General Announcement:
-	 

CTRL:
- Deployment updates: control network topics are through - SPB to be done in January.
- BKR and notification service updates to be deployed tomorrow or Wednesday.

DA:
- Nothing to report.

EEE:
- Cabling: finishing FXE and starting HED in the course of this week.
- Fast ADC: uTCA in SCS will be restarted for updated. SCS will contact Bruno F.
- SCS racks: cooling water is disconnected. Thomas Baumann informs TS needs to order cooling water lines and only in January will be connected. 
It is suggested to run with open doors in the meantime; Nerea J. says if one needs 1-2 loops then this is fine; Thomas B., Ulf B. and Nerea J. will discuss the details. 

VAC:
- Nothing to report.

XPD:
- PES installation will happen next Wednesday/Thursday. J. Laksman will contact VAC.
- Alarms in various XGM seem last week were due to updates. It is not a real problem.

DET:
- Nothing to report.

ITDM: 
- Lennart B. coordinates with instruments.
- Due to tomorrow timing update, the upgrade of DAQ on tunnels devices to start on Friday. Others will be contacted individually.
- Jan G. asks on issues of recording DAQ of PES during Petra ongoing beamtime. K. Wrona says it would be better to be informed in advance on the beamtime. 
The issue happens due to overload with a buggy script. If this script is not running, then the issue should not repeat again. 
At Petra it is used a standard control network which is different from the one at EuXFEL.

XRO:
- Not present.

LAS:
- All lasers are in local timing mode.
- LAS requests Bruno F. to have a crate update today as they have ongoing work in SA3. Bruno F. says the updates are agreed to be done today.
- Laser interlock upgrades: there is no news or known progress.

UNSYS:
- Not present.

SPB:
- Detector intervention ongoing and nearly finished. Test with DAQ and final test by end of this week. It is expected to be ready for Monday.

FXE:
- Elektro Wille firma working in the hutch.

MID:
- All fine at MID.

HED:
- Nothing to report.

SCS:
- Water leak last week was the only major event.

SQS:
- Nothing to add.
  185   09 Dec 2020, 10:24 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 09.12.2020
General Announcement:
- Regarding the e-mail related to the general radiation training and procedure to deliver a signed certificate, one can also send it by conventional post to Zunaira A.

CTRL:
- BKR machines has been updated to the new Karabo release.
- The Notification service update will follow form today.
- CTRL reminds on getting configuration from the timing feature on the GUI: right click on the device and then "get configuration". 
An e-mail with detailed instructions will be sent today.

DA:
- Nothing to report.

EEE:
- Fast electronics: SASE3 maintenance is finished; SA2 will follow.
- PLC side: SQS has some loops running but not all of them due to the cooling issue. SCS will get their loops soon running.
- Cabling works at FXE is completed; at HED is ongoing.

VAC:
- Not present due to tunnel activities.

XPD:
- XPD has completed PES beamtime at Petra. Would like to thank ITDM for the smooth work. XPD has collected data for over 300 runs.
- Today XPD brings back other PES to SA3 tunnel. There is an appointment with MEA and the plan is to connect to the beamline tomorrow together with VAC.
- A. Koch asks EEE at CTRL if DAQ tests on XPD tunnel devices can happen on Friday. 
Nerea J. points SA3 is not yet commissioned (has to check motors) but SA1 and SA2 can be done on Friday as it has only pending vacuum update. 
Steffen H. says that cameras can be tested in all 3 SASEs; connections shall be fine; requests a list of all cameras. 
Jan G. adds the idea is to verify the components can be operated and acquire data, following a test with XPD/ITDM. 
Steffen H. reminds that for testing the digitizers one has to re-start (faster ADC) the device server. 

DET:
- Not present.

ITDM: 
- Nothing to report.

XRO:
- Nothing present.

LAS:
- Lasers are on good track.
- Interlock tests: there was miscommunication. The SA2 AMPHOS is disassembled for maintenance and therefore the PP-laser test in SA2 is postponed to next week. 

UNSYS:
- Not present.

SPB:
- Nearly done with putting together the AGIPD. The Final test for DQA begin next week.
- Problem with timing but currently it has been running on local mode.

FXE:
- Not present.

MID:
- All fine at MID.

HED:
- Nothing to report.

SCS:
- Not present.

SQS:
- Nothing to report.
- SQS has ongoing work on Beckhoff crates.
  189   11 Jan 2021, 10:54 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 11.01.2021
General Announcement:
- The Interlock test light in the hutches take place on January 13th. From tomorrow is starts in the tunnels. 
We understand no support from instruments are needed and we thank HED and FXE for making their hutches available for these tests.
- A Functional interlock test was planned for the end of January. This will be shifted to later point in time.
- XO states that planned maintenance tasks that are critical for operation can of course be performed onsite at the XFEL campus. 

CTRL:
- Updated the microTCA crates was done.
- CTRL is testing many other systems.

DA:
- Nothing general to report.

EEE:
- Critical task to do related to the AIBS CPU: one power bridge is missing. EEE has to check and may need to switch one PLC off to replace the power bridge.

VAC:
- Continuing with tunnel installation works: urgent tasks.

XPD:
- No incidents to report. Tunnel works are ongoing together with VAC.
- Jan G. informed that not all channels are working in fast-ADC devices. XPD has informed CTRL and Steffen H. says that CTRL and EEE will take a look together.

DET:
- LPD calibration pipeline work is ongoing.

ITDM: 
- Nothing to report.

XRO:
- Ion pumps in SA1/3 photon beam transport are running. Pressure is in the order of 10^-8mbar.
- SA3 mc2 library update: continuing with checks some small items will need to be commissioned with beam.

LAS:
- Nothing to report.

UNSYS:
- Finishing small tasks at SA3 tunnel.

SPB:
- Start planning the revised schedule.
- XO informs that the emergency power OFF test takes place today in SA1 instruments. 

FXE:
- Nothing to add.
- XO informs that the emergency power OFF test takes place today in SA1 instruments.

MID:
- All fine at MID.

HED:
- Nothing to report.

SCS:
- Not present.

SQS:
- Nothing to report.
  190   13 Jan 2021, 10:04 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 13.01.2021
General Announcement:
- Test of power grid switching affecting green and orange power sockets: this was planned for tomorrow 14.01 but it is not shifted to 02.02. 
For a second or so it may trigger power OFF in equipment. Groups have to identify devices that are connected to these sockets, for example at the instrument hutches. 
Devices shall be made safe. On the instruments rack room, equipment have two power supplies and therefore they shall be transparent to this intervention. 

CTRL:
- Nothing to report.

DA:
- Nothing to report.

EEE:
- Today EEE connects the new PLC for the AIBS project in SASE1 balcony room. One needs to restart momentarily EPS, SPB and FXE loops in SASE1 Tunnel after lunch. 
An e-mail was sent yesterday and clarified with instruments.

VAC:
- Tunnels are closed today for the interlock tests. XO thanks HED and FXE for making their hutches available.

XPD:
- Tomorrow XPD restarts with tunnel works, e.g., alignment of PES/XTD10 together with MEA.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- Not present.

LAS:
- Proceeding with small steps but lasers are OFF.
- LAS waits for feedback from SRP and MB on the safety issue. Thomas Tschentscher will bring the safety issue to be discussed offline with MB, LAS and SRP.  
Zunaira A. questions if there were problems to re-start the Seeder Lock-in. Tomasz Z. says it is currently locked but after much additional work (no guarantee it can be 
locked again if Seeder is once more OFF). 

UNSYS:
- Working in the completion of SA3 undulator system.

SPB:
- Drilling ongoing: please keep in mind access to hutch may be affected.

FXE:
- Nothing to add.

MID:
- Wille Firma is working on cabling installation from today afternoon.

HED:
- Expecting Wille will be working from today but shall not interfere with Interlock tests. Zunaira A. says that interlock activities take around 20 minutes during this 
afternoon.

SCS:
- An external company is currently working onsite.

SQS:
- Nothing to report.
  191   18 Jan 2021, 09:44 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 18.01.2021
General Announcement:
- Clarification on the definition of a critical work will be made this afternoon during a discussion with group leaders and will be communicated to the staff. 
It includes also tasks carried out by two different groups.
- On Thursday there is going to be a switch of MPS components in the balcony room. 
This affects the timing signal distributed to XFEL, e.g. Lasers will not be able to follow timing. 
- Test of automatic switch of power bridge is shifted to Feb.2: this affects all devices connected to orange or green power sockets (no power for few seconds/minute).
General e-mail will be sent. Instruments will need to care for equipment which is connected to these sockets. 
This also affects the E0 level as well as office space in XHQ. Pease plug devices out or re-plug in other sockets.

CTRL:
- CTRL enquires ITDM on the issue with DOC (disk space full error). ITDM will take a look into it. 

DA:
- Getting prepared for involvements such as the data operation center.

EEE:
- Update of SA1 loop motion to take place by Wednesday. Affected staff is already informed.
- Firma Wille work on cabling is ongoing.

VAC:
- Continuing with works in the tunnels.

XPD:
- Tunnels works in XTD6 and XTD9 are ongoing. No incidents to report.

DET:
- Working on data analysis calibrations and installing the DOC.

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- Regarding the Timing signal interruption mentioned in general announcements: it is not a problem as usually LAS keep the laser systems in the local timing during 
shutdown periods.
- Upgrading hardware that should be updated accordingly to the plans for the shutdown.

UNSYS:
- Works in tunnel are proceeding.
- Issues with SA2 cell 26 and cell27 were found and experts are going to the tunnel to solve it.

SPB:
- Working on making experimental plans for the Covid-19 beamtime.

FXE:
- Detectors: software upgrade taking place from today.

MID:
- All fine.

HED:
- Nothing to report.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  192   20 Jan 2021, 10:32 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 20.01.2021
General Announcement:
- A. Galler encourages attendants to pose questions on the authorities decision of lockdown prolongation:  
Zunaira A. asks on travel restrictions between different cities: The commuting continues to be allowed, but not business travels; 
Adriano V. asks on business/meetings that were postponed (MID/AGIPD intervention) to February in order to plan work that will happen during the summer shutdown: Andreas 
G. says that if meeting can't be decided by Zoom, please send an e-mail to the task force with this enquire;
P. Gessler asks if EuXFEL considers to prepare documents (passport) again as in the first lockdown: A. Galler answers that this is in discussion but currently it will not 
to be implemented once no curfew is ongoing.

CTRL:
- Working with ITDM to get the Docs system running again.
- Working with EEE to have systems running by Friday.

DA:
- Nothing to report.

EEE:
- EEE reminds the update of SA1 motion loop (to allow work for Hirex) will take place today.

VAC:
- Not present.

XPD:
- Progressing with tunnel works, e.g. installation of viewports.
- A. Koch asks on the tunnel closure plans for XTD6 and XTD9. 
A. Galler says XTD9 will close around February 5th and for XTD6 one has to discuss with MXL-DESY on the possibility to keep it open for one week longer (until 12.02).

DET:
- Nothing to report on detector operation.

ITDM: 
- ITDM needs to finalize GPFS work which requires one day maintenance. The proposed date is next Monday 25.01. It means no access to data from Maxwell during the all day.
Instruments shall contact ITDM until tomorrow 21.01 in case of restrictions. 
- Tickets on e-mail lists (e.g. not authorized sending e-mails to some lists): ITDM is investigating.

XRO:
- XTD6 will have photon beam for recommissioning during the third week of February.

LAS:
- LAS asks instruments on their plans for when to use lasers (mid-February?). HED and MID confirm plans to have it by middle February. SQS, FXE and SCS will consult 
internally and let LAS known.

UNSYS:
- Two quad movers in SA2 are working again.
- Afterburner (winter shutdown tasks): Fire extinguishing system to be build; Cleaning the tunnel has to be made prior switching on the PKG.

SPB:
- Nothing to report.

FXE:
- Upgrade of Jungfrau and related work is postponed to Friday.

MID:
- All fine at MID.

HED:
- Nothing to report.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  199   17 Feb 2021, 08:52 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 15.02.2021
General Announcement:
- It had been a cooling water issue with SA1 and SA3 PPLs on Saturday. Other groups are encouraged to check their components for eventual damage. Cooling water is back 
again.
- Change on definition of a critical work: everything that leads to operation is from now on considered a critical work (official communication will be send by e-mail).
- Tomasz J. says interlock tests in SA1 tripped the laser interlock due to the Seeder connection to the interlock. 
Andreas G. says there are care been taken to prevent this in future. More discussion will follow.

CTRL:
- Updates were done on the time servers and data loggers.
- GUI servers will be done this week as there was no access to GITLab. Current suggestion is next Wednesday morning before 08:00AM. 
Each topic will take a few minutes only. XPD is fine with the proposed day/time.

DA:
- Nothing to report.

EEE:
- Issue during weekend: signals to the absorber. EEE and PRC (Maurizio V.) will coordinate when it is the best time for applying the final fix. 
EEE needs to mask it for proceeding with the work.

VAC:
- VAC OCD was involved in the absorber EPS issue.
- Today around lunchtime the XTD6 and XTD9 will be closed.

XPD:
- EPS issues: any component driven to the beam was not protected by many bunches operation. The EPS was thinking the PNACT was closing but in reality, it was opened.
PRC/EEE/VAC/XPD OCDs solved by manually telling the system it is closed.
- Wrong bunch number sent to XGM: SA3 toroid was moved to a different position and the old name was not valid anymore. 
Info from this toroid was not received and the consequence XGM was receiving wrong bunch numbers. This makes impossible for the XGM to calculate correctly the number of 
bunches. 
Doocs servers were not updated (these programs would need to be informed of new naming). 
- Andreas K. says that XTD6 is clean. In XTD9 an intervention by EEE will take place. Bruno F. says that it is a simple task and we are accessing tunnels right now.
- Operation E-log 2021 is missing and must be created. 

DET:
- Offline calibration work is ongoing until tomorrow morning.

ITDM: 
- GPFS offline storage maintenance to be done today. 
- ITDM was notified by Desy that is necessary to reboot logins on Maxwell nodes (between 11:00-12:00).

XRO:
- Nothing to add to what was discussed on the EPS.

LAS:
- Affected by water cooling incident. SA1 came up without issues but in SA3 there is problem as AMPHOS did not restart.
- Trigger issue on last week are not the issue anymore. This was not repeated (but SA1 still on local mode).

UNSYS:
- BBA and photon BBA last week: new values to be implemented and minimum gaps will be updated accordingly.
- Frank Brinker tested the ambient field corrections. A ZZ is taking place this morning to fix SA2/cell12. 
Few other coils have different polarities and will be fixed today or in another ZZ.

SPB:
- Preparing for the first two weeks with beam in March.

FXE:
- Aligned the cameras in FXE mono.
- Crates to be installed in the rack room.

MID:
- Joerg H. raises the question on the FFP2 usage recommendation. Sandra Plett says the document containing guidelines will be prepared (hopefully today); 
It is mandatory to use FFP2 masks if you are not alone; it also depends on the room size and at the moment it is 3-5 people in the hutches with mandatory use. 
A. Galler says these are the current regulations and maybe this will change in future.

HED:
- Nothing to report.

SCS:
- Nothing to report.

SQS:
- Trying to get a new DAQ and will talk to ITDM.
  201   22 Feb 2021, 10:14 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 22.02.2021
General Announcement:
- In case someone has any remaining question on the use of masks in the hutches please feel free to ask in this meeting series or write XO an e-mail.
- Racks for the SXP will be delivered and moved around XHEXP1 in March. The calendar for such activities will appear in the EXFEL infrastructure calendar. 
The activity is coordinated by TS and in case of conflicts, please contact us or Ulf Brueggmann.

CTRL:
- Few configurations issues with motors are being taken care with EEE. 
- XPD found a bug in the middle layer device and it needs new deployment. CTRL will contact people involved.
- DOC will start going on next week. Further info will be sent around and contact to single points in the instruments will be made.

DA:
- Preparing the DA contribution to the DOC.

EEE:
- Nothing to report apart the work for the configuration of motors.

VAC:
- Vacuum interlocks triggered on Friday in SA3. VAC reminds that when someone opens the shutter, nothing behind must be left in the beam.

XPD:
- A. Koch says commissioning of SA3 components and Imagers take place. The Shimadzu camera was tested with beam in SA1 and signal was observed. 

DET:
- Preparing for regular support of Detectors.

ITDM: 
- A question arises if SASE3 also operating. A. Galler says there is an effort for commissioning beam transport on SASE3, but focus for operation still remains in SASE1.

XRO:
- XRO has commissioned beam transport in SA3 and in SA1. Overall beam was stable apart of few interruptions. Objectives for the weekend were successfully completed.
- Couple of issues need to be fixed; XRO will request ZZ access in XTD10 together with EEE. Tickets are sent.

LAS:
- No news from last week.

UNSYS:
- Nothing to report.

SPB:
- Issues with Laser interlock system and accessing hutches persists, as reported last Wednesday. SPB expects laser safety to be working on that. 
Romain Letrun confirms the problem is related to the DACHS access system.

FXE:
- It has faced similar problems with the interlock system as the ones observed by SPB/SFX.

MID:
- Hutch cleaning is planned this week.

HED:
- All fine.

SCS:
- Nothing to report.

SQS:
- Last Friday an interlock issue (no beam to hutch) was found but solved almost immediately.
  203   01 Mar 2021, 10:49 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 01.03.2021
General Announcement:
- An e-mail from Steve Aplin informs on how to contact the DATA operation center during beam delivery times. It changes contact phone numbers for OCDs. 
Old numbers are discontinued. The 98089 is the new number.
- The lead scheduling for machine/operation can always be found at the TTFINFO link (BKR E-log). Any other schedule is not official.
- Hutch search training goes invalid for many scientists in the instruments. Please check your status at the DARF-DACHS system or with RPOs.
- If there is anything unclear with masks or Corona rules, please give feedback in this meeting series or to the corona task force.
- Gerd W. says that works on SCS chicane are taking place right now. Afterwards a check will be done until Wednesday. The SCS key is still removed.

CTRL:
- Next days CTRL would like to solve DAQ situations while restarting devices. For SPB it is under discussion when to proceed.

DA:
- Not present due to planning meeting for end-to-end DA commissioning.

EEE:
- Fast electronics: a problem with SA3 PP-Laser (timing issue) was found and a board will be replaced.
- PLC side: deploying SA3 laser interlock. EEE will get in touch with XO for agreeing on a date.

VAC:
- XTD6 is still open and will be closed tomorrow (Tuesday 02.Mar) afternoon.

XPD:
- Friday at 15:00 there was a wide spread network issue and XGMs were giving warnings. The XGMs came back rather quickly but beam was lost until Saturday.

DET:
- Preparing for the SPB detectors commissioning with beam this week. One module was exchanged and will be evaluated next Monday.

ITDM: 
- Nothing to report.

XRO:
- Not present.

LAS:
- SA3 PP-laser: issue on Thursday afternoon late; Replacement boards were received. Tomasz J. informs the triggers were lost in the last 5 minutes.
- Tomasz J. question if LAS is going to receive enough support on Mondays from the DATA center as they have to prepare lasers for Tuesday. 
LAS expect same level of support on Mondays from DATA department. Steffen H. says that the OCD and Data Run coordinator will support the activities.

UNSYS:
- Nothing to report.

SPB:
- Receiving beam from tomorrow on.

FXE:
- Working with EEE to get Beckhoff loops finished for the AIBS test taking place at FXE on Thursday.

MID:
- All fine at MID.

HED:
- HED asks for the status on the ADC issue. Bruno F. says it is being fixed today (crate is up and running) and objective is to finish by today.
- Question to CTRL on cameras: S. Hauf says that CTRL will ask HED to test the fix. HED will contact Dennis G.
- Pouneh S. says that for laser safety googles it is exceptionally allowed to use FFP2 masks with filters. A. Galler points that the Corona task force strictly forbids 
this type of masks at XHEL as protection against Coronavirus. 
This subject will be brought to the Task Force for more clarifications.

SCS:
- Sliding door issue is ongoing. Eric Boyd says that Zunaira A. is in contact with the company and they will come to XFEL on Wednesday (it is caused by the controller of 
the door).

SQS:
- Nothing to report.
  205   08 Mar 2021, 10:49 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 08.03.2021
General Announcement:
- SPB/SFX will continue receiving beam this week for commissioning.
- Issues with access to the Operations/21 e-log: SPB run coordinator wrote to wrote to the admin but no answer so far. Entries by Adrian M. while using VPN also did not 
work. 
XO will follow with IT (see below).
- Gerd W. reports that works in SCS chicane are done and the radiation interlock keys are returned.

CTRL:
- Some observations triggered by DOC regarding XGM trains coming too late (20s). An update will be made later on the day or next days.

DA:
- Not present due to DOC shift compensation day.

EEE:
- Nothing to report.

VAC:
- Nothing to report.

XPD:
- A. Koch and Theo M. say no issues to XPD were reported. All operating fine.

DET:
- Commissioning beamtime with SPB detectors. The AGIPD program for last week was completed successfully.

ITDM: 
- Janusz S. says on the e-log issues that administrator of the e-log has the power to include new people. 
While using VPN access one can read the e-log and post entries using the copy function from another e-log. Nothing in the procedure has changed from past time.

XRO:
- Nothing to report.

LAS:
- SA1 PP-laser recovered power for SPB and is delivering in the nominal power level.
- SA3 AMPHOS was switching off at random during the weekend; no reliable operation in SA3. LAS is in contact with external company.

UNSYS:
- Cell4 and cell6 in SA2 required intervention from expert (Suren K.) during the weekend. 

SPB:
- Drift of horizontal beam position was observed on the weekend and reported to the DOC which provided a tool to diagnostic the drift. SPB/SFX would like to thank the DOC 
for the availability.
Beam pointing was changing every hour and was difficult to keep into M1 and M2. Theo M. says the XGM drift happened in the horizontal by many mm. DOC can not solve and 
then contacted Optics group. 
The observed drift seemed to be too big to be compensated. Richard B. says the movement was seen from XTD9 XGM and was a fast drift. 
Andreas G. will address communication channels between DOC/DRC and PRC (PRC was not informed). 

FXE:
- Floor refurbishment starts today.
- Last Wednesday it was checked the gate valves are corrected integrated in EPS and MPS. If shutter is open this signal is sent to the MPS and triggers closing V0.

MID:
- All fine.

HED:
- Nothing to report.

SCS:
- Nothing to report.

SQS:
- All good at SQS.
  207   15 Mar 2021, 11:26 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 15.03.2021
General Announcement:
- Following Desy e-mail to all EUXFEL staff, the emergency call system of the elevators will be offline on Thursday March 18th during the morning. Please avoid using the 
elevators in this day. 
- On March 23rd is scheduled the SEPS interlock tests in SA3. On March 25rd is planned for SA2, pending a confirmation with the machine on the impact in SA1 operation.

CTRL:
- Progressing with investigating the train-ID issues, currently it relates to DOOCS/Desy.
- DOC: reports one fix today at 13:00 (following a call). Please respect a sign "we are in", "we are out" at the DOC to help staff focusing on issues. 

DA:
- Nothing to report.

EEE:
- Nothing to report.

VAC:
- Nothing to report.

XPD:
- All working fine in XPD.
DET:
- Detector commissioning in SPB: AGIPD was completed as planned and Jungfrau seems to run properly (data to be analyzed.

ITDM: 
- ITDM will add more space to the storage system (data taking). Initial idea is to make it on March 30th to minimize impact. Acquiring data and data analysis are not 
impacted. 

XRO:
- Beam power increase ongoing.

LAS:
- An issue with SA1 interlock in PP-laser room: the inside doors were reported to be open on Thursday afternoon. 
As SPB was not using the PP-laser, the laser was put in safe mode and Interlock was broken to access and verify the situation. The internal doors were closed. 
Further discussions will follow. This door issue happened for the first time in SA1. 
- LAS is providing beam to SPB and HED as requested.

UNSYS:
- Couple of e-log entries on settings of air coils and phase shifter, all addressed during the weekend.

SPB:
- Detector program is completed. One measurement (which is not critical) is missing from Jungfrau.
- Interacting with DOC worked nicely.

FXE:
- Preparing for this week.

MID:
- Fully in preparation for first April beam. All fine.

HED:
- Nothing to report.

SCS:
- SCS asks for update of missing CPU from EEE. No news from EEE. Contact will be made.

SQS:
- Preparing to have beam in April.
  209   22 Mar 2021, 10:14 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 22.03.2021
General Announcement:
- The Covid-19 health task force is looking into testing schemes to be employed on-site. In the future there will be an opportunity to do the self-tests on-site for 
people who does critical works.
- The UOM series will restart on next Friday 26/03 at 09:00. Communication via e-mail will be send.

CTRL:
- Follow-up for delay train-ID: progressing with discussion on using longer time data.

DA:
- Thomas Michelat reports one issue with Agipd. The Maxwell server was restarted and then issue was fixed. If something similar happens again, the advice is to contact 
Maxwell team from Desy.

EEE:
- Today EEE perform the SEPS update for SA3 Interlock. For SA2 the test takes place on Thursday.

VAC:
- Not present.

XPD:
- Nothing to report.

DET:
- Nothing to report.

ITDM: 
- ITDM reminds on the storage/cache maintenance taking place next week (inclusion of additional storage place). Janusz S. will send an e-mail to readiness list.

XRO:
- Nothing to report.

LAS:
- SA3 PP-laser is off today due to work on interlock system. LAS hopes to get back as soon as possible (not before Thursday/Wednesday) for SCS use.

UNSYS:
- Problem in cell36/SA1 (communication error). A ZZ will be needed to recover the cell.

SPB:
- Ongoing with preparations for back-up user experiments; A problem with Jungfrau has been communicated.

FXE:
- Problem with Mono last week: positions for the crystals were shifted by 10mm. It is not known if this is a physical or only reading issue.

MID:
- Pressurized air by a compressor was moved to another location; the topic was discussed with TS and a big compressor will be installed until May 1st to solve problems. 

HED:
- Nothing to report.

SCS:
- Issued a ticket with EEE to verify possibility to averaging positions on middle layer servers.

SQS:
- Preparing for beam in April.
  210   24 Mar 2021, 10:06 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 24.03.2021
General Announcement:
-	 

CTRL:
- In SA2/HED few interlocks are protected and not altered. CTRL needs to re-start the HEDloop1 and HEDcryo loop and SA2 EPS loop. It takes about 5-10 minutes without PLC 
restart. 
Suggestion is to make it today: XO will communicate to HED. 
- When submitting a ticket, please include the device ID on it. 

DA:
- Not present due to training. 

EEE:
- Nothing to report.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- Problem with SPB Jungfrau: M. Sikorski says the chiller was OFF and two modules are misbehaving. One can’t be fixed now and cards are ordered and have to be replaced.
The Chiller went OFF manually. It may become protected by EPS.

ITDM: 
- Nothing to report.

XRO:
- Not present.

LAS:
- SA1 and SA2 PP-lasers are fine;
- In SA3 still ongoing due to small problem of missing train-IDs in ADC cards. Consequently, no DAQ data can be taken for SCS and SQS. 
Nevertheless, the laser is ready for SCS use (not yet available to SQS). 

UNSYS:
- ZZ for the cell36/SA1 took place on Monday. The problem related to a coupler (spare parts are available and were replaced). It is fixed.

SPB:
- Start with data collection. Aside from detector, no other issues.

FXE:
- Nothing to report.

MID:
- All fine.

HED:
- Not present.

SCS:
- A problem was found on Monday regarding the door interlock. 
Zunaira A. comments that during a hutch search training it was found that a switch off (red button /panic switch) was pressed and did not release the magnet locks.
SRP has contacted a company and they have to come in to fix it. 
Zunaira A. sends another instruction to SCS staff in how to proceed in case of emergencies (one has to open door manually).

SQS:
- Nothing to report. Panic button at SQS works normally.
  211   29 Mar 2021, 10:45 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 29.03.2021
General Announcement:
- The UOM does not take place on next Friday 02.April.
- Pouneh S. informs the SCS panic button is not properly working (the search hutch does not perform as expected). This does not prevent operation and will be look after 
in the coming days.

CTRL:
- Following the DOC developments; nothing major to be announced.
- Karabo 2.10.4 is to be released which contains features to facilitate opening scenes and has some bug features fixed. CTRL hopes for a wider adoption. 

DA:
- Nothing major to report.

EEE:
- EEE has a time slot on Wednesday from 10:00 to 15:00 to update loops in SA3 and SA2. Updates shall be transparent and an e-mail will be sent. 
A. Galler confirms there will be no beam operation during this time.

VAC:
- Nothing to report.

XPD:
- ZZ request for Shimadzu camera in XTD9: A. Galler says it is not yet scheduled. As soon as valid information is coming, it will be communicated (maybe on Wednesday 
during the loop updates time slot).

DET:
- Small things were fixed with DOC help on available calibration constants for one SPB detector was fixed.

ITDM: 
- Reminder of tomorrow's maintenance on storage system.

XRO:
- Not present.

LAS:
- Thursday's SA2 ADC problem was fixed. Today LAS and EEE will attempt to fix the SA3 missing triggers in the ADC cards.
- All PP-lasers are running.

UNSYS:
- Information: there will be from today to Wednesday tests in SA2 performance with and without air conditioning systems.

SPB:
- Few problems with last week solved by DOC.
- SPB shift crew said machine was running at 2.2MHz. This had to be informed to BKR Operators.

FXE:
- Nothing to report.

MID:
- MID requests that planned interventions in MID hutches that are longer than few minutes and restrict access to it shall be informed in advance. This allows proper 
planning of activities. 

HED:
- Started using PP-laser and preparing for next user run (also tests with THz laser).
- Konstantin S. would like to thank EEE for the help received during last week.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  212   31 Mar 2021, 11:01 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 31.03.2021
General Announcement:
- There is no UOM on next Friday April 02.
- The next XO Int. Meeting takes place on Wednesday 07.04.

CTRL:
- Loop updates by EEE today - CTRL will follow in case of support is needed.

DA:
- Offline calibration pipeline update was done yesterday successfully.
- Online calibration pipeline update: on Monday it was done in SA2; today it takes place in SPB with tests on the afternoon. These updates are related to the Detectors 
for the upcoming next user experiments.

EEE:
- Update in SA3 and SA2 motion loops from 10:00 to 15:00.

VAC:
- Not present.

XPD:
- Information got on the test of PKG for SA2: tests foreseen for this week was postponed.
- XPD working on the calorimeter.

DET:
- Nothing to report.

ITDM: 
- Update of the dCache storage was successfully done yesterday.

XRO:
- Nothing to report.

LAS:
- SA1 and SA2 PP-lasers are fine;
- SA3 PP-laser problem with timing system was fixed but required longer than expected. Laser was OFF until this morning. SQS shall not count with available laser (50-50% 
chances) tomorrow morning. 

UNSYS:
- PKG test was shifted.

SPB:
- Problem with laser hutch interlock when closing the door: when closing the external door this breaks the interlock (laser hutch). SPB will contact SRP.

FXE:
- Nothing to add.

MID:
- All right at MID.

HED:
- HED loop update takes place tomorrow. Nerea J. will discuss with HED; there is no restrictions from HED side.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  214   12 Apr 2021, 14:40 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 12.04.2021
General Announcement:
-	 

CTRL:
- Broker pile-up on Friday: Alessandro S. says that was triggered by network configurations; it took time to recover situation. 
Started SA3 topics for deployment and for few tickets related to that, please get in touch with DRC or try re-starting devices.
- Deployments: 1. Fix for data loggers and timing servers. We propose to do next Monday; 2. Karabo 2.10.4 was released with few bug fixes. CTRL is in touch with 
instruments.

DA:
- Nothing to report.

EEE:
- Nothing to report.

VAC:
- Found on Saturday a problem with SA3 gas attenuator. It was solved with the DOC.

XPD:
- Power increase tests ongoing this morning.
- A. Koch says two servers were not running this morning and will make contact to DRC.

DET:
- Couple of OCD calls received and fixed.

ITDM: 
- Network failure: systems are very sensitive to network failures (switch failure). Relates to replacement of devices.

XRO:
- Some SA3 cameras lost configurations (maybe related to the SA3 event during the weekend): fixed by M. Vannoni. 
- SCS/SQS teams: structure for the M6 chamber has to be fixed (motors): XRO will communicate with the instruments, to keep the motors in proper conditions.

LAS:
- PP-lasers are running. Small minor issues: 
1. SA3 problem with displaying number of pulses. Solved by CTRL by installing latest Karabo server;
2. SA2 still shows small problem with regulations/settings, spectrum started drifting. Can be fixed by OCD but ticket was created.

UNSYS:
- Nothing to report.

SPB:
- Preparing for user experiment this week.

FXE:
- Nothing to report:
- Last Friday PP-laser could not config laser pattern. Tomasz J. says the OCD laser is aware and asks to please also inform DOC/DRC in such cases as LAS can't help in 
this time. 
Monica T. confirms that one has to call the DOC and invite instruments that do not get beam to also join the Monday 13:00 DOC meetings.

MID:
- Suffered with SA2 PLC downtime - mono lost positions.
- Scan energies on the undulators will be needed on next week.
- Last week operation was smooth.

HED:
- Starting operation this week.

SCS:
- Nothing to report.

SQS:
- Spectrum of detectors - two spectras were split. This was reported to BKR and DOC.
  215   14 Apr 2021, 10:50 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 14.04.2021
General Announcement:
- We would like to remind groups that the deadline for submitting to XO the feedback on the planned activities for the Summer/21 maintenance time is on April 30rd. 
In case of questions please contact XO via xo-planning@xfel.eu

CTRL:
- Updates announced on last XO Int. meeting will take place next Monday (unless if a group protests). This means a short downtime on data loggers in tunnels. An e-mail 
with a reminder will be sent.
- Upgrade for the bunch pattern statistics devices to take place (also will be offline for few minutes).
- Issues with MC2 motors: the workaround is to shutdown device and click/instantiate device. A fix will be deployed.

DA:
- DA involved and continuing with "Moonshot" coordination meeting.

EEE:
- Nothing to add.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- Nothing to report.

ITDM: 
- Announcement with respect to Maxwell cluster: ITDM will change partition schemes in the next Summer maintenance. 
Three new partitions will be introduced, for calibrations and a special one for reservations for beamtime (UPEX related); 
A new feature is that if Maxwell is full of jobs, one can pre-empty it by killing jobs and putting back in the queue.

XRO:
- Yesterday beam going to HED: some problems were found regarding parameter configurations. 
XRO reminds SA2 instruments to be careful and check devices positions and parameters are they may be changed in relation to April 1st due to the issue with PLCs during 
Easter Sunday. 
- Zunaira A. says there were problems with CRLs arms configurations. Some devices had to be restored but worked normally.

LAS:
- All lasers are fine. 
- Shutters in SA1 PP-Laser were in maintenance mode - without defined reason.
- SA2 PP-laser is fine. 
- SA3 PP-laser has degradation due to the cleaning. XO will address the issue with LAS.

UNSYS:
- All fine.

SPB:
- Running user experiment. Low photon energy yesterday (0.8mJ) and drop intensity over the full 352 bunch train but today it got better.

FXE:
- Nothing to add.

MID:
- All fine.

HED:
- All motors lost positions, e.g. mono, screens being driven (some in and not supposed to be in). CRL1 issue the position was lost at the axis; motors not being homed; 
Zuzana K. will summarize main issues and forward to XO.
- Steffen H asks for a summary of encoders and Zunaira A. also asks on the use of interlocks and CRLs/shutter to evaluate if all is fine. Zuzana K. says HED did not work 
yet on the CRL2 but will communicate as soon as experience is get.

SCS:
- Question to CTRL on the workaround of MC2 motors. Steffen H. says to shutdown device, check configuration and instantiate it again. An instruction e-mail will be sent 
to readiness list.

SQS:
- Nothing to report.
  216   19 Apr 2021, 11:39 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 19.04.2021
General Announcement:
-  Remind on the Summer maintenance period: deadline to submit task list is April 30th. XO invite all groups to submit by this date.

CTRL:
- Remind on the update of some specific Karabo installations to fix bugs (Data logger installations) to start today (e-mail was sent to the readiness).
- Bunch pattern statistics devices need to be fixed today at the same time as the data loggers (relates to lose of time stamps in lasers).
- Upgrade on instruments are coordinated by ICIs; Updates of Mc2 motors today.
- Z. Ansari asks if updates of MID will affect interlocks as well; Valerii B. answers this is a Karabo update and not PLCs, so no effect is expected.
- On recent days CTRL finds Karabo broker pileup and this was successfully understood; DOC was preventively monitoring it and fixed it beforehand.

DA:
- No OCD calls for DA; 
- Collaboration and preparation for supporting SPB/SFX last week and for beamtime continuation in two weeks.

EEE:
- Today 08:30 it was found SA1 tunnel racks lost power. The uTCAs were also down but not the one in room 1.14. It affected SA1 tunnels loops such as Vacuum and motion.
The guess is on a power glitch. XO will bring up to the machine side and eventually correlated with the Easter Sunday's event.

VAC:
- Recovering the SA1 tunnel loops from 08:30 downtime. All seems to be fine right now.
- VAC asks if FXE is running cryo coolers. FXE tells they were running and will check the signals for possible issues.

XPD:
- HIREX motors in SA1 were OFF this morning.

DET:
- One OCD call was received and solved; DET is not aware of issues with Detectors. 

ITDM: 
- On the Wednesday problem with network (in SA1, the online calibration was down): Today a cable will be exchanged. 
- ITDM was involved with experiments together with DA on offline calibrations.
- As DRC, K. Wrona reminds today that 1PM there is the DRC meeting and the participation of instruments is strongly encouraged.

XRO:
- Nothing to report.

LAS:
- SA1 PP-laser is fine.
- SA2 PP-lase with small issue with regulations. Tickets sent to CTRL.
- SA3 PP-laser with several small problems: damage to optics (need to exchange one AMPHOS stage); interlock tripped due to door problems and LAS went OFF. 
LAS hopes to bring back laser and make available for instruments by tomorrow.

UNSYS:
- SA1/cell12 Quad mover sudden move last week: it was not related to a software issue and is under further investigation on Doocs side. A Doocs command was sent.

SPB:
- Experiment last week: quite successful and not many issues.

FXE:
- Nothing to add.

MID:
- All fine.

HED:
- A Motor on the CRL HED chamber was engaged and not moving (hardware issue). It may need a ZZ. It is not related to the CRL's arms.
- SEPS interlock tripped machine on Friday almost midnight (colleagues close shutter before moving CRLs). The beam permission was restored after lens removed from beam.
- ADC is offline. HED will contact Bruno F. offline.

SCS:
- Not present.

SQS:
- Commissioning for preparing next experiment.
- Issue with digitizers that can't be used: Bruno F. adds that action is scheduled for 14:00 as discussed with SQS's members.
  218   21 Apr 2021, 10:50 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 21.04.2021
General Announcement:
-  XO reminds on the deadline of 30.04 for submitting the Summer maintenance task lists. For this, please do so sending the list to xo-planning@xfel.eu. 

CTRL:
- Update on undulator Doocs side: CTRL needs to test for two or multi-colors schemes and asks instruments to CTRL if there are plans to use it.
- CTRL will schedule a short practical training on Beckhoff devices for next Wednesday. An announcement will be made through readiness mailing list.

DA:
- Nothing to report.

EEE:
- From the PLC side, EEE is following up the MID/CRLs interlock case.
- If groups submit a change request needed to be implemented during summer maintenance time, please contact and inform EEE beforehand.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- Nothing to report.

ITDM: 
- The network cable exchange mentioned last Monday was done.

XRO:
- Not present.

LAS:
- All 3 PP-lasers are in operation.

UNSYS:
- After power glitch on Monday in SA1, about half the undulator cells were half power cycled. Most could be recovered expect SA1/cell33 and SA3/cell1. This will require 
ZZ accesses. 
XO states the power failure was man-made caused.
- Quad mover sudden move: Lars F. from MXL does not have records on the command given for the sudden move and therefore the root cause can't be traced.

SPB:
- Nothing to report.

FXE:
- Beam since yesterday; one interlock issues. 
Nerea J. says a ticket was received and the interlock issue was related to a Imager that always come up activated. This will be removed from the EPS.

MID:
- All fine at MID.

HED:
- Nothing to report.

SCS:
- Undulator photon energy couldn't be changed via Karabo. Jan-Torben D. will talk to Steffen H; David Hickin adds that the location was changed and the Karabo side is 
done/corrected. 
One needs the BKR connection/authorization and this will be organized by CTRL/Steffen H.

SQS:
- Issue with digitizer on work. It is needed for next week.
  219   26 Apr 2021, 11:08 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 26.04.2021
General Announcement:
- The deadline to submit the maintenance task list is on 30.04. We thank all the groups that have already submitted. In case of any question and comments, please contact 
us at xo-planning@xfel.eu
- Patrick Gessler reminds on the DRC meeting on Mondays 13:00. This meeting is done together with instruments to exchange information for the weekly plan. The e-mail for 
contact is drc-jour-fixe@xfel.eu 
- Andreas G. says that with the new 7-11 operation mode, XO is interested in knowing how longtime instruments need to be ready to take the beam in the early morning.
Please inform us for that XO checks the efficiency of this model.

CTRL:
- Remind on Beckhoff training next Wednesday (following e-mail to readiness).
- Upgrades of two Karaboo Beckhoff servers today (Karabo devices go down for 5-10 minutes, proposed to be done today during lunch time): SA2 master tunnel loop; and the 
HED loop.
- Bug on ADQ for twelve devices, affecting SQS and others: EEE has discovered it and CTRL is analyzing to come up with a fix.

DA:
- Nothing to report.

EEE:
- Nothing to report.

VAC:
- Nothing to report.

XPD:
- PES in SA3 was provided and operated last week for instrument's usage.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- Maurizio V. requests the SA2 experiments to provide information to XRO on issues related with mirror alignments or transport beamline.

LAS:
- Received info from Desy on a power glitch today at around 6AM. At the same time SA1 Amphos switched OFF due to not enough water. 
It’s under investigation with TS. Jan G. points that also there was a beam loss in delivery around the same time.
- SA2 and SA3 PP-lasers are still in operation.

UNSYS:
- Issue with undulator SA1 /cell33 and cell1/SA3 needs ZZ. Currently the impact in operation is minimal and ZZ is postponed to the next available date.

SPB:
- Nothing to report.

FXE:
- Run with beam delivery went smooth.

MID:
- Quite successful beam week with small hick-ups to be addressed with experts.

HED:
- Commissioning beamtime this week; Data analysis will be made this week.
- Test of the PLC synchronization with Relax laser to be done this week.

SCS:
- Not present.

SQS:
- uTCA in ADQ had been mentioned already by CTRL. It has been tackled.
ELOG V3.1.4-7c3fd00