Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Technical integration and coordination logbook, Contact: A. Violante, G. Wellenreuther, Page 2 of 29  Not logged in ELOG logo
ID Date Authordown Location Severity Subject
  115   29 Apr 2020, 17:28 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 29.04.2020
General Announcement:
- The Work on the Controls Network are progressing very nicely;
- Work in the tunnels: safety practices due to Covid-19 were covered in the staff meeting. 
The policy states that if two or more workers that are closer than 1.5m for longer than 15 min then both shall use FFP2 masks. 
If shorter than 15 min (whole day), workers can use surgical masks. 
- Work in tunnels with clean tents: in case of 2 simultaneous workers, by default they have to use PPE.
- FFP2 masks may not be suitable for clean room. More information will follow.
- For additional questions please contact SRP.
- Next Friday May 1st there will be no meeting. We resume this meeting series on Monday.

CTRL:
- Working on control network activities.
- Two trainings on the notification service were done. Another one will follow soon.

DA:
- Group is focusing in offline data analysis.

EEE:
- Normal OCD service will be open next week. However, there will be no OCD for micro-TCA issues. 
- Up to 4 PLC staff on site to support groups – EEE is asking groups to find out what type of onsite people will be needed.
- EEE colleagues from technical side will also be available on site.
- EEE colleagues from fast electronics in principle will not be on site, unless requested and planned (mostly are doing only home-support).
- We rely on the instruments plans. Please provide such information to EEE.

VAC:
- Preparing for the re-start activities.

XPD:
- Preparing for re-start activities.
- XPD will receive a VAC chamber from Italy today and next week the group will work on it.

DET:
- Preparing a plan for activities together with instruments.

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- Preparing to switch on the lasers on next week.
- LAS do not need micro TCA support if balcony room works for us. Group just needs to receive the master time from the balcony. 
EEE states that it shall be fine unless if things fails during the night. LAS comment in this case the laser will safely shutdown in the night.

SPB:
- A crashed loop will be taken care next week;

FXE:
- Nothing special to report.

MID:
- Preparing with EEE and CTRL for Monday re-start phase.

HED:
- Same as MID.

SCS:
- Preparing for next week.

SQS:
- Trying to start up and provide info to EEE.
  116   04 May 2020, 14:20 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 04.05.2020
General Announcement:
- From today on there is no general restrictions in accessing the EuXFEL site: only consent of group leader is needed.
- Control Network activities: there is a sensible approach for this week and currently CTRL and XO do not observe issues needing discussions.
- Activities in tunnels start this week. We encourage the support groups to point any issue during this series of meetings or by sending an e-mail to xo@xfel.eu.

CTRL:
- A third training on the notification service will happen on Wednesday. Proper communication will be send around.

DA:
- Nothing to report.

EEE:
- Bringing up the systems.

VAC:
- Group members are on site to prepare activities. The main one this week is the installation of pre-shutter in XTD10. 
- Protective masks have to be picked up with SRP.

XPD:
- No incidents during last week. Two group members are currently working at EuXFEL site. 
Later additional staff will work on tunnels (e.g. on Hirex; on scintillator screen on IMG) and in the lab. 
- SRP has to provide protective equipment to the staff.

DET:
- Nothing to report.

ITDM: 
- We plan to perform tasks on the rack rooms and we are waiting for the SRP assessment.

XRO:
- Nothing to report.

LAS:
- Group has an on-site team who is switching on all lasers this week. 
An order for the re-start will be communicated after an evaluation of each system's condition.

SPB:
- Group has staff on site to start systems.

FXE:
- One team is onsite. The planned activities shall not involve other groups: re-starting systems and making tests in the control hutch.

MID:
- Plan is to bring the PLCs and electronics up.

HED:
- Starting lasers and split-delay line. Activities do not mix with other groups. 
- Group is coordinating with EEE for checking the rack rooms.

SCS:
- Not present.

SQS:
- Start being on site today and plans to re-start devices together with EEE.
- Also start setting up ion pumps (no need for VAC support).
  117   06 May 2020, 14:45 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 06.05.2020
General Announcement:
- SRP is invited and urged to participate in this series of meetings.
- Several groups have questions to the SRP regarding: 
1. Rules on access, training and work performed by external companies; 
2. Clarification in how to conduct work in the clean room among several groups; 
3. Distribution of PPE/Masks; 
4. Usage and disposal of masks; 
5. Procedure to work in the rack rooms; 
6. Hygienic rules in experimental hutches: disinfecting tools, computers, disposal of PPE.  
- Friday we will discuss next week plans and also CTRL activities for next week.

CTRL:
- No issues to report;
- Announcement: to reach OCD please use 6541 and 6542.

DA:
- Planning with instruments the support for coming weeks.

EEE:
- Ongoing with planned works;
- Cabling: SQS cabling will start on next Monday (EEE and SQS will organize the task). Afterwards the cabling installation takes place at FXE. 
The installation is done with external contractors - EEE needs clear information from SRP on the Covid-19 trainings and rules for external companies.

VAC:
- Working on the tunnels accordingly to this week's plan: 
1. small issues at XTD10: chamber does not fit and needs some re-work at external company; 
2. Preparations in XTD9 for IMG screen change. 
- No issues with distancing regulations;

XPD:
- No issues to report - working as planned: XTD6 installation of Hirex filter; XTD9 exchange of Imager screen.
- Unpacking and mounting the hard-Xray PES chamber.
- XPD needs clarification from SRP on work procedures in the clean room;
- After exchange of IMG screen, XPD needs to check functionality by moving motors. EEE and CTRL are aware and shall not be a problem.

DET:
- Going back on-site to work in the prep Lab.
- Usage of labs has to be coordinated among the groups.

ITDM: 
- Nothing to report.

XRO:
- Not present.

LAS:
- SA1 pump-probe laser re-stared; SA2 PP-laser is progressing;
- LAS needs answers from SRP on the regulations for external company which is coming this week.

SPB:
- Nothing to report: working as planned on re-start;

FXE:
- Started working in the control and main hutches. Group has plans for next two weeks and is organizing tasks together with DET and LAS.
- E-mail to health@xfel.eu is not answered. FXE will not allow external companies coming in unless if trained. 
- FXE has set own rules in how to use tools, disinfect tools and computers. FXE waits clarifications from SRP. 

MID:
- General progress accordingly to the plan: updates have been made; tests of motors are ongoing.

HED:
- Nothing to report;

SCS:
- Not present;

SQS:
- Started with checking vacuum systems.
  118   08 May 2020, 16:44 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 08.05.2020
General Announcement:

- Q&A session with SRP/Tobias Haas:
1. External companies have to provide self-assessment to show they have measures in place that comply with EuXFEL regulations on safety related to Covid-19. 
The EuXFEL online training is installed at the gate house and the companies have to make the Covid-19 training. EuXFEL groups have to inform the external companies.
Slides of the training will be provided to the groups for being send to the external companies.
2. One has to observe the maximum occupancy of each room and follow the EuXFEL training. If you stick to the max occupancy, you can work without masks in case minimal
distance is respected - otherwise mask is mandatory. For control hutches we admit only 2 persons. 
3. SRP finds a good idea and encourages instruments to implement additional measures for the hutches that e.g. cover use of tools, computers and/or disinfection 
procedures. 
Nevertheless, such extra local rules must not overrule the EuXFEL rules covered in the training. 
Extra regulations shall be printed and make available at doors, for example. Responsible for rooms and and hutches or local staff must make sure these additional
regulations are explained and followed. 
4. EuXFEL will not provide PPE to external companies.
5. Tobias will check with MB if EuXFEL has to provide PPE to DESY employees. In principle, EuXFEL applies the same rules as DESY.  
6. There is currently no decision on which rules apply to external visitors regarding the summer shutdown. We assume initially they will not be able to come. 
SRP encourages groups to send questions to health@xfel.eu and the Covid-19 task force will discuss the matter.  
7. There is no decision yet if the FFP-2 masks will be disposed after use or treated for re-use. Initially EuXFEL assume they will be disposed. 
It is yet unclear how long time a mask can be used before loosing efficiency. The slides presented at staff meetings contain suggestions in how to use the masks.

- General: There is no current issues to be discussed today regarding the tunnel access and related work;

- General: No issues have been pointed on the control network activities scheduled for next week. 
XPD must send to CTRL information on when a test of a shutter valve of gas supply will take place (still to be defined) in order to test the notification service. 

- The EPS work in SASE1 was rescheduled to next Friday and has been confirmed with XO and VAC.

- Please note that XTD1 will be closed from May 18th. Do not hesitate in contact XO in case of issues/activities affected due to this.



CTRL:
- Nothing out of ordinary to report; No issues concerning the re-start of instruments.

DA:
- Nothing to report.

EEE:
- SQS installation of cables will happen at beginning of next week, followed by FXE installation.
- EEE Technical side is doing onsite support for the instruments.

VAC:
- Making progress in the tunnels.
- A particle test on FFP2 masks was conducted and values are higher that the recommended in the clean rooms. 
Please use the normal multi-use protection in top of the masks.

XPD:
- Making progress in the tunnels.
- PES prototype chamber has been prepared. Next week (foreseen in the middle of the next week) XPD will bring it to the big clean room.
- Plans are up for next week.

DET:
- Nothing special.

ITDM: 
- Plan to make intervention with control group/server for short moment in a instrument.

XRO:
- Nothing to report, but please be aware of the particle free masks issue in the clean rooms (pointed above by VAC).

LAS:
- All 3 PP-laser are working. It remains some alignment but it not a showstopper.

SPB:
- Working with DET, EEE and CTRL to bring back systems - all going well so far.

FXE:
- Preparing for the installation of cables.
- Tasks to be done with EEE: new PLCs to be placed in the racks and to be powered on in the hutches.

MID:
- Fully under vacuum again. PLCs and motors are on and tested. Commissioning of experimental hutch ongoing.
- MID was in a full shutdown mode: it takes only about 3-4 days to place the full instrument in operation again.

HED:
- PP-laser and laser back.
- Split delay line is also OK.

SCS:
- Not present.

SQS:
- Progressing with the re-start of the instrument. 
- SQS has used the time to develop and improve the interlock system for the pre-vacuum. 
  119   11 May 2020, 14:53 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 11.05.2020
General Announcement:
- The proposed works on the Control network are fully organized for this week;
- Safety: The EuXFEL task force for the Covid-19 discussed this morning the safety issues here presented last Friday. 
On Mondays and Wednesdays there will be a SRP representative in this meeting to address related questions and on Fridays Tobias Haas will be attending. 
- General: there was a short notice from MKK2 regarding cooling maintenance in tunnels to be performed today. This short notice is a communication error. 
The task was a summer shutdown work anticipated to today and was not properly communicated. No EuXFEL group raised concerns to this activity taking place today. 
- General: 30% staff presence restrictions - so far it seems that this number is fine. Groups are encouraged to think if there is a need to increase this number,
especially in the instrument side. Please inform XO. 

CTRL:
- The tickets with requests to be carried out this week are all planned.
- Group is moving to more usual tasks with instruments and support groups.

DA:
- Planned activities are in progress.

EEE:
- There was no observed master time reset from the Desy side after the Covid-19 accelerator shutdown. 

VAC:
- Nothing to report.

XPD:
- Last week's planned activities went fine.
- It is agreed with VAC that on Wednesday one section of XTD9 will be vented, in preparation for an activity.

DET:
- Nothing special to report; DSSC pump/cooling issue is being taken care.

ITDM: 
- Nothing to report.

XRO:
- A test of a motor in a magnetic switch of a XTD6 mirror will be made this week - proper ticket will be send to CTRL.

LAS:
- SA1 PP-laser is OK; others are progressing. Work goes smooth.

SPB:
- Starting the instrument. All fine until now and this week there is a plan to test Detectors.

FXE:
- The works are going as planned.

MID:
- Continue with technical commissioning: activities under control.

HED:
- Nothing special - group placed tasks with Controls and also need help from EEE, all under control.

SCS:
- Minor issues while switching on the beamline: CTRL is informed and is taking care.

SQS:
- Ramping up the vacuum: so far all going well.
  120   13 May 2020, 13:51 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 13.05.2020
General Announcement:
- SRP will join this meeting series. If you have questions please raise the points.
- DET has questions on the policy in how to proceed with team work (how close and what is the interaction that different teams can have, e.g. when working in the same
room?). The subject has been reviewed by the Covid-19 task force and a guideline will be announced soon.
- There is a smooth re-start of activities regarding the Control Network tasks. 
Groups are encouraged to use this meeting to present questions and discuss open points in this matter.
- General: the group of janitors was spotted smoking together in close distance in the designated smoking area. 
It is remarked that the 1.5m distance between persons has to be respected. Information will be send to TS. 

CTRL:
- Planned work is going smoothly.
- Group's OCD phones are working. Please do not hesitate in making use of it. 

DA:
- Not present.

EEE:
- Ongoing with regular tasks. 
- The cabling company is onsite but stopped at the gate house due to missing training. 
After access is granted, work will start at the SQS. Joern will inform XO on further details.

VAC:
- Planned work is ongoing. 
- Preparing for the alignment task in XTD10.

XPD:
- Nothing special to report.
- Housing of XGM distributor boxes and Femto amplifiers in XTD1 is ongoing this week.

DET:
- Work runs smoothly. 

ITDM: 
- Nothing to report.

XRO:
- Installation of magnetic switch in XTD6 is done; cooling installation is on progress.

LAS:
- Proceeding accordingly to the plans: FXE and SPB lasers were handed to the instruments;
- Currently working in SASE3 laser.

SPB:
- Plans are in place for activating the detectors.

FXE:
- Ongoing as planned; Waiting for cabling installation after SQS is done.

MID:
- It has placed a task request to be done in XTD1 (to inspect CRL-1 device of SASE2) - XO is trying to schedule it this week, most likely for Friday.
- Majority of tasks at the instrument goes well; there were pico motor issues with monochromator. 

HED:
- All activities are going well.

SCS:
- Not present.

SQS:
- Nothing special apart from the cabling company stuck in the gate.
  121   15 May 2020, 14:35 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 15.05.2020
General Announcement:
- Judging by feedback and communication to XO both Tunnel and control network works are progressing.
- Friday is a good opportunity to discuss the Karabo tasks to be submitted next week as well as direct questions to SRP.
- The summer shutdown will have tunnels open for two weeks due to the interlock tests that, in turn, need tunnels closed. 
Current plan is photon beam will be available after the interlock tests.
- Due to next week's holiday bridge, the XO Integration meeting will not take place on Friday. 
- XTD1 will be closed next Monday and reopened for the summer shutdown. By its side, the XTD6 will remain open.

CTRL:
- DET confirms task list for this week has possible prolongation for next week on the AGIPB work. CTRL is aware and will prepare support for next week.
- Today a new Karabo version is released but general deployment will be made during summer shutdown (MID will do it earlier).

DA:
- Nothing to report.

EEE:
- A question arises on filling the dates for the summer shutdown task list. It does not need to be necessarily filled, unless if constraints are made. 
If a date is proposed, we shall stick to that day. Entanglement with other groups will be taking into account for a final scheduling. 
- Cabling installation going as planned: SQS cabling may be finished today and the FXE installation will follow. 
- EEE plans to start with change request of modules. For PLC control crates there may be delays. Subject will be communicated to the groups.

VAC:
- Tunnel tasks are progressing: upgrade of SA2 solid attenuator pneumatic system; SA3 pre-shutter is installed; preparing for SA3 re-alignment to start next week.

XPD:
- The planned activities are progressing well.
- Few activities originally planned for the summer shutdown are anticipated to the re-start phase. The summer shutdown task list will be updated accordingly. 
- Preparing for beam delivery in SA2: XPD is prepared for the XTD1 tunnel closure on Monday. The XGM of XTD1 will be available for operation from next Wednesday, 
as well as Imagers. It is expected to receive photon beam by May 23-25 (EEE is informed). 
- The photon delivery is only for XTD1 and beam dump. XTD6 will stay open until the shutdown.
- XPD will regularly use the big clean room from next week with 2 staff members (not continuously, but larger part of the time).

DET:
- Activities on DSSC, Jungfrau, AGIPB are ongoing without major issues.
- DET do not plan to work in the bog clean room, only eventually going there to pick small components. 

ITDM: 
- IT infrastructure is properly running.

XRO:
- Progressing with planned activities, e.g. magnetic limit switch for XTD6 mirror. 
- Preparing for cooling installation in XTD9 together with VAC. Work currently being prepared in the labs.

LAS:
- No problems that require attention: LAS is progressing - all under control.

SPB:
- Jungfrau has been installed and works well besides small issues with data transmission (staff and support are working on it).

FXE:
- Preparing things for cabling installation in hutches; Questions to SRP are clarified.
- In parallel FXE conducts activities with Jungfrau detector.
- Alignment of optical laser is postponed due to staff's sickness.

MID:
- The CRLs check in XTD1 was done and no more tunnel access is need. There were no changes on the CRLs. 
- MID access XTD6 next week and is busy with other re-starting tasks.

HED:
- Progressing with lasers and split delay line.
- Internal staff and Wille company pulled cables in A12.
- Detectors are under tests since yesterday.

SCS:
- Not present.

SQS:
- Activities in hutch proceeding smoothly.
- New spectrometer setup must be finished today.
- SQS plans to start with vacuum and to integrate the locally developed interlock system during next week. 
  122   18 May 2020, 14:53 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 18.05.2020
General Announcement:
- Starting today 18.05 the XTD1 tunnel will be closed. It is not accessible until the summer shutdown. All other tunnels remain open.
- XO and PMO have sent a communication for updating the task list. Please indicate if tasks were already carried out. Deadline for submitting it back is Wednesday 17.05.
- SA1 instruments emergency power off on Friday 15.05: originated from PLCs on ProfiNet from Desy. 
It is still under investigation and we should make sure that sudden power off does not happen again, which may harm equipment such as detectors. 

CTRL:
- SPB informed issues on the notification service. CTRL appreciate the feedback and is working on it.
- It is planned to deploy the new Karabo 9.0 at MID this week.
- CTRL is working in few problems with Imagers (corrupted data) - data is flowing but not being displayed.

DA:
- No conflict or issues: working as planned.

EEE:
- SA1 VAC loop update is schedule for today.
- Friday power off on SA1: problem came from the Desy signals. It may require extra work at Desy - PLC cables are still disconnected.

VAC:
- No issues to be reported.

XPD:
- IMG issue with corrupted data was informed to CTRL who is investigating. SA2 IMG has to be fixed for use on next Monday 25.05.

DET:
- AGIPB detector at SPB suffers from power off but its Chiller was recovered without consequences. The detector itself has to be checked. 
- DET has placed the detectors in safe states, but there is nothing to protect the detectors against power outages.

ITDM: 
- Nothing to report. 

XRO:
- Nothing to report. 

LAS:
- SA1 PPL1 laser switched off on Friday around 14:30. The reason is possibly linked to low air flow. It remains unclear if there is any relation with the instruments 
power off.

SPB:
- Last week worked on Jungfrau and AGIPB detectors.
- Nothing else to report other than the power outage in the hutches.

FXE:
- Instrument recovered well from the power outage.
- It is planned the cabling installation for the next couple of days.

MID:
- Continuing with installation and commissioning. On Wed it is planned to check devices in XTD6.

HED:
- All work goes as expected.
- A plan for the XTD6 work will be done this week. The activity in tunnel shall take place next week.

SCS:
- Nothing to report.

SQS:
- Cabling installation is done. SQS reports that due to lack of crane operator in the group they had to wait some time until a crane operator was available. 
  123   22 May 2020, 08:57 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 20.05.2020
General Announcement:
- XO Integration Meeting will not take place next Friday 22.05 due to the bridge holiday.
- MPS group shared some info on the SA1 emergency power off event that happened last week. Further investigations are ongoing. 
- No conflicts have been reported for the activities on control network systems.
- Today 20.05 is the deadline for the groups to send via e-mail the updated summer shutdown tasks.
- MXL/Desy has planned to start on next Saturday and Sunday the SA2 photon search and operation.  

CTRL:
- CTRL works together with XPD in the Doocs images for the IMG devices. A new control update will be deployed. The data is no longer corrupted.
- Today CTRL is deploying Karabo9 at MID. This serves as a small scale test prior the deployment on the other parts/groups of EuXFEL. 
During the summer shutdown it will be deployed at the BKR photon computers. 

DA:
- Working with the Karabo deployment. 
- Group is available for data analysis and troubleshooting in devices, e.g. the Detectors.

EEE:
- EEE reminds the cables in the MPS room still remain to be connected (linked to the emergency off event of last Friday). 
MPS group do not know yet when this will be done. As soon as XO know it will be informed.
- SQS cabling installation is done. FXE cabling work has started: it has an open issue with HV cables but it will be solved today. 
Over lengths of cables are currently stored in the instruments but will be moved later. 

VAC:
- Working in tunnel activities: MID pre-shutter; SA3 re-alignment ongoing.
- SA3 re-alignment: today we end at the PES - work ongoing accordingly to the plan. Upstream side of the gas attenuator will start on next Monday.
- No issues to report.

XPD:
- XPD is finishing XTD2 and XTD9 tunnels works: water cooling, pumps, boxing electronics; XPD will try to do activities in XTD10 in parallel with the re-alignment.
- All working fine - an updated file for the summer shutdown list will be send later today.

DET:
- The AGIPB detector at MID was re-started yesterday.
- SPB detector will be tested today or Friday (complete test after the emergency off event).

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- Nothing to report.

SPB:
- Nothing to report. No damages due to the emergency off event but still has to test the detectors.

FXE:
- Nothing to report - no damage associated to the emergency off event.

MID:
- It is planned to check the power modes. 
- MID gets confirmation it can access XTD6 today.

HED:
- Not present.

SCS:
- Not present.

SQS:
- Just protective rules on the OFF buttons were changed - nothing has been done on the functionality side.
  124   25 May 2020, 15:29 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 25.05.2020
General Announcement:
- Machine started SA2 lasing last weekend. Currently photon energy is 0.5mJ at 9keV.
- CTRL OCD was called Friday on the SR slits position and movement. It was quickly solved.
- XO ask people who carries work in tunnels to use this meeting to raise questions and concerns. 
- XO also ask people to discuss during this series of meetings possible resource conflicts among the support groups for the upcoming week(s).

CTRL:
- New Karabo version installed at MID is working nicely. Instrument staff is creating new panels with Karabo9 and CTRL hopes to integrate 
this Karabo version in the whole facility during summer shutdown.

DA:
- Not present.

EEE:
- Working in normal duties.
- Cabling installation in SQS is done. The FXE installation has a mismatch with a rack planning (XGMD) and responsible company for installation
may come back on Wednesday to solve it. 

VAC:
- Tunnel works are nicely ongoing.

XPD:
- Working on tunnels and looking at lasing in SA2.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- A water leakage in an amplifier box in SA1 laser occurred last Thursday. It is repaired but LAS will have to investigate on possible damages on optics
(due to water inside). Laser operation will be possible only tomorrow or at the end of the week. LAS will provide further details on Wednesday. 

SPB:
- Nothing to report.

FXE:
- Nothing to add besides the cabling installation issue mentioned by EEE.

MID:
- New Karabo is working nicely up to now.
- Tunnels work is also finished; MID staff continues with work on the hutch/optics.

HED:
- No issues to report.

SCS:
- SCS will be busy with an external company and needs assistance of SRP on hot work permit. Sandra Plett will communicate with Michael Prollius.
- SCS has informed DET that there is data in the computer to be saved. DET is aware and has taken needed actions.

SQS:
- Nothing to report: activities are progressing normally.
  125   28 May 2020, 13:58 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 27.05.2020
General Announcement:
- It seems EuXFEL was not affected due to the power glitch at the Desy site last Tuesday (no device was found in off state or damaged). 
- TS informed no indications of power failure at EuXFEL. Groups are encouraged to inform XO if they find components that have been affected. 


CTRL:
- CTRL has deployed a new cross-hair in images for all instruments; XPD is fully using it. This cross-hair will be also used in the Doocs panels 
allowing BKR to use it as tuning tool. CTRL reminds that if operator does not disable it then it ends in the DAQ.
- CTRL is in contact with instruments to arrange New Karabo2.9 installation.

DA:
- Working with contact persons for the Detector Advisor committee.

EEE:
- EEE raises a question on the Shutdown planning procedure for the task scheduling. 
XO plans to use a summer shutdown process that coordinates with individual groups the tunnel scheduling. 
Starting in the next few days XO will contact the groups for individual scheduling. 
Tunnel activities will be initially scheduled and try to schedule without resources conflicts.
- EEE plans planned to make a SA3 loop update tomorrow.
- A MPS board in SA2 is not properly working and has to be replaced. Contact with DESY was done 
and this shall not affect operation or risk triggering the emergency power off.
- Today the remaining cable work at FXE will be concluded.

VAC:
- Not present due to tunnel activities.

XPD:
- There was an incomplete update of SA1 Vacuum loop. EEE informs there are issues with some gauges and by tomorrow EEE 
must have it fixed and will conclude the final update.
- Yesterday re-cabling SA3 (SS3 brunch) was done; exit slits are being reconnected. The main Karabo shows the two exit slits not connected. 
For the IMG it is needed support from CTRL and XO.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- Installing the cooling in XTD9 (M3) during next days and then VAC will take over by next week.
- Actions in XTD6 are needed in order to receive beam for possible operation during June 6th-7th (for the self-seeding activities). XRO will send a summary to XO.

LAS:
- SA1 laser is back: SPB and FXE shall measure energy to confirm all is fine. It is still unclear the cause of water leak in the SA1 laser last week.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- Nothing to add.

HED:
- Nothing to report.

SCS:
- Not present.

SQS:
- Everything is going as planned. 
- Regarding the active fiber laser, SQS is waiting for the company reply.
  126   29 May 2020, 14:22 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 29.05.2020
General Announcement:
- Due to the public holiday this meeting do not take place on Monday.
- Safety related questions: 
1. DACHS issue that XPD staff could not enter the lab in E0.505: there was a false entry in the DARF-DACHS system that was corrected. It shall be working now;
2. It seems DARF-DACHS system shows incorrect dates for training expirations. SRP will check on possible corrupted dates; 
3. EuP trainings validity will be extended until end of June.
- Safety masks: A warning was issued by Hamburg authorities. EuXFEL has some masks that belong to the batch mentioned in the warning but with different production dates.
Currently SRP has no info if these masks are not suitable for use but will keep staff updated.   

CTRL:
- Nothing to report.

DA:
- Not present.

EEE:
- SQS cable installation: some issues related to the over lengths will be fixed by the external company during next week. 

VAC:
- Nothing to report.

XPD:
- Planned tunnel work is ongoing.
- For next week: 1. A differential pumping station in XTD2 will need to be locally checked next Wednesday. 2. Additional housings on XGM will be done.
- SA2 K-mono measurements were performed in BKR. Evaluation of results need to be made with a new software tool (ticket has been sent). 

DET:
- Ongoing work on various detectors (located in different instruments) will continue next week.
- CTRL has to be informed on the plans for the next week: the calibration pipeline must be followed and time for deployment. DET will check what the plans are.

ITDM: 
- Nothing to report.

XRO:
- XRO installed InGa in M3 mirror in XTD9. Group had good experience while working with masks and face shields inside clean tent.  
It was found a small damage in the mirror that will be further investigated and reported next week. Next week there is a plan to close the chamber and pump down. 

LAS:
- SA1 and SA3 lasers are in operation.
- There are ongoing work in SA2 laser synchronization; Laser operation will be back after today.

SPB:
- Nothing to report.

FXE:
- XGM cabling going on;
- FXE contacts CTRL on the Jungfrau crashing issue that happens when 2 Detectors operate simultaneously. CTRL states this issue is being investigated while in operation
and is not reproducible. In addition, it seems to happen only at FXE and not in SPB. Further fix needs to take place prior start of operation.

MID:
- Nothing to report.

HED:
- Nothing to report.

SCS:
- Not present.

SQS:
- No news on the active fiber were received.
  127   04 Jun 2020, 13:31 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 03.06.2020
General Announcement:
- Summer shutdown is nearing. Few dates on crane maintenance at XHEXP1 were sent to the readiness mailing list. Please be aware on the dates when planning activities. 
- MPS software updates are planned for the summer shutdown - an update on potential emergency off situations will be informed.
- Groups and instruments are encouraged to make questions/comments.

CTRL:
- Continuing with shutdown tasks: CTRL will deploy Karabo 2.9 next week: an e-mail with information on dates for the installation in instruments will be sent.
- For SASEs areas: SA2 deploy takes place on the 9th June; SA1 an SA3 will follow on the 10th. Dates will be sent to the readiness mailing list. 
- Please contact CTRL for any comment/question.

DA:
- Nothing to report.

EEE:
- There are planned tasks on migration of Mc2 and Vacuum eps updates.
- EEE is working with regular tasks together with the instruments.

VAC:
- Working as planned in the tunnels: MID pre-shutter is installed; SA3 re-alignment is done; Continuing with SSP shutter in SA3; Loop updates.
- Desy-MXL will contact VAC on the SXP slits installation. 

XPD:
- Finishing the tasks in tunnels.
- XPD has been supporting the tuning efforts on SA2 lasing during this week.

DET:
- DET will communicate with CTRL on dates for tests and potential conflicts.

ITDM: 
- Maxwell related issues: System does not work well, probably due to a bug. ITDM and DA will check. Desy service shall be contacted in case of troubles.
- Instrument control room PCs: FXE is already equipped with new computers, as well as SCS and SPB. An Update of control PCs in experimental hutches of SQS, MID and HED 
has to be done. 
- Each of those three instruments has to inform ITDM when this can be take place - a complete new installation will be made - please backup the PCs! 
- CTRL also remarks Karabo installation has to be done in some instruments. 

XRO:
- Not present.

LAS:
- Synchronization issue is fixed (due to broke delay line). This week Desy colleagues will work on improvements of communication to lasers.

SPB:
- Working together with LAS, CTRL and EEE to solve small issues.

FXE:
- Update on the Jungfrau status has to be clarified.

MID:
- Progressing with the works on the split and delay line.

HED:
- Group is busy with PP laser and other regular business.

SCS:
- Not present.

SQS:
- No news from the external company on the laser active fiber issue.
  128   05 Jun 2020, 13:44 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 05.06.2020
General Announcement:
- Many summer shutdown tasks have been scheduled already and information has been sent to the groups with tunnel tasks.
- XO will not fully engage with tasks in the instrument Hall carried by the Instruments. Please contact XO if there are difficulties in organizing these works. 
- Be aware of date for potential power off: 22 June (MPS group runs upgrades that may trigger the emergency power off); 
- Be aware of date for hutch access restrictions: July 1st and 2nd (D3 will test interlock system in experiment hutches); 
3rd of July is a reserve date - please expect only limited access to the hutches due to this tests.
- Safety information: Desy is now recommending each person to take a FFP-2 mask for tunnel works to be used in case of close proximity work. 
EuXFEL will follow this rule: SRP has available masks and groups with tunnel activities can collect these masks with SRP
- A schedule for summer shutdown activities will be send soon to the readiness mailing list.

CTRL:
- CTRL has distributed schedule for updates. For example, the BKR machines will be performed on Tuesday; 
- The update of exflgateway will take place on Wednesday next week.

DA:
- Nothing to report.

EEE:
- It is planned to perform the loop update for the MC2 library on Tuesday. 
- Changes requests on cabling are being finalized. 

VAC:
- Currently carrying on the SA2 work on HED mono together with XRO on alignment; SA3 re-alignment activity is done; 
SXP installation is ongoing and preparing the exit slit installation.

XPD:
- The DPS remaining problem in XTD2 is solved. Pressure is going down (<10e-8).
- Work on motor calibrations on HIREX: one (XTD6) to be done next week after migration library.
- For next week there will be activities of maintenance in the XTD10-PES.
- SA2 is operating until Sunday and machine is currently using 100pC bunch charge.
- Works on the clean rooms/labs are ongoing. Acceptance test on the new PES prototype may be finished today.

DET:
- Nothing to report - small issues have been worked and solved.

ITDM: 
- Preparing shutdown activities that start on Monday: update of control servers together with CTRL; updating PC layer servers, computer clusters, etc... 
There shall be interruptions in the DAQs systems;
- Updating Karabo 2.9 and exflgateway: at the same time ITDM will update also Maxwell and reboot gateways to be taken place on Wednesday (joint effort CTRL, ITDM).

XRO:
- Proceeding well: Mono in XTD6; vacuum in XTD9.
- Possible summer activities are on hold and XRO will inform XO accordingly.

LAS:
- Laser down due to maintenance/updates: SA1 PP-laser on Tuesday 9/6; SA2 on Wednesday 10/6; and SA3 on Thursday 11/06.

SPB:
- Works are going well.

FXE:
- Nothing special to report.

MID:
- Nothing special to report.

HED:
- Activities on the Split and delay line (cleaning), on PP-laser, among others. No faced issues.

SCS:
- Not present.

SQS:
- No answer from external company on the active fiber.
  129   09 Jun 2020, 15:47 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 08.06.2020
General Announcement:
- SA2 lasing: up to 2mJ@9keV was achieved with strong linear and quadratic tapering with 250pC bunch charge. 
Lasing with 500pC achieved 0.45mJ@9keV and with 100pC achieved 0.75mJ@9keV.
- From today we start the summer shutdown phase.
- Please note the last minute information on air conditioning maintenance in tunnels between Tuesday 15:00 up to Wednesday 08:00. 
We ask groups to shift planned works to outside this time slot. In case you need to be in tunnel, it is mandatory to use FFP2 masks.

CTRL:
- Karabo 2.9.0 deployment will start tomorrow and follow over the week. Typical activity time is from 8AM-16:00 each day.

DA:
- No problems. 

EEE:
- EEE plans for tomorrow the mc2 migration.

VAC:
- HED mono has adjusted gap between crystals. All other tunnel activities ongoing.

XPD:
- Major task for the coming week is related to the PES maintenances. All other tasks are also organized.

DET:
- Will carry tests after the Karabo installation.

ITDM: 
- Group will be busy with updates to be done this week.

XRO:
- Completed big shutdown activities: M3 cooling mirror - leak tested OK and pumping during the weekend.

LAS:
- All lasers are in operation.

SPB:
- Progressing with regular planned tasks.

FXE:
- Nothing to report.

MID:
- Nothing to add.

HED:
- Working with EEE activities.
- HED requests suitable dates for testing the THz laser. This date has to avoid infra-structure, interlock and other works. 

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  130   10 Jun 2020, 11:12 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 10.06.2020
General Announcement:
- Maintenance in the Tunnel Air Conditioning is completed. No more work restrictions are in place besides the regular COVID-19 rules. 

CTRL:
- Deployment of Karabo 2.9.0 started yesterday accordingly to the information sent to readiness mailing list. So far the work goes with the plans.
- CTRL mentions Broker servers need update and will bring down Karabo again. Possible intervention date (early morning) will be discussed with LAS and Instruments.
A warning e-mail will be send 1-2 days in advance.

DA:
- Related to new Karabo: in case the upgrade is not covered, please contact DA.

EEE:
- Migration of mc2 done in SA2. 
- Preparing call for tender of HED cabling; other instruments follow up next.
- There will be maintenance in SA1 and SA3 balcony rooms. A discussion with LAS is in place (risk of possible shutdown can be accepted).

VAC:
- Not present.

XPD:
- Nothing special to report - resuming tunnel activities after AC tunnel maintenance.

DET:
- Nothing to report.

ITDM: 
- The updates on the online cluster side are almost finished. Only a check has to be done.
- Access to online cluster is labelled.
- DAQ has to be re-started.
- Updates are planned for tomorrow: reboot exflgateway at 10:00AM - an e-mail will be send to readiness mailing list.

XRO:
- Not present.

LAS:
- SA1 and SA3 lasers are in operation.

SPB:
- SPB asks for sending warning notice a day or two prior the Karabo restart intervention.

FXE:
- Nothing to add.

MID:
- MID will inform ITDM today on the dates for the updating the linux PCs in the hutches.

HED:
- Nothing to report.

SCS:
- Nothing to report.

SQS:
- SQS will also inform ITDM on possible dates for updating PCS.
- Some macros are not running (they were not able to start).
  131   12 Jun 2020, 13:48 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 12.06.2020
General Announcement:
- There will be tunnel ventilation additional maintenance on two mornings next week from 6:30 to 8:00AM. An e-mail to Readiness list will be send when dates are known.
- There was again a situation that the interlock door between XTD4 and XTD10 was blocked open. SRP reminds all that please do not leave this door opened. 
Further investigation with Desy side will be done if this was a mistake done by an external company. 
- EuP training: Tobias Haas has extended trainings until end of August. There will be refreshers and first time trainings starting on week 26 as in-person EuP training.

CTRL:
- CTRL is done with 2.9.0 deployment - now DAQ and calibrations checks are ongoing.
- No major issues during deployment: still few devices need to be updated again; CTRL is working on it.

DA:
- DA has released new version of extract data. Documentation will be send around and people are invited to give feedback.

EEE:
- Activities are running fine.
- PLCs side: this week there is migration for mc2 in SA2 - EEE ask people to crosscheck systems.
- Two cables in MID will be finished late next week (regarding personal interlock).
- EEE is conducting migration microTCA systems/crates: SA1 and balcony rooms.
- Timing for the Lasers updates has to be arranged with LAS. CTRL and EEE recommend making it during the shutdown. It needs green flag from LAS and Instruments. 
- Upgrade of firmware of timing system: this will not be done to avoid stop timing system for lasers. Tunnels are done.
- Puppetization work is ongoing. SA2 and SA1 tunnel remains to be completed at beginning of next week. 

VAC:
- No issues to report.

XPD:
- Follow up of SA2 mc2 migration: we recheck motors in tunnel; update scenes with CTRL.
- XPD is almost finished with large interventions.

DET:
- Test of Agipd with new Karabo is successful. The DSSC is also working.

ITDM: 
- DAQ updates: to be started today or next week.
- Hardware updates in SASEs that ITDM will be performing.

XRO:
- Nothing to report: XRO is finished with big installations. Only small tasks to be done next week.

LAS:
- The broker update caused the timing in SA3 to be lost. It took several hours to bring up the system. 
- Updates in SA2 (affecting timing) will be performed next Tuesday.
- SA1 and SA3 have to be scheduled and it depends also on instrument's plans. 

SPB:
- It has planned tests on the calibration of pipeline / DAQs for next week.

FXE:
- It has upgraded to new Karabo and some controls will be updated today.

MID:
- Work ongoing as planned.
- CTRL test the influx data logger today and Monday and this causes loosing of information for few minutes. 

HED:
- Water incident in SA2: Water spills caused a flooded experimental hutch. TS have repaired and will check with the external company if systems have been exchanged. 
Such events must be avoided in future. 
- In many hutches there are water sensors in the floor which are not connected: TS and SRP shall take a look.
- Summer shutdown: there was scheduled task (presumably from Desy groups) on June 8-10th that nobody showed up. By the other side, suddenly someone was working inside the 
laser room. 
Ulf would like to see Desy people working with better planning and coordination. As positive, EEE tasks on microTCA are an example of good practice in communication and 
coordination. 

SCS:
- Not present.

SQS:
- No issue to report.
  132   16 Jun 2020, 13:32 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 15.06.2020
General Announcement:
- There will be additional ventilation maintenance on all tunnels, scheduled for next WED/17th and THU/18th between 06:30AM and 08:00AM. 
We request staff to do not enter in tunnels during this period.
- TS has sent information on the hutch crane maintenance starting today up to Wednesday 16th. Please make sure one instrument colleague is present.
- XTD4 will be closed on next FRI/19th as part of Interlock Tests (§88 - TUV Prufung).

CTRL:
- Few minor things were solved on Friday.
- Notification service worked as expected in SPB; VAC also got notification.
- CTRL will follow the uTCA updated after EEE is done today.
- CTRL is working on the PMO projects.

DA:
- Nothing to report.

EEE:
- Activities running well.
- Today afternoon migration plan for tunnel crates and tomorrow SA2.

VAC:
- Nothing to report.

XPD:
- Nothing to report. 
- XPD will check the uTCA crates after its update/restart.

DET:
- Data has been taken at SCS; also performing online tests.

ITDM: 
- Nothing major - Continuing updates with SQS, MID and HED instruments.

XRO:
- Nothing to report.

LAS:
- Scheduled SA2 maintenance on Tuesday. EEE firmware update also takes place. 
- Timing related updates on SA1 and SA3 are under discussion between the groups.

UNSYS:
- Everything is OK - All work in tunnels are done.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- Nothing to report.

HED:
- Water leak from last week: TS has contacted the external company and a faulty air humidifier was the cause. It will be changed/fixed.

SCS:
- Not present.

SQS:
- Nothing to report.
  133   18 Jun 2020, 13:40 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 17.06.2020
General Announcement:
- Today and tomorrow it takes place the tunnel ventilation maintenance between 6:30 and 8:00AM;
- An e-mail was sent to readiness list with tunnel access restrictions for next Friday morning at the Osdorf Born site in and XTD4 work between 10-11AM.
- Today there the maintenance of the SA3 hutch crane is scheduled.

CTRL:
- CTRL will follow up the uTCA updates.
- Mc2 migration in SA2 is almost done - only XPD needs to test some componenents.
- CTRL is working in some layout problems in scenes of the latest GUI update (new Karabo). Groups are encouraged to write tickets to CTRL if they require changes. 

DA:
- Nothing to report.

EEE:
- Shutdown activities are ongoing with, e.g, VAC loop updates and PLC updates;
- The firmware updates affecting the PP-laser timing will take place on next Friday (19.06) in all SASEs. 
- EEE is following the delay on the MID cabling related to personal interlock. 

VAC:
- Shutdown activities in XTD6 and XTD10 are ongoing. 

XPD:
- Currently finishing own summer shutdown tasks in tunnels.
- First DAQ test together with ITDM: had to wait the timing server re-start. To be continued today also after full mc2 migration.

DET:
- Calibrations of detectors at instruments are ongoing.

ITDM: 
- Nothing to report.

XRO:
- Not present.

LAS:
- So far all in good state.

UNSYS:
- Nothing to report.

SPB:
- DAQ update was not an entire success - but it has been taken care. DAQ is needed for the calibration test of detectors.

FXE:
- Nothing to report.

MID:
- Nothing to report.

HED:
- Nothing special.

SCS:
- Nothing to report.

SQS:
- PC updates are ongoing.
- SQS raises the question on hutch access during the disabled emergency off planned for next Monday. It is possible that SQS EQP will be in sick leave on that day. 
XO will contact Torsten Schoen to get more details on the time schedule and possible access for that day.
  134   19 Jun 2020, 14:28 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 19.06.2020
General Announcement:
- Next Monday it is planned the NOT-AUS experiment in the frame of Interlock tests and the emergency off will be disabled. 
Only groups with EQP persons can continue working in the hutches. An e-mail was sent by TS.
- There will be test on smoke extraction in Tunnels on next Monday and Tuesday. Information was sent to Readiness mailing list.
- An e-mail to Readiness list was sent this morning regarding TUV/Interlock tests in SASE areas on July 1-3: 
No access or work on the experimental and optics hutches is allowed in these days. More specific details will follow in the coming week. 
If you have questions, please contact XO.

CTRL:
- Finished 2.9 deployment - control rooms also have the updates;
- CTRL is working on the XGM together with Theo (XGM does not update some properties). This came after an update done at the Desy side.

DA:
- Nothing to report.

EEE:
- Shutdown activities are ongoing. 
- Migration to mc2motors was ongoing. EEE encourage groups to check motors after start running again.
- For next week: cabling work in SCS and PLC modifications with the help of two external colleagues.
- Timing system update: SA1 and SA3 timing system laser and instruments are done; EEE will do the SA2 this afternoon; Still to be arranged a date for the balcony rooms.
If problems occur, please contact Bruno Fernandez.

VAC:
- Finished all shutdown activities. 
- The recovery of HED pulse picker branch needs help of HED staff. HED points Konstantin is around today.

XPD:
- Finished all XPD tunnel works.
- Testing ongoing: SA2 motors after mc2 migration.
- Checking the trigger on uTCA crates after upgrade.
- DAQ test was successful with ITDM.

DET:
- New DAQ system has some issues with AGIPD in SPB (did not store data) - to be followed next week.
- Deployment of new calibrations is ongoing.

ITDM: 
- Nothing to report.

XRO:
- Not present.

LAS:
- Warming up SA3 laser.
- SA1: LAS maintenance is not finished. So we ramp up later. Bruno reminds SA1 must be back and switched on again.

UNSYS:
- Enclosure of panels in SASE3 has been installed and all tunnel activities are done.

SPB:
- Nothing to report.

FXE:
- Works on Detectors are ongoing.

MID:
- Nothing special.

HED:
- Activity with lasers alignment.

SCS:
- Not present.

SQS:
- Nothing to report. Working in different things/parts.
- SQS has planned activities for July 1st-3rd. It suggests that more specific communication on TUV tests and access restrictions must be done differently
than the e-mail distributed on June 8th and today. XO will look for improvements.
ELOG V3.1.4-7c3fd00