Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Technical integration and coordination logbook, Contact: A. Violante, G. Wellenreuther, Page 10 of 29  Not logged in ELOG logo
New entries since:Thu Jan 1 01:00:00 1970
ID Date Author Location Severity Subject
  397   22 Feb 2023, 09:44 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 22.02.2023
General Announcement:
- Situation of He gas: currently it is a bit more relaxed than last year but it is still hard to make predictions of He availability in a month or so. Please contact XO in case you have plans to use He 
gas.

CTRL:
- Nothing to report.

DA:
- Nothing to report.

EEE:
- PLC team: SA3 PPL was damaged and replaced. Fixed together with LAS.
- ADQ for SPB Laser setup was fixed (fast ADC).

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- Setting up DSSC at SCS for the next experiments: main chiller used to cool down the detector did not restart after the maintenance period. A replacement will be installed today. For tomorrow there are 
plans for testing.

ITDM: 
- Nothing to report.

XRO:
- SCS exit slit is fixed and further commissioning still pending.

LAS:
- Issues with Smaract stages in SA3: control crates (replaced) and stage (not functioning). Stages to be exchanged today and tomorrow.

UNSYS:
- Nothing to report; ZZ on Monday was successful.

SPB:
- Nothing to report.

FXE:
- PP-laser is solved;
- Yesterday one had 1mJ at 5.8keV. After fixing some machine parameters the realignment had to be done and took 4 hours of lost time.

MID:
- All fine at MID

HED:
- Nothing to report.

SCS:
- Thanks to TS also for supporting with chiller issue.

SQS:
- Running 2-color PP experiment. When SASE1 changed photon energy the pulse energy of the pump color changed, this is a serious problem for experiment.
- Wiener MPOD power supply does not work properly. We can ramp it up from zero, and ramp it down to zero, but otherwise changing value was not possible. 
Meanwhile the problem solved by itself. Still unclear if it was hardware or control or whatever else.

SXP:
- Nothing to report.
  396   20 Feb 2023, 11:05 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 20.02.2023
General Announcement:
- Accesses to XTD10 and XTD4 are happening this morning. The South branch sees continuation with beam activities and preparation for this week of operation.

CTRL:
- Two Announcements: 
1. Today at 13:00 a fix for influx proxy will be deployed. A short downtime will happen; 
2. Also 13:00 a fix for the delay timers will be deployed everywhere. A contact person at instruments will restart the device.

DA:
- Nothing to report.

EEE:
- One OCD call related to HED encoder: to be investigated and fixed this week.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- SA3 intervention for SCS exit slit ongoing this morning.

LAS:
- SA3 PP-laser will be ready at the end of today.

UNSYS:
- A ZZ in SA3/XTD4 will take place today.

SPB:
- Pointing always had to be corrected at 7AM after beam back from night shift at FXE.
- Transmission with XPD last week: higher intensity at the calorimeter was seen (also high fluctuation 10-15%).

FXE:
- Pump probe beam shape showed some problems. LAS will investigate today.

MID:
- Nothing to report.

HED:
- Beam jitter in order of 50-100us is not like best performance seen last year.
- Everything else went fine. 

SCS:
- Nothing to report.

SQS:
- Nothing to report.

SXP:
- Nothing to report.
  395   15 Feb 2023, 10:14 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 15.02.2023
General Announcement:
-	 

CTRL:
- Nothing to report.

DA:
- Nothing to report.

EEE:
- Nothing to report.

VAC:
- Nothing to report.

XPD:
- Working with SPB with laser power meter / calorimeter.

DET:
- Not present.

ITDM: 
- Announcement: on next Monday at around 8AM the E-log will not be available for a short time.

XRO:
- Working on SCS exit slit. Recommissioning with beam will need to be done. Next action in tunnel will happen on next Monday. Until then the slit is currently detached with cables. None shall move or touch 
the device.
- Regarding parts: they are ordered and shall arrive later this week.

LAS:
- Nothing to report.

UNSYS:
- Nothing to report.

SPB:
- Nothing to report.

FXE:
- Problem with Jungfrau 1M last night. Informed to DET.

MID:
- Motor of rotation for the spectrometer is not yet working to characterize seeding. EEE is investigating and may have to exchange motor.

HED:
- Beam pointing was realigned. It jitters and feedback tries to work. To be see along the day.

SCS:
- Nothing to report.

SQS:
- Nothing to report.

SXP:
- Nothing to report.
  394   13 Feb 2023, 10:05 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 13.02.2023
General Announcement:
- Accelerator downtime on Saturday of 5-6 hours due to a matching capacitor located at the GUN. Work to find the problem and exchange cause this delay and it was the first of this kind since 2016.

CTRL:
- A fix for the device clone is prepared and will deployed today.
- Two issues from weekend being investigated (camera SPB/SFX and PLC) with EEE and CTRL.

DA:
- Data generation for MID: high load during the weekend. Now it was drained. 
- Data delay during the weekend was recovered: migration queues were very long and calibration was delayed. Denial of services happened as many works were in the queue. 
This was changed and shall not happen anymore. All data taken during the time was processed.

EEE:
- Working on the timeout issue.
- OCD calls for AGIPD motor positions: configs were recovered.
- Scanner issue is not yet clear if mechanical or software related.

VAC:
- Nothing to report.

XPD:
- Preparing for calorimeter measurements at SPB.
- Today supporting BKR to record images.

DET:
- Nothing to report.

ITDM: 
- Be aware that last week was not a standard week in Data recording, being a run at the edge of capabilities. Experts are looking to explore other possibilities. 
- ITDM expected MID to take a bit higher data but it was really at the edge. Much less calibrated data was generated – efforts by data reduction helped to keep into the edge. 

XRO:
- Nothing to report.

LAS:
- Unexplained behavior of ADC in SA2 laser being investigated.

UNSYS:
- Nothing to report.

SPB:
- Did not get the RF window at the beginning. It was enough to get some data by end of the week.

FXE:
- Users were happy last week.

MID:
- Good week and very successful week with user group.
- High duty cycle could be achieved - thanks to DA; reduced due to the high load.

HED:
- Nothing to report; finishing to prepare for this week beam.

SCS:
- Nothing to report; waiting for XTD10 tunnel investigation of the motor.

SQS:
- Nothing to report.

SXP: 
- Nothing to report.
  393   08 Feb 2023, 10:25 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 08.02.2023
General Announcement:
- When questions or issues with operations or beam parameters appears, please contact the PRC. The Karabo main scenes are changed and the PRC phone can be directly found at them.
- As PRC A. Galler says that competing requests by SA1 and SA3 was taking place yesterday. So the decision was to run non-interleaved until Thursday when the plan will be revisited.

CTRL:
- Issue with Bassler cameras in SPB (only): still under investigation.
- PLC timing feedback devices: workaround was implemented and together with EEE further investigations are ongoing. 

DA:
- Nothing to report.

EEE:
- Nothing to report.

VAC:
- Nothing major to report.
- ZZ in XTD10 for the exit slit was done on Monday.

XPD:
- Calorimeter for XPD is installed and running.
- FEL IMG in SA3 has a new feature installed by XPD and XO: in case of danger for the device the number of bunches will go to zero. 
This takes into account the damage threshold of the total pulse energy of photon beam. Above a limit it will drive beam to 0 bunches. 
Only installed at the FEL IMG and in case of questions please contact Andreas Koch.

DET:
- On Friday there is was a timing shift for pulse resolved detectors for SA2. That also appears with AGIPD. 
Jolanta S.-D. says that at MID the shift is at 9 clocks; at HED is up to 15 clocks (thus around 100-138ns) when comparing to September, and depending on detector positions. 
An enquire with machine has to be done if it relates to BAM or another device.

ITDM: 
- Nothing to report.

XRO:
- SA3 exit slit: work/investigation is ongoing by XRO.
- Calibration of mirrors are almost done.

LAS:
- Nothing to report.

UNSYS:
- Nothing to report.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- Issue with CRL1 (first arm): device is interlocked in the OUT state for both X and Y axis. Zunaira A. says that arm1 is not part of SEPS Interlock. 
Investigation with EEE has to take place. Operation can continue with current status.
- Issue with rotary motor for the spectrometer rotation appeared - seems to be damaged. On Monday chamber has to be open. 

HED:
- Not present.

SCS:
- On the exit slit strategy/status: Mikako M. will discuss internally at XRO and go back to SCS. 

SQS:
- Nothing to report; acknowledged the announcement done by the PRC.
  392   06 Feb 2023, 12:48 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 06.02.2022
General Announcement:
- A. Galler shows at the TTFinfo schedule where to find information for operation calendars. 
- A. Silenzi inform that the Jour-Fixe takes place and instruments shall be present to inform on needed requests to DRC/DOC.
- As PRC, Harald Sinn informs the agreed RF window that was set on Friday was reversed on Saturday. Do not hesitate in contacting the PRC in such situations.

CTRL:
- Nothing to report.

DA:
- Nothing to report.

EEE:
- Two OCD calls on weekend: 
1. Issue with PP-laser setup at FXE/Mono in tunnels - to be followed by PLC team; 
2. Issue with SA3/SCS Exit SLIT in the tunnel to be followed up by ZZ. Couple of hours are needed in tunnel to try to fix it without guarantee of success.

VAC:
- Performing ZZ and breaking interlock in XTD10.

XPD:
- Jan G. says chamber for calorimeter and laser power meter are being installed in SPB hutch today.
- Tests of the IMG watchdog can take place only after lunch due to ongoing ZZ access.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- Not present.

LAS:
- Laser timing in SA1 is 3ns off.

UNSYS:
- Tunnel access ongoing in SA2.
- Replacement of the HXRSS crystal to take place today.

SPB:
- Wednesday morning Karabo server was down for 90min; it was fixed by the DOC.
- Chan Kim says that SPB/SFX had a wrong RF window set on Wednesday.
- Camera devices were showing issues (had to break interlock to reset camera) and needs a long term fix. 
Wajid E. says CTRL investigates with high priority and it seems not to be a Karabo issue. Investigation continues at CTRL hands.

FXE:
- Nothing to report.

MID:
- Problem with FSSS that is needed for the user experiment: CTRL and SEC are looking into it.

HED:
- Setup instrument; Karabo connections solved by DOC.
- Due to RF window AGIPD tests were delayed.
- A ZZ for checking a motor can be done still this morning.

SCS:
- Troubles with motors were addressed.
- Exit slit issue still pending.

SQS:
- Nothing to report.
  391   01 Feb 2023, 10:56 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 01.02.2023
General Announcement:
- A. Galler reminds instruments to use the Operation-2023 e-log for daily reports.

CTRL:
- Issue with Karabo dataloggers connection to newly available Proxies (not connecting). Problem is understood and a fix in under made. Then one shall apply to topics (takes 5-10 minutes downtime).

DA:
- Nothing to report.

EEE:
- Nothing major to report; working on a received ticket.

VAC:
- Last night FXE reported issues with SA1 ion pump. Vacuum was OK but the status of Karabo was wrong. It's under further investigation and Wajid E. comments a ticket was sent and is being addressed.

XPD:
- Nothing to report.

DET:
- Detector installed back to HED (ePix) after successfully intervention.

ITDM: 
- Updates of Maxwell cluster was done yesterday. If something unexpected happens please get back to ITDM.

XRO:
- Instruments taking beam at hutches and no major problems have seen so far. 

LAS:
- SA1 and SA2 PPL's are in operation.
- SA3 PP-laser is under preparation.

UNSYS:
- Issue with cell24/SA1 undulator motion happened and was fixed on Monday.
- Gap of exchanged undulator in SA2 seems not be correct and it is needed a ZZ for the gap calibration, possibly next Monday (tbc).

SPB:
- Camera devices goes to error and needs power cycle.
- After power cut some motor lost positions.

FXE:
- He gas supply: A. Galler informs that currently there is no shortage of He for the next two weeks.

MID:
- Making good progress by setting things up at instrument.
- One sample stage has problems and EEE will work on Friday.

HED:
- Preparing for taking beam on Friday and currently working on Dipole laser.

SCS:
- Problem with new Interlock and BKR had to overwrite it. Beam is now at the instrument.

SQS:
- Not present.
  390   30 Jan 2023, 09:49 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 30.01.2023
General Announcement:
-	 

CTRL:
- Nothing to report.

DA:
- DA-OCD service has started from this week.

EEE:
- PLC had an OCD call on Saturday (motor SA3 M2). XRO could continue and further investigation is ongoing.
- SEPS to be done today in SA3.

VAC:
- Nothing to report.

XPD:
- Minor HIREX issue on the weekend but did not affect activities.

DET:
- Jungfrau detector had a small bug in Karabo control device. The device has to be re-instantiated when detector is rebooted. CTRL is aware and preparing fix.

ITDM: 
- Nothing to report.

XRO:
- On SA3 M2: issue related to PLC update in December; apparently resulted with loss of calibration in one motor. All alignment were done with other parameters based on beam reflection. 
- Steffen Hauf comments there was two different issues with different motors: 1. the calibration was solved end of last week; 2. from Saturday it was a problem with encoder which will be fixed this week 
with EEE. 

LAS:
- Stages with problem but running.
- SA1 will be ready for users by the end of today.

UNSYS:
- Small issue with SA1/cell22 air coils were fixed by Suren K.

SPB:
- Thanks to supporting groups for the bring-up days.

FXE:
- Nothing to report.

MID:
- Question on the availability of PP-laser in SA2: Daniel K. informs that is expected by the end of today but this will be confirmed with other LAS colleagues.
- Question about intensity in SA2: A. Galler informs there is no news on the cause of low intensity; Raul V. as PRC mentions currently it was reached about 500uJ at 9keV.

HED:
- Nothing to report.

SCS:
- Bring-up days today and SEPS interlock tests.

SQS:
- Nothing to report.
  389   25 Jan 2023, 11:01 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 25.01.2022
General Announcement:
-  As PRC, Raul V. thanks to CTRL and EEE for the work with the SEPS yesterday.

CTRL:
- New version for bunch alignment monitor devices (for pulse resolved operation). An e-mail will be sent to xo-info list.
- Regarding the issue reported by LAS: Karabo Beckhoff device went in error and a work around solution has been developed and to be implemented to reset the system.
- Issues with SEPS interlocks: PLCs devices went down at HED during tests. 
Steffen H. says an interface issue with Karabo happened; interlock settings are protected; yesterday CTRL had to implement a new update and as consequence many PLCs went down.

DA:
- Bring up days going smoothly; few issues found were fixed.

EEE:
- Nerea J. informs that fix for the MDL for IMGS is deployed and shall work.
- SEPS modifications were done by lunch time yesterday. SA1 and SA2 were tested by end of the day. The SA3 SEPS tests will be done on Monday.

VAC:
- Nothing to report.

XPD:
- Hard X-ray PES was recommissioned last week. New Metrocal acquisition did not work; DA will investigate and inform XPD.

DET:
- Bring up days are ongoing.

ITDM: 
- E-mail was sent for the dCache maintenance scheduled for next Monday.

XRO:
- Not present.

LAS:
- Issues with stages are under work and to be implemented today.

UNSYS:
- A ZZ in SA2 to replace PS motor in cell 17 took place. The motor was replaced and a few spares are still remaining. 
- This or next week Pb shields will be received and ZZ would be required for their installation.
- Tomorrow the alignment of 4mm aperture in SA2 will take place.

SPB:
- Not present.

FXE:
- Nothing to report.

MID:
- Comment to XRO: alignment in tunnel XTD1 in ongoing.

HED:
- Broken pile-up on Monday happened. Steffen H. says that macros can be restarted now.
- Alignment in tunnels by XRO: HED needs some information on activities.

SCS:
- Busy with bring up days at hutch.

SQS:
- Not present.
  388   23 Jan 2023, 10:01 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 23.01.2023
General Announcement:
- As PRC Jan G. says machine was tuned at 7keV for SA1 and SA2 and 700eV for SA3 with good performance. SASE tuning proceeded as planned with few issues blocking EPS. 
- Analyzed the effects of the 4mmm aperture at the end of the undulators in SA2: it is not exactly in the center where the FEL is lasing. 
It was found the FEL is well aligned at the IMG cross but is partially blocked by the pipe and is under discussion with RCs the next steps.
- Jan G. mention that one screen at SPB was in unclear state; also a software device was blocking beam in XTD9. A ticket was issued; initially the software blocking could not be identified. 
Solution was to close the XTD9 shutter. Steffen H. suggested to also contacting the DRC for urgent and the technical problem with clone device will be followed up.

CTRL:
- Nothing to report.

DA:
- Nothing to report.

EEE:
- Busy with bring up days. No major obstacles were found so far.

VAC:
- Nothing to report.

XPD:
- Restart Diagnostics and photon systems last weekend went relatively fine.

DET:
- Finished with MID for ramp-up and today HED is scheduled. So far so good.

ITDM: 
- Nothing to report.

XRO:
- On the weekend issues with MDLs run by the experiments appeared. A follow-up will be made to avoid problems in the future.

LAS:
- EEE was informed of issues in the balance cross correlators. Nerea J. comment that tests were done but not reproducible. More follow-up to be done today.

UNSYS:
- SA3 cell 18 issue with PS solved remotely last week. All fine with undulator systems.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- Bring up days were mainly a success; thanks to involved groups. All good.

HED:
- Bring up days were also successful. Thanks to EEE and CTRL.

SCS:
- Not present.

SQS:
- Nothing to report.
  387   18 Jan 2023, 11:37 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 18.01.2023
General Announcement:
- The 5Hz tests were successfully completed. Contrary to the original schedule all tests (pure and hybrid) were finished yesterday already. 
From now on the rep rate is set back to 10Hz. If you were affected during the tests please contact XO. 
- Machine starts up with 11.5GeV from January 30th.

CTRL:
- The requirement to add the associated karabo device name to the Master Equipment List before requesting the network registration of the device is not needed anymore. 
Please suggest the karabo name directly in the network registration form. 
In case of doubts please contact Wajid E.; J. Szuba adds the network registration form in XIM is changed (Karabo name is now optional). It shall be used when an ALIAS is needed.
- Karabo framework is being worked today. 

DA:
- Preparing for bring up days next week.

EEE:
- Nothing to report.

VAC:
- Closing XTD6 and XTD9 today after lunch.

XPD:
- Finishing tunnel activities.

DET:
- Nothing to report.

ITDM: 
- UBuntu22 DOOCS JDDD is being updated today.

XRO:
- Nothing to report.

LAS:
- All good and no interruptions from the 5Hz tests.

UNSYS:
- Currently performing middle plane scans in SA1 and SA2.

SPB:
- Nothing to report.

FXE:
- Aligned XTD9 cameras and Mono. One power supply did not work and Beckhoff devices of all FXE tunnel components did not work; Wajid E. informs this was because of wrong Alias.

MID:
- Nothing to report.

HED:
- Not present.

SCS:
- Nothing to report.

SQS:
- Agilent turbo pump shows a Karabo problem. EEE will be contacted.
  386   16 Jan 2023, 09:54 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 16.01.2023
General Announcement:
- Tomorrow and Wednesday the 5Hz test take place; Wednesday as the pure 5Hz operation and on Wednesday there is the hybrid test. Every second pulse will not see any train.

CTRL:
- New version of Beckhoff Karabo device will be deployed today at 14:00; it shall take 5-10 mins.

DA:
- Nothing to report.

EEE:
- Continuing with remaining maintenance tasks and preparing the bring-up days with instruments.

VAC:
- Nothing to report. Tunnels XTD6 and XTD9 remain open until Wednesday.

XPD:
- Preparing for tunnel closure, stat-up and 5Hz tests.

DET:
- Gotthard1 detectors: need a firmware upgrade and will be coordinated with instruments.

ITDM: 
- Announcement: on Friday exchange of SA1 devices.

XRO:
- All fine from XRO.

LAS:
- Working on the Lasers back-up; Lasers will be shut down for the 5Hz tests.
- Issue with Smaract stages being worked.

UNSYS:
- Nothing to report.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- Nothing to report.

HED:
- Nothing to report.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  385   11 Jan 2023, 11:16 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 11.01.2023
General Announcement:
- If you have a forwarded invitation for the XO Int. meeting in your calendar, it will not be automatically deleted. The new invitation was sent at the end of December. 
Please contact XO if you have not received. Another option is to subscribe to the xo-info mailing list.
- The Operations-2023 e-log is made available. Thanks to ITDM for the support on it.
- The 5Hz tests will take place on the 17-18.01. A timeline schedule is to made available today from Desy and will be shared via the xo-info list. 
The 5Hz operation will be done on the 17th and a hybrid mode test is on the 18th.
- Tunnels XTD6 and XTD9 will remain open for a max of 1 week. 

CTRL:
- Nothing to report.

DA:
- Nothing to report.

EEE:
- Power OFF in SA3: electronics in SQS, SCS and PP-lasers were affected. Systems had to be restarted. 
- Discussion is going on to avoid such mishaps not happening again in future.

VAC:
- XTD6 and XTD9 are open; Please FXE and HED shall check cameras and Monochromators before the tunnels are permanently closed.

XPD:
- XGM in SCS hutch was affected by the power failure. It was recovered and is back into the normal state. Other systems are also being brought back during this week.

DET:
- Nothing to report.

ITDM: 
- Upgrade of Ubuntu 18.04 LTS control PCs is going to take place until April. An e-mail was sent to xo-info list. Instruments shall contact ITDM accordingly by using the ticket systems.

XRO:
- Not present.

LAS:
- Switch OFF in SA3: no harm seems to remain. 

UNSYS:
- Nothing to report.

SPB:
- Nothing to report.

FXE:
- FXE is interested in XTD9 access for the next days. 

MID:
- Nothing to report.

HED:
- HED is interested in XTD6 access for the next days.

SCS:
- Suffered from the power OFF: bringing back vacuum for XGM and other systems. All shall be fine.

SQS:
- Not present.
  384   09 Jan 2023, 10:10 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 09.01.2023
General Announcement:
- Interlock tests light taking place today and tomorrow, starting at Desy premises and tunnels.
- On 23.01 there is the Interlock tests at XHEXP1. 
- Zunaira A. asks for one experimental hutch in all SASEs (optics hutch can also be) to be closed for tomorrow to check some signals for tunnels. Hutches need to be closed at around 09:30-10:00. 
SQS accepts to interlock the hutch. MID also says it is possible but a precise time needs to be communicated.
- On 17-18.January the 5Hz operation will happen. Needed groups are already informed and tests shall be transparent for the instruments. Tim Wilksen will prepare a schedule to be distributed as soon as 
available.

CTRL:
- Influx DB: two nodes are available. A 6-month policy notice is the one to be used by Karabo. An e-mail will be sent.

DA:
- Nothing to report.
EEE:
- SA2 lost power on the 31.01. The CPUs in the instruments were not affected; the CPU in SA2 laser was affected and parameters had to be reset. Impression is that UPS did not act. EEE needs more 
information.
- A. Galler says that it relates to the broken UPS in SA2 area. A possible automatic check run/done by MPS triggered the emergency OFF. A new battery for the UPS is ordered and it is to be delivered in 
future.

VAC:
- All relevant tasks for WMP are closed.

XPD:
- XPD would like to continue in XTD9 and XTD6 after the interlock tests to conclude minor activities.

DET:
- Nothing to report.

ITDM: 
- Reminder to all instruments and support groups: finish accessing and closing the proposals (deadline has already passed) before they will be discarded.

XRO:
- Will need access to tunnels XTD6 at late January. The access is not related to test components.

LAS:
- Bringing lasers back up. In SA2 there was a rough start due to the power OFF but seems all in good track.

UNSYS:
- SA3 undulators: rotary encoders could be used to control the undulator gaps.
- Suren K. informs that partially recovered encoders for the 3 upstream segments. Spare parts for the next two devices will arrive in some months. Root cause for the SA3 power issue is not understood. 
Undulators can be operated.
- Power distribution terminals in SA2 (2 units) and 1 unit in SA1 needed replacements.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- Request to support groups: if external companies need access to hutch, please remind these companies to do not use dirty shoes when accessing any hutch.

HED:
- Nothing to report.

SCS:
- Issue with XGM gas supply last week (valve was closed by someone unknown). Check functionality is ongoing but all seems to be fine. 
- Transport taking place may affect access in areas around SCS, including XTD10.

SQS:
- Nothing to report.
  383   19 Dec 2022, 10:01 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 19.12.2022
General Announcement:
- This is the last XO Integration meeting of this meeting.
- An electrical issue in SA2 experimental area happen: issue with UPSs - rack rooms could be affected. TS is investigating. PP-lasers were unaffected.

CTRL:
- Concluded Karabo updates basically in all topics.
- Further updates ongoing this week.

DA:
- Nothing to report.

EEE:
- Nothing to report.
- Train-IDs for SA2 instruments were missing during the weekend (likely related to the UPS failure) but are back since about an hour ago and then maybe only PLCs were affected.

VAC:
- All fine with VAC.

XPD:
- Work ongoing as planned.

DET:
- Nothing to report.

ITDM: 
- Maxwell maintenance taking place this week. 
- Servers for SA2 apparently were not affected due to the issue with UPS. To be further checked.

XRO:
- Not present.

LAS:
- Nothing to report.

UNSYS:
- Five undulators in SA3 have faulty encoders and are not moving after a power cut on 06.12 (seen in history of local PLCs - happened from cell14 to cells23). Reason for power down is not known. The power 
was ON from cell1-13. 
- Replacement of linear encoders are not possible with vacuum chamber between girders as needs alignment.
- First UNSYS will try to operate with rotatory encoders, if does not succeed, segments will be taken out.
- There are 4 spare encoders to repair 3 segments. Delivery time for new spares is 3-4 Months.
- Needs investigation to discover reason for the power outage in cells#14-23.
- Cell 33 in SA2 is fully operational.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- Power failure of UPS happened on Saturday on the SA2 experimental Hall area – will further investigate for affected systems.

HED:
- Will investigate any effect of the UPS failure.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  382   14 Dec 2022, 09:55 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 14.12.2022
General Announcement:
- There will not be Xo Int. meeting next Wednesday 21.12. The last meeting for this series will be next Monday 19.12.
- Martin Doering announces that the DACHS system maintenance previously scheduled for next Monday 07:30AM was already done and there will be no access disturbance next Monday; 
Currently around 48% of the winter maintenance tasks are timely done. For Desy groups around 36% are closed.
- Please inform xo-planning for tasks that are not going to happen or are cancelled/delayed. An e-mail will be sent to inform the groups in the coming days and the file to be updated will appear at the 
Sync&Share system.
- XO has been asked regarding gases and cryogenics. The process in place is the Hall Crew only supporting TS and if any group is needing technical gases and cryogenics, please continue to submit a ticket 
to TS. 
- K. Wrona asks for additional info on the 5Hz operation. A. Galler says that if there is a showstopper this has to be communicated and the startup period in January is meant to test this operation mode.
All timing systems will run at 5Hz and some solutions will be put in place e.g. at the lasers. Reason behind is to save electricity. 

CTRL:
- Done with Karabo upgrade in SA1 and SA3 topics. Today goes on with SA3.
- On Thursday ITDM will upgrade the SA1 topic for data loggers' machines. This takes about 1 hour.

DA:
- Nothing to report.

EEE:
- Ongoing with the current schedule for tunnel updates: SA1 motion done yesterday. Please check these systems in the coming days.

VAC:
- Everything is going accordingly to the schedule.

XPD:
- In a group retreat.

DET:
- Testing detectors after the Karabo update.
- Following request from DA to test Detectors calibration pipeline (LPD, AGIPD-1M).
- Operation at 5Hz will be discussed internally.

ITDM: 
- Continuing the calibration work.
- Finalize servers update today (there is one hardware issue to solve).
- Data loggers for SA1 will be changed to the new hardware. An e-mail will be sent.

XRO:
- Not present.

LAS:
- Nothing to report.

UNSYS:
- Small absorber at the end of SA2 was installed in preparation for the SCUs.
- SA3 will have a Marwin installed to measure radiation during operation.
- Beckhoff sent back repaired motors for PSs. A total of 8 spares are now available.
- SA3 undulators had a power cut and is under investigation.

SPB:
- Nothing to report.

FXE:
- Maintenance of the electrical rack today.

MID:
- All fine at MID.

HED:
- Not present.

SCS:
- Nothing to report.

SQS:
- Work happening at the experimental hutch today; Filter change for the air conditioning has to be postponed.
  381   12 Dec 2022, 10:01 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 12.12.2022
General Announcement:
- So far there is no reports of big bad effects from the power outage on 03.12 caused by MPS activity.
- Experimental Hall cranes will be maintained tomorrow by an external company and therefore can not be used in the time.

CTRL:
- Starting today with Karabo update.

DA:
- Nothing to report.

EEE:
- Nothing to report.

VAC:
- Nothing to report.

XPD:
- All planned tasks for maintenance are ongoing; in XTD2 started mounting the clean tent; 
- On Tuesday and Wednesday XPD has a group retreat.

DET:
- Nothing to report.

ITDM: 
- Delivery of online cluster server is delayed in SA1 and it will be concluded this week. Please contact ITDM if service is needed.
- Tomorrow 6AM distribution layer switches will be updated to be back with redundant mode of operation.

XRO:
- Not present.

LAS:
- Nothing to report.

UNSYS:
- New SA2 undulator is aligned and vacuum chamber clearance is to be checked today.
- Fuses for the balcony room are ordered.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- All fine at MID.

HED:
- Nothing to report.

SCS:
- Nothing to report.

SQS:
- Working inside the hutch as planned.
  380   07 Dec 2022, 12:06 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 07.12.2022
General Announcement:
- Tobias Clever informs to contact TS (Oleg E.) in case of broken fuses (see UNSYS).
- Regarding liquified gases: the XHCrew does not provide safety trainings nor is the main contact for supplying gases or cryogenics. 
Please contact TS will enquires regarding technical gases or cryogenic liquids. TS is the main point of contact for this matters.
- Regarding network problems yesterday: Desy exchanged a switch for a new one and it was when problem happens. Office telephones are currently not working. A new ticket to NOC was issued. 

CTRL:
- Started the topics back after the power maintenance. Not all devices are up as there is some updates to be done in the next days/week. The ramp-up went fine for the topics that were restarted.

DA:
- Nothing to report.

EEE:
- Results of the check after the power cut show no damage.
- PLCs were also recovered.
- uTCA went up and the planned update of fast-ADC will take place next week after the Karabo update. Please do not use fast ADC until then and contact Bruno F. in case of questions.

VAC:
- Continue with scheduled works for the WMP.
- From Saturday task: everything was recovered without main issues.

XPD:
- Nothing to report.

DET:
- Not present.

ITDM: 
- Not present.

XRO:
- Electrical shutdown went well in tunnels.
- From yesterday once Karabo is back: XRO is checking again systems.
- An update of tasks for the WMP will be send to XO as some tasks were cancelled.

LAS:
- No issues from the power shutdown. All are fine.

UNSYS:
- SA3 balcony room had a problem after the power shutdown - fuse was broken; Now it is working.

SPB:
- All going fine, tests with Jets today.

FXE:
- Examining CRL lenses.

MID:
- All fine at MID.

HED:
- Not present.

SCS:
- Switching ON components and so far no damaged devices were found.
- Normal maintenance program is ongoing.

SQS:
- Restarting devices and no damaged components were found already.
  379   05 Dec 2022, 09:59 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 05.12.2022
General Announcement:
- Dec.3rd power an drinking water maintenance: many thanks to TS and MKK groups for their efforts - tasks accomplished without any harm by lunch time (4 hs earlier than originally planned). 
- Unfortunately an action by another Desy group triggered radiation protection in instrument areas. This action was not announced to XO. 
Please inform XO if you encounter any damaged device. An 8D report will be prepared on this incident.
- PLCs and Karabo will be ramped up; Office network was available all time; Drinking water is already available.
- Zunaira A. says that an e-mail is usually sent to a list of persons. A. Galler says that this time we do not know if someone was informed.
- J. Szuba says only in SA1 rack rooms were out of power.
- Tobias Clever inform that every device can be switched on again.

CTRL:
- Start bringing up Karabo topics as soon as control machines are available.

DA:
- Nothing to report.

EEE:
- Tunnel loops are already properly working.
- Switching ON instruments loops as agreed with them from today on.
- uTCAs are in process to be brought back.

VAC:
- Lost some controllers and power suppliers as expected but no major issues on Saturday.

XPD:
- Survived electrical shutdown quiet well: PES and XGMs are fine.
- Second outage due to Desy group was detected first at SCS XGM which was the first device to be brought back.
- Re-starting more devices after Karabo is back.

DET:
- Nothing to report.

ITDM: 
- Started to bring up the control servers and other systems.
- Comment to update done on office network switches Friday afternoon: one distribution layer is not working. Currently one runs office network in a single layer - to be investigated by NOC.
XRO:
- All systems are reconnected and will be checked when Karabo is available.
- One computer did not come back (failure of power supply).

LAS:
- Nothing to report. Seeders were unaffected to the best of LAS knowledge.

UNSYS:
- Replacement of undulator: new one in SA2/cell33 is in place and connected to control system; Needs alignment by MEA.
- Control cabinets in balcony room to be brought back.

SPB:
- Ion pump system is back online Saturday evening. Continue today with other devices.

FXE:
- To be checked today for effects from the weekend.

MID:
- All fine at MID. Most devices were OFF.
- Work on power line at the balcony room today. Wait for TS finish the work before start major switches. ITDM will wait before re-starting machines there.
- High temperature in control room and hutches is seen this morning.

HED:
- High temperature in the control room and hutches as of now.

SCS:
- Components were OFF and today switches ON again and search for damage.

SQS:
- Not present.
  378   30 Nov 2022, 09:55 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 30.11.2022
General Announcement:
- Reminder on the Power cut activity on Dec. 3rd: please contact XO for questions.
- The heating at HXQ will be switched OFF on Friday 8AM.
- There will be no available drinking water from Friday 15:00.

CTRL:
- Related to 03.12: Karabo and other topics will be shut down on Friday starting at 11:00AM.

DA:
- No updates for today.

EEE:
- In process of preparing for the power cut; groups were contacted for timeframe work.

VAC:
- Not present.

XPD:
- Preparing for power cuts.
- Ramp down day on Monday found only minor issues; very useful data were taken; XGMs were placed OFF; beam transport was brought to safe state.

DET:
- Nothing to report; no news on Jungfrau burst mode.

ITDM: 
- Working accordingly to the plan.

XRO:
- Not present.

LAS:
- Lasers will be switched down from tomorrow.

UNSYS:
- Maintenance work is ongoing.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- All fine at MID; 95% of devices are already OFF.
- Reminder: on Monday TS has work in MID rack rooms; MID start back on Tuesday with maintenance work.

HED:
- Question related to cooling water for the PLC CPUs (which are not being switched OFF): Nerea J. and A. Galler confirm that water cooling is available. 

SCS:
- Nothing to report.

SQS:
- Not present: on a retreat.
ELOG V3.1.4-7c3fd00