Group Selection Page HELP Controls Group Data Analysis Group ITDM WP76 DET Vacuum EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Operation PSPO XO TS Migrated2Zulip
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Technical integration and coordination logbook, Contact: A. Violante, G. Wellenreuther, Page 16 of 31  Not logged in ELOG logo
New entries since:Thu Jan 1 01:00:00 1970
ID Date Author Location Severity Subject
  305   02 Mar 2022, 10:12 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 02.03.2022
General Announcement:
- There is a high probability that we will run out of Helium gas due to difficulties with stock. If an instrument needs He on next weeks please get in touch with TS to verify its availability.

CTRL:
- Last Monday intervention on the SA3 GATT middle layer servers was successful.

DA:
- Today a major upgrade of offline calibration is scheduled during which services won't be available.

EEE:
- Supporting different tasks at SQS (recommissioning motors), HED (motor encoders), SCS and FXE.

VAC:
- Ion pump in XTD9 shows a potential risk of tripping interlock: a ZZ on Friday 14:00 will take place to change parameters.
- Another ZZ in XTD2 to attempt to fix the solid attenuator in SA1 (hole in the arms reported by SPB / 0.5mm Si damaged); try to change the blocking mechanism.
- Dmitry K. asks on the Si intervention in XTD2: Martin D. says a change of Si is a major intervention as it involves need of clean tent etc… and will not be done this Friday. 
The idea is to use a fresh spot on the attenuator. Conditions for interlocks have to be later checked with Liuba S.

XPD:
- ZZ on Monday to remove Shimadzu camera was successful.

DET:
- Nothing to report.

ITDM: 
- Problem with Influx cluster which did not accepted data for 3 hours: search for fixes last days and today a new configuration will be applied, followed by restart afterwards (minutes downtime). No effect 
in tunnels DAQ.

XRO:
- Commissioning beamtime for SA2 mirrors: available beamtime was short. The coating stripes were found in beamlines in respect to motor positions. More beamtime is needed to continue commissioning of M1, 
M2 and M3 in XTD6.

LAS:
- Nothing to report.

UNSYS:
- Apple-X commissioning ongoing: working on Control systems commissioning. Last cell was controlled; more tests ongoing today. The phase shifter tables are not yet ready.

SPB:
- Working with different groups during the week.

FXE:
- D3 was present on Monday to test the BTM; it was successful.

MID:
- Radiation alarm triggered due to a false alarm at MID hutch. Thomas P. from HED helped by calling RPOs; W. Clement, Eric B. and M. Prollius helped to solve it.

HED:
- Preparing for the high intensity laser and also working on motors.

SCS:
- Not present.

SQS:
- Not present.
  304   28 Feb 2022, 10:35 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 28.02.2022
General Announcement:
- This week a facility development week takes place without user operation. XO thanks the groups for posting at the Operations-2022 e-log.

CTRL:
- Update on the SA3 GATT loop (middle layers devices) to be done following to find a good time slot.

DA:
- Today from 10:00-12:00 the calibration system will be down due to an update.

EEE:
- Nothing to report.

VAC:
- Nothing to report.

XPD:
- Nothing to report concerning XPD; SCS made an enter that XGM went OFF for a day.
- Regarding PRC, the machine was running well most of the time; problem with XTD2 Air conditioning due to a fire safety flap malfunctioning happened (downtime of several hours in SA1); 
on Sunday magnet power supplies at the accelerator had a problem and took few hours to restore beam delivery as it required tunnel access.
- The two-color was not created in the right order but it was corrected afterwards. The bandwidths were adjusted a few times and HED said it went well, including their spectrometer. 
- XO proposes that the info on the two-color (order) can be entered in the comment section of the delivery table. 

DET:
- Issue with AGIPD at SPB did not happened again and currently there is no plan for any intervention.

ITDM: 
- Janusz S. says the hardware monitoring needs to be rebooted for several servers (PC layers at SCS, MID) and a short downtime will happen. Proposition is to make today if no complains appear.
- Two control servers also need maintenance and proposal is to make next week.

XRO:
- Busy with activities in this blue week (e.g. Mirror calibrations); it may require CTRL support.

LAS:
- For next week a stage in SA1 will be replaced.
- A change of operation point in SA1/SPB and S3/SQS will happen this week. SCS also need a change working point to 1.1MHz.

UNSYS:
- Tests with the Apple-X to take place this week; preparation for commissioning and lasing attempt.

SPB:
- User time largely went OK; small troubles with DAQ and detector.

FXE:
- D3 is testing components in FXE hutch today. 
- CTRL, ITDM and FXE will discuss on the previously mentioned updates.

MID:
- All fine at MID.

HED:
- A ticket send to EEE is being under work.

SCS:
- XGM high voltages went down to zero and was restarted by powering on again. Cause it is not clear and will be followed up by XPD and SCS members.

SQS:
- Continuing work of moving chamber to prepare for next week beamtime. Some PLCs for the chamber have to be reset motors and other things. EEE is helping with it.
  303   23 Feb 2022, 10:30 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 23.02.2022
General Announcement:
-  A. Galler reminds instruments and support groups to feel welcome in making regular entries on the Operations-2022 e-log.

CTRL:
- FastX of GATT middle layer devices was updated last Monday; the slowness issue is improved and fixed.
- Analyzing to upgrade the broker pile-up issue at Karabo: probably to be fixed by next Monday.
- On the BAM monitor: few properties were changed in the DOOCS side. Changes are transparent to DAQ and all the data must be able to be stored. 
Problem appears when data shall be analyzed and then must be looked to the new DAQ. In case of issues please get in touch with CTRL.

DA:
- Maxwell GPFS access rights bug: patch was deployed on Monday and went successfully.
- Next week there will be an update of calibration (further announcement to be done).

EEE:
- Started installing Coax cables for SXP.
- LBM in MID: EEE contacted Beckhoff and will try to get a fix done still this week.

VAC:
- Nothing to report.

XPD:
- Issues with Desy mobile phones: not all phones were equally affected. Issue seems to be fixed this morning.
- In SA2 the SRA slits were too wide open (probably from tuning times). They were closed yesterday night after users finished work.
- Beam delivery to instruments is running fine and smooth.

DET:
- AGIPD detector at SPB: issue with one of 16 modules not sending data since yesterday. Investigation ongoing with DOC and experts. 
Jolanta S.-D. says that this is a new issue which happened twice yesterday and Desy is contacted. An intervention for the hardware during the blue week shall take place. It may be related to electronics 
outside detector.

ITDM: 
- Issue with "phantom" data appearing at DAQ in SA3 instrument: investigation shows it can't be reproduced; maybe it relates to data arriving earlier. It was only visible at DOOCS devices (Undulators 
device). Under further investigation by ITDM.

XRO:
- CRLs in SA2 fixed by ZZ.

LAS:
- Nothing to report.

UNSYS:
- Nothing to report.

SPB:
- Nothing apart of the detector report.

FXE:
- Thanks to CTRL for addressing BAM issue.

MID:
- Thanks for solving CRL2 issue on Monday.

HED:
- Two-color mode working with nice energies. Investigation source shape from undulators with lenses.

SCS:
- Nothing to report.

SQS:
- Not present.
  302   21 Feb 2022, 11:57 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 21.02.2022
General Announcement:
- Philipp S. says a downtime for the calibration / GPFS update is to be done today at 12:00.
- Raul V. says that the biggest issue of last PRC week was related to the FXE beam pointing. In general, was a quiet and productive week. Please, instrument shall remind to make entries in the operation e-
log.

CTRL:
- In SA3 GATT activity will be performed today (fix to slowness) as beam is down and there is no activity.

DA:
- Announcement will come today: restart GPFS issue / Maxwell to be restarted.

EEE:
- One OCD on Saturday: issue with SDL motors in MID; to be followed up today.

VAC:
- Nothing else apart of the Gatt fix.

XPD:
- Shimadzu camera is installed in XTD6. A test has to be done and organized with instruments. 

DET:
- Nothing to report.

ITDM: 
- Fix to be deployed today: plan is to deploy Maxwell cluster done in the background; it shall not disturb any user of the system. All other storages with login to be done in March and still to be 
confirmed.
- Slow data investigated: get wrong values with time stamp that could be corrected. Further investigation will take place this week.

XRO:
- FXE stability pointing issues on Friday afternoon: Raul V. placed a report in Operation E-log.

LAS:
- Nothing to report.

UNSYS:
- Nothing to report.

SPB:
- Nothing to report.

FXE:
- Pointing issue from Friday;
- In DAQ the BAM device name has changed and could not be used. Please keep the compatibility for names; A. Silenzi will check with CTRL.

MID:
- Motor problems: in touch with CTRL.
- Today morning the CRL2 lenses were retracted but not giving the proper signal. It has been under investigation.
- Issue with DAQ: slow devices were saving empty data (no entries); at least happening with two devices. It has been reported and one is fixed and the second is under investigation.

HED:
- Initial setup this afternoon for the two-color operation.

SCS:
- Not present.

SQS:
- Not present.
  301   16 Feb 2022, 10:42 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 16.02.2022
General Announcement:
- XO launched a new XO Alfresco presence. Please check there for information related to operations and do not hesitate in giving suggestions or raising questions. 
Adam R. asks for the schedule for the PRCs and DRCs. A. Galler says that the PRCs are included in the photon delivery tables. A discussion with Olivier M. on the DRC will take place. 
Naresh K. asks on the status display: it is current a screenshot for the moment the page is loaded. It is not yet a live display.
- A. Galler reminds instruments to make entries to the Operations-2022 E-log to help the PRCs to track down and spot problems.

CTRL:
- Intervention on Monday GATT update: action to be done again next Monday to increase performance.

DA:
- Nothing to report.

EEE:
- Intervention on HED to replace a fast ADC card that lost communication to CPU. Replacement to take place today.

VAC:
- Nothing to report.

XPD:
- A. Koch reports that yesterday the Karabo fast-X was slow.

DET:
- Nothing to report. 
- Olivier M. also observed slow fast-X connection to gateway.

ITDM: 
- Janusz S. says the fast-X issues can be related to an overload yesterday.
- Login to Influx had intermittent connection for a half day yesterday n the afternoon. Investigation being taking place of it relates to fastX.

XRO:
- Nothing to report.

LAS:
- Issues with SA1 PP-laser: overshooting in the CM station. Maintenance this morning is taking place. Current timing is not as good as it could be.

UNSYS:
- Nothing to report.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- All fine at MID.

HED:
- Nothing to report apart of the ADC issue.

SCS:
- All fine at SCS.

SQS:
- SQS shutter issue from yesterday 15.02: problem was solved and it was due to a card misbehaving. 
Zunaira A. says that the problem was with the Lasermet interlocks. Work done in the maintenance affected signals going to radiation protection interlocks. The particular signal was missing and after a fix 
it worked again.
  300   14 Feb 2022, 10:02 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 14.02.2022
General Announcement:
- Thanks to instruments that posted at the Operations-2022 e-log. Please make regular entries that allow PRCs to recognize eventual issues that have to be tracked down.

CTRL:
- Nothing to report.

DA:
- Friday there was issues with Data Aggregators processing in several detectors. DOC found it was an issue with the new version. It was fixed by Saturday by working with a separate routing. 
This was a bug in the new version (time of template creation). A final fix will be installed in a suitable date. 

EEE:
- Nothing to report.

VAC:
- Intervention to solve issue GATT issues is postponed by CTRL (patch work is almost ready). To be discussed between Raul V., CTRL once deployment can be done only on Mondays.

XPD:
- Issue noticed that XGM data were showing missing trains at the start of last week. Tickets were issues and it was cured by end of the week – it affected only one XGM. Reason for missing trains must be 
asked to Theo M.
- SA1 pulse energy was around 4.5mJ; a really good performance.
- Preparing calorimeter in SA1 hutch for experiment.

DET:
- Two OCD calls (one from HED) and one from SPB on a detector. Both fixed by DOC / OCDs.

ITDM: 
- Incident on Saturday with influx DB cluster: happened by 3:00AM; started investigating during the morning. By 14:00-15:00 the cluster came back. Data synchronization is ongoing. Not sure yet if there is 
lost data, under investigation.

XRO:
- Main BKR scene will contain a button to Graphana page.

LAS:
- Working with CTRL on Nagios issues.

UNSYS:
- Nothing to report.

SPB:
- Saturday problem with history of motor position at Karabo: solved by DOC.
- Broken cable for encoder of focusing mirror still has to be fixed (MKB focusing mirror in hutch).

FXE:
- Preparing for the week.

MID:
- All fine at MID.

HED:
- Week went good: successful user experiment.
- Beam was drifting quickly between left/right. Not sure if this is related to the new HED feedback loops. Under investigation.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  299   09 Feb 2022, 10:09 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 09.02.2022
General Announcement:

CTRL:
- GATT broker pile up: there is a fix available but not foreseen to be updated now. The middle layer will be fixed in cw09 (blue week). This will be coordinated with XO. 
- Raul V. completes that 1. slowness of the GATT from last week can be fixed next Monday (which triggers a pile up); 2. More invasive changes mentioned by Wajid E. to be done in a later point. 
- Wajid E. adds that if problems appear again (unresponsive middle layer), please call DOC.

DA:
- Nothing to report.

EEE:
- Finishing smaller tasks.
- Fast ADC issue is taken over by the fast electronics team. The cooling issue may be related to connection problems with the board. EEE monitors if last Monday fix was enough. 

VAC:
- Nothing else apart of the GATT discussion.

XPD:
- XGM issue in XTD2: someone changes the settings leading to an overload in the XGM. A. Galler says that BKR operators did not touch it and one still looks to find who triggered the changes.
- Calorimeter and laser polarimeter to be installed at FXE on next days.
- A. Koch says there was an update of the DAQ in tunnels; that was tested on Monday afternoon and if problems are found, please contact A. Koch.

DET:
- Nothing to report.

ITDM: 
- Nothing to report apart from ground floor room 604 work. 

XRO:
- XRO contact control integrations to work on motor layer devices for March.

LAS:
- Nagios Karabo system still do not work.

UNSYS:
- Nothing apart of the smaller gap limitation in SA2 system for the 2-color test last Monday.

SPB:
- Nothing to report.

FXE:
- Hiccup with train-IDs not being synchronized: a ticket was sent to CTRL.

MID:
- All fine at MID.

HED:
- Not present.

SCS:
- Issues with middle layer devices that had to be restarted: Laurent M. will check on the status with SCS colleagues.

SQS:
- Issue with XTD10 PES digitizer: there is an open ticket in progress.
- Trigger of hutch shutter last week: the loose maglock has been addressed.
  298   07 Feb 2022, 10:56 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 07.02.2022
General Announcement:
-  Power glitch on Sunday morning at around 04:00AM seems to have no effect at machine or Schenefeld site.

CTRL:
- During winter shutdown the bunch arrival monitor was updated. An e-mail will be sent reflecting the changes.
DA:
- Single OCD call was solved: configuration of train match bridge to eXtra foam.

EEE:
- Two tickets from MID shall be followed this week.
- Tickets from DOC on SQS (solved) and PES (to be fixed by DA).

VAC:
- All fine with VAC.

XPD:
- All fine with Diagnostics.

DET:
- Nothing to report.

ITDM: 
- Wednesday there will be shutdown of rack room in ground floor (604): details were sent by e-mail and there were no concerns/feedback from potentially affected people.

XRO:
- Nothing to report.

LAS:
- All 3 PP-lasers are stable and will be available by the end of the day.

UNSYS:
- Issue FRI/SAT: bad communication between balcony and SASE1 cells. It is solved but being further investigated.
- This morning there was a BKR request to go lower undulator gaps in SA2: gap can go as lower to 10.61mm.

SPB:
- Commissioning of AGIPD done; successful week.

FXE:
- Preparing the beamline; ready for beamtime.

MID:
- Issue with RF window: it was too short when they received the beam. Solved by PRC and instruments for fast solution.
- EEE had to solve an issue.
- Cameras in the tunnel monochromator may need a ZZ. This afternoon VAC will join for a ZZ and fix it.
- Week was successful.

HED:
- Quite successful beam usage last week.
- Issues with fast ADC devices not working until Wednesday. It worked for 24hs and then had to be restarted again and came out with wrong settings. 
This needs further investigation and is needed for users this week. CTRL will follow up.

SCS:
- Preparing with UAC from tomorrow.

SQS:
- Safety problem with magnet interlock in one door: a loose screw was fixed (for the time beam).
- Issue with digitizer: SQS will clarify with CTRL.
- Recheck calibration of monochromator (needs cameras looking to the motor): it seems that the camera has to be discussed with XRO. 
Martin D. says that currently Maurizio V. is in the tunnel and SQS shall contact for the possibility of a quick fix now.
- Zunaira A. says that if beam shutter closes without apparent reason: it can be related to emergency off, panic switch, air box or the maglock. It happens 3 times on the same day. If this happens again, 
it may trip the entire accelerator. 
People in safety group or laser interlock are responsible for fixing the maglocks. A. Galler asks Zunaira A. to send an e-mail to xo-info@xfel.eu. 
Alberto Defanis says that Eric B. has fixed. Zunaira comments that this fix was momentarily for the weekend. Further discussion will follow.
  297   02 Feb 2022, 08:39 Andreas GallerGeneralInformationNotes XO Integration Meeting 02.02.2022

General Announcement:

  •  

CTRL:

  • observation from DOC
    • macros some times after the upgrade to Python 3.8 --> please contact CTRL?

DA:

  • significant upgrade to Offline Analysis -->
    • proc data won't inlcude a copy of raw data any longer

EEE:

  • fast electronics

VAC:

  • no issues

XPD:

  • no incidents
    • 2 tunnel accesses on Monday --> succesful

DET:

  • DET commissioning at SPB (AGIPD JUNGFRAU 1M), MID (AGIPD), HED (ePIX, JUNGFRAU)

ITDM:

  • E0.604 rack room, Wed next week
    • fixing power distribution units in every rack --> TS and external company will need a full day
    • affected services are: Lab DAQ, LAB control servers (EEE; CTRL, DET), GitLab runners, one machine for data analysis, PLC database, karabo project database (?)
  • Yesterday short interruption with influx reading note --> test requested for next Monday causing a 1 hour interruption

XRO:

  • SA1 / SA2 M3 PBLMs have been equipped with diamond plates and can be used for beam stability measurements
  • Backlash Controls implemented last week --> values
  • report of lost positions of vertical slit in SA3
    • in case of similar issues please contact DOC prior to self fixing.

LAS:

  • SA2 PPL is good
  • SA3 PPL planned to be up today
  • SA1 PPL being investigated as agreed with SA1 instruments

UNSYS: 

  • transparency test  for APPLE X went successful

SPB/SFX:

  • SPB/SFX aligned since yesterday, no issues

FXE:

  • blown fuses in crates --> solved with EEE

MID:

  • all fine

HED:

  • Com yesterday
    • outstanding issue: fastADC not working EEE aware of that

SCS:

  •  

SQS:

  • GATT always worked but very slowly responding
    • OCD contacted
    • Raul comments that this is a known issue and should be communicated to CTRL
    • SH nesures that Raul creates the ticket
  • XTD10_PES
    • digitizer display frozen almost all time (connected to 2 DAQs) --> reported to DOC
    • SH comments that when connecting to two DAQs (tunnel and SQS), should be connected to only one DAQ.

  296   31 Jan 2022, 10:03 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 31.01.2022
General Announcement:
-  On this current run, beam delivery to instruments will start on Tuesday at 07:00AM.

CTRL:
- New version of DeviceClone and Doocsml device will be updated today which contains a bug fix;
- Minor update on Karabo framework version on the datalogger machines will be performed today
- CTRL will proceed with the update today at 13:00 if they didn't hear any objection till 12:00. Intervention will not take longer than half an hour. No need to check afterwards.

DA:
- Nothing to report.

EEE:
- Nothing to report.

VAC:
- Notification on power interruptions on the weekend: it seems to have no impact but please check the systems.
- Zunaira A. says the AIBS looses connections to network during glitches and has to be restarted if not masked. She will take a look.

XPD:
- Nothing to report.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- No big issues during the weekend; smaller ones were solved.

LAS:
- SA2 PP-laser is ON;
- SA3 PP-laser will need tomorrow to fix final things.
- SA1 PP-laser: LAS has negotiated with instruments to further investigate more.

UNSYS:
- SA1 issue on Saturday: problem with CPU;
- Ongoing tests with Apple-X this morning.

SPB:
- Aligning instrument to take beam tomorrow.

FXE:
- Nothing to report.

MID:
- All fine at MID.
- MID did not look yet in the PP-laser but will do so tomorrow or Wednesday.

HED:
- Waiting for DAQ rollout. In contact already with DA.
- Zunaira A. reminds on the reply for scheduling the hutch search training. HED will inform after their afternoon group meeting.

SCS:
- Nothing to report. SCS will also make a schedule and will contact Zunaira A.

SQS:
- Nothing to report.
  295   26 Jan 2022, 10:46 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 26.01.2021
General Announcement:
- The cold compressor failed this morning and beam operation is currently stopped. We expect the beam operation for the alignment of beam systems will resume tomorrow morning (Thursday).

CTRL:
- Nothing to report.

DA:
- Nothing to report.

EEE:
- Closing last tasks for the maintenance.

VAC:
- All fine.

XPD:
- Issues with PES were solved by CTRL.
- Jan G. asks when beam would be aligned to M1 and M2 in SA1 and SA2? (see XRO report).

DET:
- Nothing to report.

ITDM: 
- Work ongoing with company regarding Monday's report on offline storage system.
- Jan asks for the DAQ Karabo test with XPD. Janusz S. suggested to contact Partha who is on charge for this.

XRO:
- Ahead of schedule with alignment until this morning: SA1 and SA2 beam established in all experiments. SA1 beam on mirror but it needs to finish Bender calibration (nice beam at the end of the SA1 
tunnel).
- Currently cryo is down and pushes back next days plans: Today planned schedule of tuning 17.2 keV in SA1 as well as Apple-X in SA3 is shifted to tomorrow. 
If beam comes tomorrow morning SA2 is available for alignment. By end of the week one starts with SA3.

LAS:
- SA2 almost ready: it shall be finished by end of the day.
- SA3 Amphos maintenance is finished: maybe ready end of the week or start next week.
- SA1 is making progress: 1.1MHz operation shall be OK but 280kHz can be have some difficulties.

UNSYS:
- Power failure in SA1 central control node prevented communication to undulators during the evening. It was solved after power cycle.

SPB:
- Busy with aligning beamline.

FXE:
- Same as SPB; nothing else to report.

MID:
- All fine.

HED:
- Not present.

SCS:
- All fine.

SQS:
- Nothing to report.
  294   24 Jan 2022, 11:18 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 24.01.2022
General Announcement:
- Steffen H. states DOC starts in special operation mode 09:00-17:00 for the weekdays. Jour-fixe also starts today at 13:00. Instruments are welcome to join.
- Regarding DATA OCD numbers, DRC started last Saturday: it did not work in some cases: please do not call directly any other OCD number, just the DOC or DRC number;
- Over the weekend an issue the bunch number pattern happened. It is ongoing and has to be tested.

CTRL:
- Nothing to report.

DA:
- Tomorrow DA members are in satellite workshop of their group.

EEE:
- Two OCD calls for ELMO drivers which lost configurations: solved.

VAC:
- No issues. 

XPD:
- Commissioning work during the weekend on SA3 tunnel (mainly): bunch pattern could not be changed in any SASE.
- Tickets were sent and people responded promptly.
- One MPOD crate was in error in SA3: a power cycle in XTD10 was done (helped by XRO) yesterday night and fixed.
- Commissioning of Imagers, PES in SASE3; hard X-ray PES in SA1 (missing some DAQ) started; MCP-detector; and Shimadzu in SA2.

DET:
- Nothing to report.

ITDM: 
- Relating to last Wednesday maintenance: a re-cabling at Desy side occurs and after that it observed unstable behaviors on the network. 
Maybe today or tomorrow one needs to make some tests leading to a break of GPFS operation (short interruption of migrating data from online to offline).

XRO:
- SA3 proceeding well and for SQS several mirror positions are saved.
- On Sunday there was a problem preventing to complete the SCS (control issues of translation stages of pre-mirrors). It was solved but happened a couple of times. 
Please experiments in SASE3 be aware that current translation stages positions may differ by 1mm. 
- XRO implemented two-steps backlash corrections in SA3 (as done before in SA1): to solve the different positions after moving mirror. 
Maurizio V. informs that instruments shall not be surprised if the motor overshoot and then return to correct position.
- SA2 beam transport: SRA calibrated; beam arriving to HED Pop-in instrument; PBLM was commissioned.
- SA1: starts today. This week focus goes to SA1 and SA2 realignment after the SESP interlock tests.

LAS:
- SA2 PP-laser: issues with ADQ card and smarAct: with help from EEE and CTRL, is fine now.
- SA3 PP-laser: AMPHOS maintenance this week; it shall be ready for user run.
- SA1 PP-laser: updating this one; LAS is working hard.

UNSYS:
- Beam trough in SA3; Working to correct some kicks in Apple-X.
- BKR requested to give a feedback that system is giving signals to BKR. Working on it.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- Not present.

HED:
- All fine.

SCS:
- Not present.

SQS:
- Nothing to report.
  293   19 Jan 2022, 11:00 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 19.01.2022
General Announcement:
- Machine status: SA2 is currently lasing @ 9keV and 2.5mJ. North Branch was closed yesterday and after a quick ZZ in XTD10 this morning the BBA and tuning will resume today and tomorrow.
- X-ray delivery tables for cw05 have been sent to the instruments and we thank to all that have already sent us a feedback.
- DOC will start next Monday. From MON-FRI from 9Am to 5PM. For the next weekend the photon staff in shift work shall send a ticket or only in case of urgent/critical matters call the DRC phone. The PLCs 
are providing OCDs.

CTRL:
- Bassler cameras were migrated to Aravis library.

DA:
- Nothing to report.

EEE:
- ZZ is ongoing to check a faulty switch signal in XTD10.

VAC:
- Benoit R. is currently in the tunnel on the ZZ;
- VAC systems are all fine and ready to take beam.

XPD:
- Aravis library installed and tested; all went fine.
- XTD6 ongoing tasks are under progress and may be finished already at the end of the day. If progress is made accordingly to the plan, XTD6 can be closed tomorrow. 
The new M-port crate was connected yesterday (upgrade of MCP). Almost all is finished; Wolfgang F. finishes small things.

DET:
- Nothing to report.

ITDM: 
- Offline storage system update scheduled for today (Dcache affected). E-mail will be send when finished by end of the day.

XRO:
- Nothing to report; all maintenance activities completed.

LAS:
- As aftermath of cooling water and air conditioning issues during maintenance: problems with misalignment of all lasers; LAS has troubles to align them.
- For SA2, LAS is confident will be fine with alignment. The SA3 is a bit behind of SA2;
- SA1 presents the biggest misalignment after T and H shock - long pump pulse. The 280kHz test is now in secondary priority. LAS will report day-by-day and is not so confident will be ready for instruments 
in February.

UNSYS:
- Finished to install air coils in Apple-X.
- SA2 phase shifter solved.

SPB:
- Nothing to report.

FXE:
- Interlock issues were fixed.

MID:
- All fine at MID.

HED:
- All fine at HED.

SCS:
- Nothing to report.

SQS:
- All good at SQS.
  292   17 Jan 2022, 10:41 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 17.01.2022
General Announcement:
- SEPS interlock tests are scheduled for this Friday January 21st; Zunaira A. needs XTD6 closed by the SEPS interlock at 09:00. 
Martin D. will evaluate if it is possible to close XTD6 before Friday pending to finish the work (without closed vacuum we won't have beam in future).
- Machine is tuning SA1 and SA3 this week and XTD2/4 tunnels are opening today and tomorrow for finishing Apple-X works.

CTRL:
- Nothing to report.

DA:
- Preparing for start of operation; nothing out of ordinary.

EEE:
- Nothing to report.

VAC:
- Vacuum all is fine.
- Tunnels closures: XTD9 tomorrow afternoon; XTD6 on Friday or Thursday afternoon (see general announcement).

XPD:

- Camera library tests/migration together with CTRL (Aravis library) from today afternoon. Some cameras won't work for the update (5mins or bit more). 
Plan is to do all cameras - please keep in touch with A. Koch if cameras are needed.

DET:
- Nothing major to report: preparing detectors for start of the run.

ITDM: 
- Reminder on the storage system (offline side) update on 19.01: dcache won't be available for the whole day; connection between online and offline won't work also. An e-mail will be sent when activity I 
done.

XRO:
- Next week it starts the photon beamline alignment. Next Friday one needs the SCS or SQS hutch interlocked over the weekend.

LAS:
- Nothing to report.

UNSYS:
- Issue with phase shifter in SA2: BKR forgot to use the right operation mode. 
- Apple-X: waiting to enter tunnel today at 12:00 to install air coils and finalize hardware commissioning.

SPB:
- Controller was affected by power glitch; fix ongoing.

FXE:
- Interlock system problem was detected and under fix.

MID:
- All fine at MID.

HED:
- Nothing to report.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  291   12 Jan 2022, 10:06 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 12.01.2022
General Announcement:
- SEPS interlock tests are scheduled for January 21st: starting early morning from 08:00 to 16:00 across all the SASEs; 
In parallel D-3 tests the interlocks in all hutches including SXP. An e-mail to instruments was sent and a reply has to be directed to Zunaira A.
- Disabling SEPS interlock yesterday night was not necessary. Further discussion with A. Galler will follow.

CTRL:
- No planned updates.

DA:
- No updates to report.

EEE:
- Yesterday the SA1 vacuum update took place.
- MPS contacted Nerea J. on the SEPS interlocks issue: Nerea J. to be included in further discussions.

VAC:
- Nothing to report.

XPD:
- Preparing for tunnel closure: finishing Hard X-ray PES tests; works in XTD9 are completed.
- Works in XTD6 finishing EPS switches and installing upgrade M-ports in MCP (crate coming on Thursday and update interlock connection).

DET:
- Nothing to report.

ITDM: 
- Remind on the Wednesday maintenance on the dCache and GPFS; Access to XFEL related data from Maxwell compute cluster is not guaranteed during the intervention. Please contact ITDM in case of conflicting 
with it.

XRO:
- Not present.

LAS:
- Failed to upgrade the SASE1 front ends during Winter Maintenance (company did not come due to Corona regulations). 
- 8D report for the Seeder shutdown issue at the start of the maintenance period: A. Galler informs that by the end of this week it shall be ready and distributed.
- Power supply connection: Max L. asks for XO support to follow up with TS.

UNSYS:
- Apple-X undulators are aligned and currently the intersection is being aligned together with air coils. Vacuum shall also be connected permitting to close tunnel tomorrow.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- Thanks to SPB group for helping with providing a flange.

HED:
- Apart from the SEPS all is fine.

SCS:
- Not present.

SQS:
- All fine.
  290   10 Jan 2022, 09:22 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 10.01.2022
General Announcement:
- The "Readiness" mailing list will be discontinued and substituted by the "xo-info@xfel.eu" list. This new list is owned by XO and please use it in future for sharing information to a broad audience.
- Next News on the Covid regulations will be communicated on Wednesday 12.01 or for the next Thursday's staff meeting.
- Please take attention to Zunaira A. e-mail on the radiation safety training. It shall be done until the end of January to avoid disruption in access rights.

CTRL:
- No major updates.

DA:
- Nothing to report.

EEE:
- SASE1 VAC loop will be update tomorrow including the PES system.

VAC:
- No issues to report. Continuing with small tasks being done at XTD2 and XTD6.

XPD:
- All continued tasks are fine, mainly XTD2, XTD6 and XTD9.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- Carry on with maintenance works - SASE1 and SASE2 are in vacuum;
- XTD6 PBLM diamond to be exchanged this week as well as screens.

LAS:
- Not present.

UNSYS:
- Alignment for the Apple-X to be done this week and vacuum will be closed until Thursday.

SPB:
- Small issues with things moved into new racks; being followed with EEE.

FXE:
- Continuing with tasks.

MID:
- MID looks for a CL flange with SmartAct connection. Please contact MID or Joerg H. if you have one to help MID.

HED:
- All fine at HED.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  289   05 Jan 2022, 09:29 Andreas GallerGeneralInformationNotes XO Integration Meeting 05.01.2022

General Announcement:

  •  

CTRL:

  • no major updates

DA:

  • no major updates

EEE:

  • 1 MID plC dead
    • replaced on Monday
  • cable work planned for next week
    • HED, SXP

VAC:

  • In general excellent progress
  • closing of M2 XTD2 (SA1) in progress, sealing issues mitigated

XPD:

  • XTD10, XTD6
    • improvements, commissioning ongoing
  • clean room tent water leak reported on 23.12.
    • fixed by TS befroe X-Mas

DET:

  • no major issues

ITDM:

  • Jan 19: dCachce maintenance

XRO:

  • progress as planned
  • changes to existing components will be posted to respective elogs

LAS:

  •  

UNSYS: 

  • progress as planned

SPB/SFX:

  • Vac monitoring recoverd

FXE:

  •  

MID:

  • PLC outage on Jan 1 st caused VAC issues (reported by EEE)
    • fixed
  • no access to MID optics hutch due to interlock test

HED:

  • everything on schedule
  • leak on a hose to humidifier device in A12. This leaked a few litres on the floor.
    • to be fixed by Caverion

SCS:

  • progress as planned

SQS:

  • progress as planned
  288   20 Dec 2021, 09:25 Andreas GallerGeneralInformationNotes XO integration meeting 20.12.2021

General Announcement:

  •  

CTRL:

  • no update

DA:

  • nothing

EEE:

  • nothing

VAC:

  • nothing to report

XPD:

  • nothing special, shtudown tasks are in schedule, HXPES / XTED2 cable work ongoing

DET:

  • nothing special

ITDM:

  •  

XRO:

  •  

LAS:

  • lasers ramped down

UNSYS: 

  • APPLEXv inv place, VAC to be closed next year

SPB/SFX:

  • working on mirrors
    • checking vacuum today
  • not clear what is the status with the movement of racks wrt SXP (SPB/SFX optics hutch racks currently powered down)
    • electrical installation?
    • PG comments: Brad won't allow operation until 230 V power distribution is calrified, once Brad gives the OK, the racks can be switched on
      racks are being finalized by EEE, but some checks need electrical power
    • RB: SPB/SFX were promised that the move of the racks were finished before X-Mas, but it seems the electrical work is not up to satandards

FXE:

  • shutdown task in schedule

MID:

  • all fine
    • some loop updates planned for Today

HED:

  •  

SCS:

  •  

SQS:

  • nothing

AOB:

  • light OCD over X-Mas for XPD in case of floowings, power outages.lists will be

  287   15 Dec 2021, 10:26 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 15.12.2021
General Announcement:
- Severe power cut affected Schenefeld campus yesterday: it seems to be associated to human error but investigations are still ongoing. As soon as information will be available, it will be distributed via 
e-mail either from TS or from XO.
- Regarding access regulations coming into effect Thursday evening (16.12): those who shared vaccination status with SRP will be able to enter via side gates or without showing vaccination certificates to 
the gate keepers. 
Without showing to SRP one can enter only via the main gate.

CTRL:
- Due to power cut some devices went to error state; a bunch reset helped to bring them up. If errors appear again please write tickets to CTRL.

DA:
- Nothing to report.

EEE:
- Issues with power cut: lost electronics in instruments; lost parts in tunnels (but recovered). Please check systems if they need to be reset.
- XGM in SA1 and SA3 were also affected.
- uTCAs are back and running after power cut.
- Work with cabling is ongoing accordingly to the maintenance planning.

VAC:
- PLC in rack room were affected and recovered with help from CTRL and EEE. So far nothing severe seems to be appeared but investigations still ongoing.

XPD:
- XGM is under investigation by Theo M.
- HIREX in SA1 has a motor not moving. Today on-site investigation will be done together with Bernard B,

DET:
- Nothing to report.

ITDM: 
- Power cut: problems with office switches had to be rebooted/recovered. It got stuck during the reboot process causing problems that switches had to be manually power cycled (maybe due to a second short 
power failure).

XRO:
- Nothing to report.

LAS:
- Affected by power cut; PLCs were off but running again after help from EEE.
- Seeder seems to do not suffer major issues.

UNSYS:
- Problems with electricity at XHU due to power outage were recovered later in the afternoon.
- Two Apple-X undulators were installed in SA3 yesterday.

SPB:
- Could recover the essential systems quickly enough; no big damages so far.

FXE:
- Working in tunnel this morning. Investigations related to the power outage ongoing.

MID:
- Issues were recovered with EEE.

HED:
- Could recover vacuum systems; Laser systems were turned OFF.
- SA2 gas alarm controller was damaged due to the power outage. So there is no operation with liquid nitrogen and other gases from now. TS need to discuss with HED as tasks must be performed by latest mid-
January (lasers and/or cryo activities).

SCS:
- Not present.

SQS:
- Damage in the air conditioning (electronic and physical) in room 509 due to the power outage. To be discussed between SQS and TS.
  286   13 Dec 2021, 10:51 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 13.12.2021
General Announcement:
- The cooling water various types shall be working/restored and it seems that temperatures are back to normal. In case of finding deviations in temperatures let TS or XO know. Racks and racks rooms can in 
principle be closed.
- Tobias H. comments on the open rack doors: in general if racks have to be opened, please keep in mind the corridors in between the labs are fire safety doors and this has to be discussed with SRP or 
Michael Prollius prior taking place. 
The comment serves as a precaution for the future.
- An e-mail from SRP will be sent concerning disclosing the vaccination status and registration at the entrance gate.

CTRL:
- Upgrade/migration of all tunnel cameras to Aravis was concluded in tunnels.

DA:
- Nothing to report.

EEE:
- All runs smoothly at the moment.

VAC:
- Maintenance activities going accordingly with the plan.

XPD:
- Proceeding with shutdown tasks. Today alignment activities and vacuum activities at XTD2.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- This week resume the work in lab after restoring cooling water.
- XRO reminds the need to resume discussion with the ramp-up activities to divide commissioning days - a plan has to be done due to the high number of updated devices. 
A date for recommissioning of these devices shall be fixed. XO will discuss with XRO.

LAS:
- Restarting the lasers and proceeding maintenance.

UNSYS:
- Plan to install Apple-X from today on.

SPB:
- Installing granites in experimental hutch.
- Intervention in optics hutch today: please refrain to access it for staff other than the ones performing task.

FXE:
- Access XTD2 to check CRL; commissioning motors in hutch.

MID:
- All fine at MID.

HED:
- Laser interlock upgrade last week was successful with Klaus Witt.

SCS:
- Activities are going accordingly to the plan.

SQS:
- Nothing to report.
ELOG V3.1.4-7c3fd00