Group Selection Page HELP Controls Group Data Analysis Group ITDM WP76 DET Vacuum EEE WP78 FXE SPB HED SQS SXP Sample Environment Operation PSPO XO TS Migrated2Zulip
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Technical integration and coordination logbook, Contact: A. Violante, G. Wellenreuther, Page 20 of 32  Not logged in ELOG logo
ID Date Author Location Severity Subject
  251   16 Aug 2021, 10:07 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 16.08.2021
General Announcement:
- On frequent power glitches: it happened twice over the weekend. Machine was not affected and maybe this time the PP-lasers also. The origin is on the electrical power grid of Vatenfall and it is unclear 
how long it takes to fix it.
- TS requires location knowledge of all office chairs. In case you have taken yours to home, please let TS know.

CTRL:
- Reports from DOC with delayed train of DOOCS XGM for HED. It will be investigated.
- Reminder that it is a blue week and the DOC does not run. The DRC is available via phone.

DA:
- Issues with the offline calibration system: changes of data migration (how it works). Hot fixes are ready to be deployed (probably today); please check the migration and the auto-run; DA will update 
after the deployment.

EEE:
- Nothing to report.

VAC:
- No problems with power glitches.

XPD:
- XPD side: all fine.
- As PRC, Jan G. says that pump-probe laser at FXE was affected on Friday morning (Laser unavailable until the night). On Saturday and Sunday the lasers were not affected due to the power glitches.

DET:
- Nothing to report.

ITDM: 
- Gitlab update taking place this week.

XRO:
- Not present.

LAS:
- None of the PP-lasers went down this weekend in relation to the power glitches.

UNSYS:
- Nothing to report.

SPB:
- Adrian M. asks that, in case supply problems continue to happen, would that mean EuXFEL makes proactive action for operations? 
A. Galler comments that DOB will discuss the issue with lasers (exchange of pumps that are vulnerable to the power glitches is planned for the winter shutdown). From machine side, as it is largely 
unaffected, the operations calendar won't change.

FXE:
- Nothing to add, no news on clock and control upgrade.

MID:
- All fine at MID.

HED:
- Not present.

SCS:
- Nothing to report.

SQS:
- Dismount the DSSC and give back to SCS this week. 
- SQS expect beam for the safety tests on Wednesday and Thursday.
  250   11 Aug 2021, 10:45 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 11.08.2021
General Announcement:
- There was another power glitch last night. It seems that accelerator was not affected. If XFEL groups find affected devices, please contact XO.
- From healthy task force the Covid-19 measures stay in place as they are.

CTRL:
- Nothing major to report.

DA:
- Nothing to report.

EEE:
- Nothing to report.

VAC:
- Nothing to report.

XPD:
- Running at SA3 at the edge of the energy range (3keV is at limit of the undulator tables (K near 4)). Sara C. says that with higher electron beam energy this won't be a problem. 
In addition, the problem was with only few cells and Suren A. is in contact with BKR. Jan G. says that will get in touch with Suren A.
- HED reported problems with beam pointing being instable. XPD and XRO will take a look on it and include XO for the analysis.

DET:
- Small hiccups but nothing major. Follow-up on the pipeline for DSSC and firmware for other detectors.
- Jolanta S.-D. is not aware of LPD/FXE update and will check with EEE/CTRL/FXE.

ITDM: 
- Announcement: ITDM would like to upgrade GitLab on next Wednesday 18.08 from early afternoon 13:00 and may take until the evening. Users of GitLab are contacted and no access to GitLab during that 
action.

XRO:
- Nothing to report. Maurizio V. will follow the HED beam instability.

LAS:
- Affected by power glitch: all PP-lasers / AMPHOS went down and warmed. LAS would need a solution for power glitches, considering power backups, UPS or batteries, as the controllers for this type of the 
pump goes down. 
- Jan G. says that XPD has a bunch of unused UPS and could offer to LAS.

UNSYS:
- Problem with cell6#SA3 quad mover is solved. Coupler was exchanged and it works. UNSYS has more spare parts and is in touch with Beckhoff.
- Sara C. says P. Gessler informed Karen had problem when changing undulator energies. Suren A. could not find any issue with Doocs / Unsys side. 
Patrick G. talked to Olaf H. and firstly BKR must try to change energies and if it works, then instruments shall try. Karen A. says BKR could moved energy and had no issues - the issue was in HED side. 
P. Gessler proposes that Unsys check with Olaf H. Further discussion will follow offline.

SPB:
- Couple of issues: 1. SBP Pop-in reached limit switch and had to be changed; 2. Affected by the PP-laser downtime overnight.
- A. Koch says there was about 0.5mm steps lost. He is looking into it if it is mechanical, motor, or control issue.

FXE:
- Wajid E. says work on the clock and control is ongoing for the LPD.

MID:
- Al fine and use of PP-laser is not needed currently.

HED:
- Nothing else to report besides of what was discussed during Unsys report.

SCS:
- Not present.

SQS:
- Not present.
  249   09 Aug 2021, 10:26 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 09.08.2021
General Announcement:
- XO reminds that the timing system maintenance is taking place now.
- Power glitch happened at around 5:15AM today. Accelerator had a downtime; please check components that use cooling water / pumps to check if they were affected or not.
- Liubov S. reported that the PRC phone could not be started and maybe calls were not answered.

CTRL:
- Follow-up on the timing downtime maintenance: CTRL advices instruments to please check DAQ afterwards. 
- Bug reports for cameras - 1. For Lima Cameras updated for new Karabo 2.1: new library has new features on rotation (a fix can be deployed); 2. Rotation in non-instantiated cameras won't work: one has to 
instantiate them initially.

DA:
- Nothing to report.

EEE:
- Downgrading clocking and control firmware today after this meeting. For questions please talk to Bruno F.

VAC:
- Power glitch propagated to the tunnel (shortage of cooling water) but it did not affect VAC systems 
(update 10:30AM: GATT-SA3 injection of gas stopped due to the water shortage being above 5-10seconds but less than 30s, as pumps continue running - SCS could set it up again quickly). 
- GATT loop: Steffen H. and Raul V. are setting up update and please refrain to use it today.

XPD:
- Issue with XGM in SCS hutch: it got shock vented with N2 last week. Fortunately, high voltage was not ON. Turbo pumps have issues with controller; on Thursday and Sunday the pressure gauge dismounted. 
XPD is on contact with SCS on it. 
Remark: Theo M. is on holidays and for XGM issues please contact Jan G.
- A. Koch asks Steffen H. if the Lima/Bassler camera fixes uses only DAQ and not GUI. Steffen H. says this is correct and for Karabo 2.11 only. A. Koch will send a list of cameras to Steffen H. 

DET:
- Nothing to report. DET aware of clock control downgrade.

ITDM: 
- Today afternoon ITDM starts activities in Influx: downtime of few minutes.
- Reminder on closing proposals: Please do it ASAP. If not done by next week a policy on non-accessed data will be done.

XRO:
- Nothing to report.

LAS:
- The cooling water for SA1 and SA3 AMPHOS went down on Saturday morning, bringing PP-lasers - due to another power glitch on SAT early morning. 
- Cooling water in the LAS R&Dlab remains down as of now.
- PP-Lasers will come up this afternoon but requires time to thermalize. It was put OFF in a controlled way this morning due to the timing system maintenance. The AMPHOS was not OFF during today's power 
glitch.

UNSYS:
- Issue with cell6/SA3: power cycle of whole cell is ongoing. Suren K. asks if a possibility to go to tunnel can be done. ZZ is not yet requested but will contact PRC to fix the coupler.

SPB:
- Complications with the delivered bunch pattern last week: coincidence of needing to drop bunches for detectors commissioning at same time SCS use particular bunch pattern. 
Nevertheless, it worked well enough for getting data, apart of few lost time to set the pattern.

FXE:
- Nothing to report.

MID:
- All fine at MID.

HED:
- Nothing to report.

SCS:
- Not present.

SQS:
- All good at SQS.
  248   04 Aug 2021, 10:19 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 04.08.2021
General Announcement:
- There was a power glitch last night around 10:30PM at the Desy power distribution. XHQ and XHEXP1 seemed to be not affected - probably devices that gets cooling water from Desy could be affected. 
Please inform XO if it is found any affected equipment in the XHEXP1 side.
- Raul V. asks on the fix CTRLs has applied to the vacuum issues last week. Steffen H. will give details offline.

CTRL:
- Bi-directions of clones may not have been working properly and CTRL is investigating and preparing a solution for it. 

DA:
- Nothing to report.

EEE:
- Small issue with FXE timing (strange behavior of RTMs). It happens when communication to main timing system is interrupted and it affects mainly the FXE PLCs. Result is that devices may not correct 
trigger.
- Cable installation currently ongoing in HED and scheduled at FXE (cw33). 

VAC:
- Last night status of critical pumps was checked and seems that there was not water interruptions (very first time for a power glitch). These pumps stay working normally during the night.

XPD:
- No issues to report due to the power glitch.

DET:
- Jungfrau activities at SPB were delayed because of beam delivery issues with the number of bunches.

ITDM: 
- Nothing to report, also regarding to the power glitch.

XRO:
- Not present.

LAS:
- Unaffected from the power glitch. PP-Lasers are working.

UNSYS:
- Everything is fine with Undualtors.
- SA3/cell6 quad mover has a problem unrelated to the power glitch. As agreed with BKR, it stays as it is Monday when corrective actions to recover it will be made.

SPB:
- Beam delivery problems yesterday regarding the bunch number: A. Galler says that accordingly to W. Decking, when running in interleaved mode it may cause that problem if the suppressions does not work 
correctly. 
Further investigations are under way by MXL. If this is an issue for equipment BKR can install an interlock on the Big Brother and probably a detailed discussion with interleaved mode instruments can help 
in this direction.

FXE:
- Nothing to add.

MID:
- Looks like the beam today is very unstable. Data were collected and the stability task force will be contacted.

HED:
- Nothing to report.

SCS:
- Not present.

SQS:
- Yesterday a situation happens when 1 PLC went OFF unintentionally, causing a pump went OFF afterwards. SQS asks if this can be followed in a way the pump does not goes OFF in such events. 
Raul V. comments that 5Hz turbopumps at the tunnel have a configuration to prevent it by disabling the automatic switch in the component configuration. 
Nerea J. says that they can take both tunnels and SQS used configurations to bring them together. 
  247   02 Aug 2021, 12:06 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 02.08.2021
General Announcement:
-	 

CTRL:
- Deployment announcement: there are two more motors to be updated on ARAVIS cameras (photonic and Bassler). CTRL proposes to do this afternoon. 
Cameras devices will be down after update, aimed to enable train-ID corrections. Please instruments check on Tuesday if cameras are back.

DA:
- Nothing to report.

EEE:
- uTCA CPU in SA1 balcony room is not reachable. Bruno F. is investigating.
- CPU of LOOP16-SQS is not reachable. Nerea J. will check it today.
- Issues with LPD and AGIPD are being tested in the lab and the check at FXE will be done later today.

VAC:
- Some OCD calls related to instability of SA3 vacuum loop. DOC is informed and shall be working on that.

ME:
- Alberto De Fanis asked if ME is present, willing to discuss topics. A. Galler says group was around a couple of times and if groups have questions please use this meeting series to address.

XPD:
- No issue to report.
- Steffen H. will check if some XPD tunnel devices are affected by the ARAVIS update.

DET:
- Nothing to report.

ITDM: 
- Influx problem on Thursday (disabling live-view on Karabo): with help of Influx data support this was fixed. The cluster is up and running well. 
The part of the old data during the time it was down was written by Grafana and will be synchronized back to the cluster during this week (tests are needed).
- Following on Friday for the Influx third node that went down (not related to the previous incident): DOC was blind for a couple of hours. Investigation ongoing. It's not related to Grafana. 
Instruments were not affected.
- Reminder of reviewing and closing proposals for the second half of this year. Please look at the sent e-mail and make a cleanup. 

XRO:
- Not present.

LAS:
- All PP-lasers are running.

UNSYS:
- Issue with phase shifter in SA3 for the 3keV use: problem is that at 14 GeV the tables of phase shifters go to 25.3mm gap and this is in the upper limit for making 3 keV. 
Phase shifter tables will be extended to a larger gap. Better to use 3keV at higher electron energies.
- For the UOM's mention on the update of phase shifters on the chicanes, this has to be prioritized. XO will discuss with Sara C.

SPB:
- Minor issues with SPB imager being saturated. A. Koch adds that it will be followed up and he is aware and will analyze better.
- Organization limitation: RF discussion for last weekend. The BKR / Operators were not aware they would use 404 bunches and costed 2 hours.

FXE:
- Nothing to report.

MID:
- All fine at MID.
- Laser went down for 12 hours due to the issues with HED interlocks on Wednesday (action taken due to the restart of laser interlock performed by SRP).

HED:
- Not present.

SCS:
- Issue on the scanning speed of monochromator. Parameters will be adjusted with Marijan S. today.

SQS:
- Loop for moving DSSC got a fault but has been addressed by EEE.
  246   28 Jul 2021, 09:29 Arvid GebhardtGeneralInformationNotes XO Integration Meeting 28.07.2021

General Announcement:

- No general announcement.

CTRL:

- Problem with cameras / DAQ: fixed yesterday and tested at SA2/MID.

- Issues with SA3 vacuum loop: work ongoing and further investigations are needed.

DA:

- Nothing to report.

EEE:

- Cables available for HED to be installed next week – date to be discussed offline.

- Fast electronics side: working on FXE and HED issues;

- Nerea J. reports on the VAC/SA3 issues: instability with devices going into an unknown state. Alessandro S. works at the night shift in the DOC and will try to fix a permanent fix during the night.

VAC:

- SA3 issues are affecting also the gas attenuator (not only general SA3 vacuum loop but also GATT is affected, which has its own loop). There are no physical events - seems to be electronic. Stability issues to connect devices; Seems to be more related to infrastructure (PLCs). Further investigations are needed.

ME:

- Not present.

XPD:

- SPB imager: change setting of motors (it shall work now) and next week when A. Koch is back further investigations will be done.

DET:

- During the night after 02:00AM: SPB AGIPD K-bridge went OFF. Under investigation. Detector recovered this morning.

ITDM:

- Nothing to report.

XRO:

- Not present.

LAS:

- Nothing special to report.

UNSYS:

- Nothing to report.

SPB:

- Issues with wings of Agipd, causing also interlock trigger. Under investigation.

- 11PM last night: laser interlock triggered. It happened also in the past and SPB will get in touch with Safety today.

- XTD9 IMG: currently working but a permanent fix is welcome in the future.

FXE:

- Not present.

MID:

- All fine.

HED:

- Major issues with Agipd detector yesterday (thanks to DOC for help): 1. Could not kill the service and CTRL investigated; 2. Clock and control did not work (it has worked at CFEL last week). The issue was solved by changing the clock controller back to old configuration (EEE helped). Bruno F. comments that the clock control had to be downgraded in this detector (it worked in other detectors, only this one did not work). Further investigations will follow.

SCS:

- Change of speed from the monochromator was not possible. EEE and CTRL are working on it.

- Next week will run with a special train picker / bunch sequence pattern as the one used last week.

SQS:

- Vacuum problem as mentioned.

- Commissioning DSSC for future beamtimes.

  245   26 Jul 2021, 09:20 Arvid GebhardtGeneralInformationNotes XO Integration Meeting 26.07.2021

General Announcement:

- Power glitch 3 times at night, what brought down the beam for 1,5 hour each time. Please report to XO if you find devices affected.

CTRL:

- Datalogger update to take place today between 16:00-17:00. Please inform CTRL in case of problems with this schedule.

- Aravis camera and bunch pattern decoder to be updated at around 14:30. Please inform CTRL in case of problems with this schedule.

DA:

- OCD side: no new problems.

- Follow up last Wednesday: better is to use the new Karabo with the fix and not to downgrade the Karabo version.

EEE:

- Ticket from SCS was solved.

VAC:

- Some trouble with the pumps in the gas attenuator SA3. It needs to be fixed today in the tunnel with a ZZ (30 mins).

ME.

- Not present.

XPD:

- Are investigating, if something is affected by the power glitch. So far nothing was found.

DET:

- Nothing to report.

ITDM:

- Two issues to follow with MID: 1. Bassler camera seems to be the data wrongly recorded at DQA. Tests need to be done; it’s a camera used for feedback. Ulrike B. will talk offline with K. Wrona.

- Second issue: on Friday there was one ADC from tunnels to be used from MID was requested a bit late. Data comes from the uTCA from Desy network. If this device is going to be used in full, it has to be set inside Desy network.

XRO:

- Not present.

LAS:

- Two incidents: the power glitch at 19:23 yesterday took Amphos in SA1 down. It is back and operational; In SA3 LAS is further investigating the Amphos.

UNSYS:

- No problem with the power glitch.

- The temperature in SA3 Undulators is stable.

SPB:

- SPB imager at XTD9: is not working and has to be changed the outcome needs to be fixed of XPD. Naresh K. will contact SPB.

FXE:

- Not present.

MID:

- All good at MID – not heard on affected systems due to the power glitch.

- Friday afternoon confusion with the fix of Extra Foam bridge. Probably DA is aware.

HED:

- Vacuum system ok after power glitches.

- Nothing to report.

SCS:

- Not present.

SQS:

- Not affected by the power glitch.

  244   21 Jul 2021, 10:05 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 21.07.2021
General Announcement:
- XO would like to remind instruments that in case it is planned to use beam after 23:00, please put this information in the delivery table for that all involved parts are aware of it.

CTRL:
- CTRL has prepared the fix for the new Camera and would like to apply it. Instruments are in process to be contacted to arrange the best suitable time (10min downtime).

DA:
- MID observed incompatibility in Karabo bridge and framework. Two fixes can be done and will be arranged with instrument contacts. Upgrade of Karabo bridge must be less invasive. 
Steffen H. adds that on MID the hot fix did not make the expected result, so the less invasive is better option.

EEE:
- Nothing to report.

VAC:
- Not present.

ME:
- Not present.

XPD:
- Not present.

DET:
- Tests with LPD are being carried on (for the electronics; at FXE hutch last Monday). Detector has a small issue with configuration. If LPD runs correct, then it will be available. More information to 
come until next week.

ITDM: 
- K. Wrona mentions on the internal proposals. If one wants to have a logbook this has to be requested in advance as it is not automatically created. 
The procedure for the internal proposals is set in a way that a request for the creation of logbook has to be made (and not at the last minute).

XRO:
- Not present.

LAS:
- All laser available for delivery.
- SA1 laser timing system was changed last Monday morning. If someone wants to change timing system (or accidently has changed), please contact LAS.

UNSYS:
- Klima PKG in SA3 must be still OFF. Temperatures in the vacuum chamber are being monitored.

SPB:
- Nothing to report.

FXE:
- Started preparation for commissioning and user experiment. LPD test is prevented by issue with broker control.
- PLC crates installation/update is ongoing with Loop2. This has to be coordinated as they get beam today at 15:00. Nerea J. says there are issues with that crate and it is planned to be done today.
- Access into Doocs for changing XGM settings were not permitted (due to access rights). Desy colleagues from BKR explained that the mapping to accounts have been lost. The BKR colleagues are making the 
changes when requested by FXE.

MID:
- Not present.

HED:
- Thomas P. asks if the operators table had been discussed with XO as he was absent last couple of weeks. A. Galler confirms Ulf Z. had contacted XO and the tables have been shown at the recent UOMs.

SCS:
- Commissioning phase and looking forward to the beamtime.

SQS:
- Nothing to report.
  243   19 Jul 2021, 11:37 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 19.07.2021
General Announcement:
-  A. Galler asks the instruments to also take a look at the operators table as they have a shift-by-shift information for X-ray delivery, not only into the delivery tables.

CTRL:
- Influx logging update: CTRL might have found the couple of devices producing the problem. Solution has been found by restarting and synchronizing the timing clock.

DA:
- Nothing to report.

EEE:
- Nothing to report.
- MID cabling is done.

VAC:
- Nothing to report.

ME:
- Not present.

XPD:
- Nothing to report. 

DET:
- Assessment of the humidity issue; minor problem with the control humidity (power supply) interlock.
- A. Galler asks when PP will be available to FXE. Answer is that there is not yet a fix date.

ITDM: 
- Nothing to report.

XRO:
- Harald Sinn says the three SASEs were aligned, excluding the Monochromators. Beam is available at the end of the tunnels.
- Issue 1: at HED the M3 mirror was with Platinun strip inserted for sometime and may be damaged (it has been changed). 
- Issue 2 with backlash: running in a single mode and must be two backlash – ticket issued to CTRL and may affect the MC motors. Nerea J. is aware and get in touch with Harald Sinn (info from Jorn 
R.).

LAS:
- Trouble with humidity changes and can't guarantee beam pointing. Next few days one must be able to get back the proper operation. Changes from Desy originated the change and TS was not informed.
	
UNSYS:
- Suren K. informs that the PKG in SA3 does not work. A ZZ is needed by TS (Christian Holz). A ticket has been written for ZZ. TS has only one person allowed to go to tunnel but one UNSYS technician can 
accompany TS.

SPB:
- Nothing to report.

FXE:
- Not present.

MID:
- All fine.

HED:
- Not present.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  242   14 Jul 2021, 09:28 Andreas GallerGeneralInformationNotes XO Integration Meeting 14.07.2021

General Announcement:

  •  

CTRL:

  • InlFlux logging, some statisitics had been gathered --> but no root cause had been found.
    • Load Balancer would needed to be restarted --> data inside buffer would be

DA:

  • all good

EEE:

  • PLC team is still busy with check up of the "fuse" issue
  • MID cabling going

VAC:

  •  

ME:

  •  

XPD:

  • one XGM didn't ecevice a signal
    • quickly resolved
  • downstream XGM's are running as well

DET:

  • AGIPD
    • dark procedure fixed and seems to be working now at SPB/SFX, has to be installed at HED and MID
  • LPD
    • 3 supermodules had been moved to the DET LAB --> so far visual inspection does not show major issues
    • no module powered yet
       

ITDM:

  • nothing to report

XRO:

  • SA1 was aligned
    • SPB/SFX done

LAS:

  • humidty in PPLAS
    • TS working on it
      • PKG after maintenance did not come back to specs

UNSYS: 

  • nothing to report

SPB/SFX:

  • nothing to report

FXE:

  • nothing to report --> shutter porblem solved

MID:

  • nothing to report

HED:

  • nothing to report

SCS:

  • triggers

SQS:

  • nothing to report

AOB:

  •  

  241   12 Jul 2021, 09:29 Andreas GallerGeneralInformationNotes XO Integration Meeting 12.07.2021

General Announcement:

  •  

CTRL:

  • InFlux, still experiencing delay with querying the database (20min, karaba; 5min Grafana)
    • Jan reports that in the XGM trendlines a similar effect is seen

DA:

  • nothing to report

EEE:

  • Friday call from BKR, because of MPS blocking
    • FXE SHUT MPS signal was not reset
    • ZA comments, that the reason is not yet clear --> ZA is contact with Rathjen and MPS experts

VAC:

  •  

ME:

  •  

XPD:

  • For the FXE SHUT it seems MPS and karabo data are differeing
  •  

DET:

  • LPD
    • Hazem is back on Friday --> Supermodules will be tested then in the Lab
  • AGIPD
    • special dark procedur currently not working well

ITDM:

  • nothing to report

XRO:

  • This week, component check in all SASE tunnels
  •  

LAS:

  • nothing to report

UNSYS: 

  • Friday
    • SA1 cell 10, Suren exchanged the coupler

SPB/SFX:

  • nothing to report

FXE:

  • nothing to report
    • PLC issues loop4 and loop7 solved

MID:

  • nothing to report

HED:

  • nothing to report

SCS:

  • nothing to report

SQS:

  • nothing to report

AOB:

  • Zunaira --> beam shutter keys

  240   07 Jul 2021, 09:14 Andreas GallerGeneralInformationNotes XO Integration Meeting 07.07.2021

General Announcement:

  •  

CTRL:

  • nothing to report

DA:

  • Nothing to report

EEE:

  • XTD 10 ZZ uTCA excahange

VAC:

  • nothing

ME:

  • nothing

XPD:

  • within next three days XPD equipment to be checked with x-rays
  • DAQ test next Monday
  •  

DET:

  • LPD
    • communication with RAL and STFC, no sign of corrosion --> single module to be taken out and test in the lab

ITDM:

  • nothing

XRO:

  • nothing
  •  

LAS:

  • redmine tickets

UNSYS: 

  • nothing to report

SPB/SFX:

  • ITDM DAQ test today

FXE:

  • nothing --> hutch being prepared
  • PLC loops 4 and 7 are down due to hardware issues on the PLC --> EEE on it.
    • sample stack --> loop4 preparation delayed

MID:

  • pre is going on, everything

HED:

  • nothing

SCS:

  • nothing

SQS:

  • nothing to report

AOB:

  • Zunaira --> beam shutter keys

  239   07 Jul 2021, 09:07 Andreas GallerGeneralInformationNotes XO Integration Meeting 05.07.2021

General Announcement:

- User Operations Meeting will resume on Friday

CTRL:

- Last week found small bug for the fastADC – short down time requested

DA:

- Nothing to report.

EEE:

- Fast electronics – are planning a ZZ

- Fuses issue – MID & HED medium priority crates fixed

- SASE 3 vacuum loop has to be updated – today afternoon or tomorrow around lunch timewill be coordinated by XO with EEE and MXL

VAC:

- Nothing to report

XPD:

- Start up of equipment

DET:

- Nothing to report.

ITDM:

- Nothing to report.

XRO:

- Nothing to report.

LAS:

- Alignment Laser interlock issue at SA3, being investigated

UNSYS:

- Nothing to report.

SPB:

- some motor issues after crate restarts in connection with but not caused by the works adressing the fuse issue

FXE:

- Nothing to report.

MID:

- all fine

HED:

- nothing.

SCS:

- Nothing to report.

SQS:

- Nothing to report.

  238   30 Jun 2021, 10:55 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 30.06.2021
General Announcement:
- D3 starts the radiation interlock / TUV tests at XHEXP1 today. Initially by SA1, followed by SA3 area. 
Torsten Schoen will be available to bridge SA2 power supply only when tests are to be done in these instruments. One can work in SA2 until RPOs arrive to start tests in that hutches.
- Accelerator will start next week and first delivery beam to instruments is on cw29.
- First UOM starts on July 9th possibly discussing X-ray delivery parameters.

CTRL:
- Influx logger stress tests taking place this morning between 10:00 and 11:00. 
- Karabo 11.2 is out and instrument contacts will get in touch for deployment.
- Fix for the time zone configuration together with EEE: hopefully by the end of the week this will be fixed automatically otherwise it is done manually.

DA:
- Nothing to report.

EEE:
- PLC modifications at SQS is done; then followed at SCS and FXE.

VAC:
- Nothing to report.

ME: 
- Working together with VAC, XRO, XPD and UNSYS.

XPD:
- Andreas K.is working in XTD9, testing synchronization signal for Shimadzu camera (sync signal comes from PLC).

DET:
- LPD detector at FXE had water condensation yesterday. The chiller was ON with low temperature set (15 C). Together with EEE put detector in safe state (detector was OFF but not the chiller). 
Responsible person will be back in two weeks. Martin K. adds says that temperature setpoint was then set to 22 C and there is no apparent reason for the 15C set.

ITDM: 
- Nothing to report.

XRO:
- Info to SA3 instruments: XRO would like to test SA3 mirror motors from 10:30-11:30. Please do not touch mirrors in this timeframe. SQS and SCS do not see problems with it.

LAS:
- SA1 and SA3 PP-lasers are restarted and preparing for operation.
- Trigger for SA3 PP-L after Karabo upgrade does not work. The feedback also does not regulate. Tickets were sent to CTRL. After feedback it may contact also EEE.
- SA2 Seeder oscillator is exchanged and sync has to be restarted.
- A. Galler asks about spares for Seeders. Man J. says the spare was installed in SA2; one remaining oscillator is used in the lab and then LAS must stop R&D projects in case it is used as spare for one of 
the PP-lasers.

UNSYS:
- Nothing to report.

SPB:
- Richard B. says tunnels trigger that XPD works in tunnel have no relation to the timing trigger board.

FXE:
- LPD issue: chiller appears to be dry again this morning after setting it to 22 C.

MID:
- Nothing to report.

HED:
- Fuses activity to start today. EEE and Bruno F. confirm this plan. 

SCS:
- All fine at SCS.

SQS:
- Nothing to report.
  237   28 Jun 2021, 10:28 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 28.06.2021
General Announcement:
- A. Galler reminds that Interlock tests are coming this week to the hutches. D3 did not make a schedule with respect to each hutch and when. 
As soon as the interlock tests are done in one instruments this will be informed to XO which in turn will communicate to the respective instrument.
- Thomas P. asks if there is a way to bridge instruments only for the tests and not for the whole two days. XO will check with TS and SRP; during the tests one can't access the hutches; 
in case one has the bridge done for the two days one can also work there with the presence of the EQP.

CTRL:
- Scheduling announcement: 
1. Bug in the current fast ADC devices. This is applied at LAS and will be deployed for the whole facility. Proposition for the tunnels is today afternoon; 
2. uTCAs in general: time zone is set to Greenwich time; it is not a major issue but CTRL will ty to fix that; 
3. CTRL will use the Influx logging by testing with the Interlock signals; 
4. Legacy Read the docs will be switched OFF.

DA:
- Nothing to report.

EEE:
- Today start cabling installation at SQS.
- Fuse changing currently ongoing in SQS and to start afterwards at SCS.

VAC:
- Information for tunnels: XTD9 may open again Tuesday afternoon for other works.

XPD:
- XPD is interested to work in XTD9 when it can be opened again.

DET:
- DSSC detector activities at SQS: commissioning without beam is over and was successful. Commissioning with beam to be done on cw30.

ITDM: 
- Nothing to report.

XRO:
- Not present.

LAS:
- Nothing to report.

UNSYS:
- Nothing to report.

SPB:
- Finished all fuse works at SPB. Few issues were found on Friday and other tests are still ongoing. Richard B. will inform other groups on the issues via XO.
- Received DAQ test request from Parthasarathy T. and shall be ready for Wednesday.

FXE:
- Issue with uTCA bug on the 10Hz trigger appeared but has been fixed.

MID:
- All fine at MID.

HED:
- All fine.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  236   23 Jun 2021, 10:41 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 23.06.2021
General Announcement:
- In case groups had issues with power glitch on last Sunday, please let XO know for that this will be discussed with Desy.
- Interlock tests are happening and will reach the hutches on next week. In the past there is little to no implications to the instruments. 
During the tests it shall be transparent but no access shall happen during the tests time interval. As soon as XO receives a detailed plan from SRP/D3 this will be 
communicated to the groups. 

CTRL:
- Influx logging issue has been solved by changing settings together with ITDM.
- Announced updates for the PLC (ELMO motors / settings of rotary encoders): to be deployed tomorrow early in the morning (PLC continues to run); 
For the tunnel topics CTRL proposes to make tomorrow at 8AM and instruments shall coordinate with contacts in case there is restrictions for this time.
- Found small issues with a fuse when connecting to the middle layer of Beckhoff devices. It has not been a problem.
- Natalia G. informed a motor was not working and EEE could solve it early enough. Checking systems in advance is a good practice.
- CC updates to be done tomorrow and rolled to the back properties.
- Read the Docs legacy mode will be switched off on 5th July.

DA:
- Reminder that today the offline detector calibration is not available.

EEE:
- Beckhoff terminals / Fuse issue work is ongoing. EEE waits for contact feedback from other instruments.
- SA3 balcony room and PP-lasers uTCA updates ongoing.

VAC:
- Not present.

XPD:
- One XTD2 door was defective and Jan G. reported on Monday evening to TS which informed Desy colleagues. Ralf E. informed this morning that the door was fixed. 
Issue was a disc of the magnetic contact which had fallen and therefore door was not working properly.
- Motor issue in XTD2 (stuck in inserted position): technosoft control motor for MCP detector. EEE and XPD worked on it and is mostly solved. 
One needs a feedback from CTRL to find why this particular motor looks different from similar devices.
- Tunnels works are done.

DET:
- DSSC improvements taken place and is progressing.

ITDM: 
- Nothing to report.

XRO:
- Not present.

LAS:
- Proceeding with SA1 AMPHOS maintenance and expecting to be done by today.

UNSYS:
- Nothing to report.

SPB:
- Doing well with fuses changes. It tries to finish all of them in the next few days.
- Couple of issues with uTCA updates but Bruno F. is helping.

FXE:
- Nothing to report.

MID:
- Contacted Joern R. / EEE to give feedback on cabling.

HED:
- Nothing to report.

SCS:
- All fine at SCS.

SQS:
- Nothing to report.
  235   21 Jun 2021, 10:56 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 21.06.2021
General Announcement:
- Interlock tests starting this week. An e-mail was sent to xo-info@xfel.eu and if clarifications are needed please get in touch with XO.
- Zunaira A. asks if XO knows if emergency OFF will be tested and power would be bridged. 
XO has no info on specific tests for emergency buttons and understands power will be bridged as it was done in the past. XO will confirm with Wolfgang C. / D3.
- From Wednesday of this week tunnels will be closed. If a task is pending, please contact XO.
- Jan G. asks if uTCA maintenance in tunnels are finished. Bruno F. says that tunnels are completed.
- Sunday morning 7:30AM there was a warning on the power stations but no systems faced power outage as much as it was reported. Please check your devices and systems for 
potential power failures yesterday.

CTRL:
- Control monitors update happening this week.
- Today CTRL needs exclusive SA3 access to motion loops for middle layer devices updates.
- Cameras with Clone work in the Lima version: intervention for these cameras between today and tomorrow.
- Influx logging system: CTRL asks XPD that there are messages being received frequently from the PES and needs to switch it OFF for a while. 
CTRL will contact Joakim Laksman if tests are being made otherwise it is not a problem to stop PES for minutes.

DA:
- Nothing to report.

EEE:
- uTCA updates to continue on Wednesday.
- SPB crates modifications ongoing and discussion with other instruments is taking place.
- Missing feedback from MID and HED for cable installation. 

VAC:
- Finishing tunnels tasks.
- Question to EEE on when the issue with SA1 vacuum loop could be addressed. Bernard B. says he will check the issue mentioned Friday afternoon by today.

XPD:
- SA1 alignment of Shimadzu camera ongoing; Other works from A. Koch are finished.
- Jan G. says that tasks are finished apart of a MCP motor in SA2 (ticket has being issued and Bernard B. will take care of it after this meeting). Issue is that motor 
does not move in reality.

DET:
- Nothing to report.

ITDM: 
- Reminder was sent on creating new proposals for the next half-year. Related in a change in how to clone the commissioning proposals. Please give a feedback to ITDM 
today.

XRO:
- Working in tunnels.

LAS:
- SA1 AMPHOS activity is ongoing and takes longer than expected. To be finished tomorrow or Wednesday. It has to be discussed with XO as other activities are planned 
which affect SA1 PP-laser.
- On Friday SA3 there was cooling water maintenance that switched off PP-laser. To be addressed by XO.

UNSYS:
- Nothing to report.
- Tunnels can be accessed until Tuesday 21.06. Zunaira A. adds that the Interlock tests started this week and go on during next week.

SPB:
- Supporting EEE with changing the crates. Good progress has been done.
- Problems with uTCA crates after the upgrades (fast-ADC can't be reset; previous settings are missed after the upgrade).

FXE:
- Nothing to report.

MID:
- All fine at MID.
- Contact to EEE will be made on the cabling feedback.

HED:
- All good at HED.

SCS:
- Nothing to report.

SQS:
- Last Friday tried to run digitizer again after upgrade: minor issue and if not solved today SQS will get in touch with EEE/CTRL.
  234   16 Jun 2021, 08:37 Arvid GebhardtGeneralInformationNotes XO Integration Meeting 16.06.2021

General Announcement:

- Interlock test next 2 weeks starting on monday - from next wednesday the photon tunnels will be closed; Tests are the XHEXP1 take place on 30.06, 01.07 and 02.07 with the last date as reserve; An email is going to be send by FWF to the xo-info@xfel.eu list.

CTRL:

- List of items to be sent to readiness: 1. problems with lima based cameras (Lima library does not work – needs to be updated: instruments contacts shall get in touch); 2. In SA1 there is legacy Undulator Karabo scenes – vector properties have to be adapted; 3. Counter Clocking motor devices upgraded next week.

- A. Koch asks if SA1 was working this morning. Steffen H. says there were updates but must be running now.

DA:

- Next wednesday will be the Offline calibration update deployment

EEE:

- Shutdown activities going well; "Wille" is short in people but scheduling adjustments with FXE and MID is organized.

- If there are short circuits or mal functions in the Beckhoff crates and current is not high enough to trigger the fuse it may be a fire risk. Solution is developed without impact in firmware, just a replacement of fuses. EEE starts today at SPB the changes; Based on this experience a plan will be made for the other systems and EEE will get in touch with groups.

VAC:

- try to get the works finished in the tunnels

- waiting for the Beckhoff crate works

XPD:

- Most of the tunnels works have been done; others are ongoing; No surprises are expected.

- MKK logbook from Desy reporting about electrical issue. XO will check. (XO update at 13:30: automatic mailing system is being commissioned and under testig; no power failure happened at the time).

DET:

- Work with DSSC in SQS going as planned.

ITDM:

- Work currently being done at FXE.

- Reminder of Friday afternoon gateway update.

XRO:

- Not present.

LAS:

- Nothing special to report.

UNSYS:

- Greasing the linear stages for undulators but not in SA2 (missing grease).

- SA1/SA2 after middle plane alignment UNSYS redefined the minimum gap and will be communicated through XO.

- Cell#36/SA2 there is a cable disconnected that need to be fixed.

- SA1/SA2 working with PS tables for extending operating tables for higher photon energies.

SPB:

- Work with EEE changing all the crates (Beckhoff)

FXE:

- Nothing to add

 

MID:

- Several ongoing infrastructure works are going fine.

- Worried with Beckhoff fuses (reported two years ago by Konstantin). It will be good to hear experience with SPB.

HED:

- Nothing to add

SCS:

- Nothing to add

SQS:

- Nothing to add

  233   14 Jun 2021, 10:15 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 14.06.2021
General Announcement:
-	

CTRL:
- Announcement: tomorrow starts Karabo deployment on FXE in SA1 as well as ITDM; Wednesday the MC2 upgrade for the rest of facility (already done in SA2) will take place.
- Device clone fix to be deployed today (e-mail sent to readiness).
- Two versions of ReadtheDocs exit (Old one will be OFF on the July 5th). If someone has an old project at the old version of ReadTheDocs please change to the new 
version.

DA:
- Nothing to report.

EEE:
- Reminder that uTCA systems are under maintenance this week (interruptions planned in balcony rooms).
- EEE received report last Monday from SPB with issues on motor cables from Beckhoff controllers. Electrical current could go very high but not enough to trigger the 
fuses and consequently overheats and has a fire risk. 
EEE is looking implementations to take place this week in crates. Ordered parts shall arrive beginning of this week. 
It is a large intervention to introduce 1-2 fuses in the modules/terminals of all crates in tunnels and experimental Hall. 
- Steve A. adds that the changes are piece cases, each crate will be touched; if 50% of the crates are changed during this maintenance, one reduces 50% the chances for 
fire. 
P. Gessler comments that one has to limit the current of the 24V terminals, by introduction the additional fuse. All crates will be touched but it is a linear change.

VAC:
- Investigating the situation with motor terminals. A. Galler says tunnels will start being closed next Monday and will find the exact date for XTD6 and XTD9 closure.
- Shutdown work ongoing but no issues to report.

XPD:
- A. Koch, N. Kujala and W. Freund say there is nothing to report.

DET:
- Nothing to report.

ITDM: 
- Reminder on the e-mail of the gateway maintenance proposed to take place on Friday. In case of issues please contact ITDM.

XRO:
- Nothing to report.

LAS:
- Nothing to report.
- Pouneh S. asks when AMPHOS engineer will come this week. Man Jiang (LAS) says that work starts today from 10AM with the amplifier in SA1. 
Man J. will inform back Pouneh on a detailed schedule for this week.

UNSYS:
- After a delay in Afterburner project activities with MEA group, the infrastructure problems at the beginning of last week were solved by TS. 
The work is currently ongoing for the afterburner project and mechanical elements have been installed. 
- Today there will be adjustment of the base plates pedestals; from tomorrow work with concrete filling takes place. Planned tasks for the afterburners will be completed.
- Cell18/SA1 problem: it was not needed to replace the quad mover.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- All fine at MID.

HED:
- All fine at HED.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  232   09 Jun 2021, 10:14 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 09.06.2021
General Announcement:
- Zunaira A. says that on HED on Saturday there was the 2 hour break on the search mal-function. It was solved by manual restart done by Eric B. (origin was the DACHS 
issue) and we do not have an OCD for this matter - basically depends on the goodwill of people. 
Jan G. says that there is no OCD for what Eric B. and Dennis K. did. It would be nice to find a solution for such situations - if this happens during the weekend, this 
may have the end of an experiment. 
Zunaira A. asked Eric B. to file a non-conformity report to be shared with XO.
- There is no UOM meeting next Friday.

CTRL:
- Karabo updates on most of topics are performed yesterday. Few issues in SA3 and HED are under work today. Few open points: 
1. new GUI features: a configuration may be an issue but an e-mail is sent; 
2. EuXFEL gateway hosts to be updated today after lunch with interruptions on running scenes. GUI 2.11 will be installed.

DA:
- Karabo installation on online calibration will be done under arrangements with instruments, mostly likely this week.

EEE:
- Monday point concerning cooling water effects: uTCA will not be affected (no interruptions for e.g. PP-Lasers).
- Next week schedule for uTCA maintenance: it does not affect LAS and balcony rooms. E-mails will be sent when maintenance is done and systems are available.
- SPB issue with PLC wiring on fuses - EEE is analyzing for proposing modifications.

VAC:
- Working on tunnels.

XPD:
- All XPD devices are in safe state.
- Beryllium covers in Hirex are placed.

DET:
- Nothing to report.

ITDM: 
- ITDM finished maintenance of online resources (clusters/storages/migrations). Most of the DAQ is back in operation.
- In the course of June ITDM close the commissioning like proposals. All PIs/contacts of instruments will receive an e-mail with details for procedures to be done.
- Plans for the usual XFEL gateway update: tricky to schedule. A proposed date is by the end of the next week, on Friday 18.06 later afternoon. 
Janusz S. and/or XO will send an e-mail to readiness for spotting eventual issues with this date.

XRO:
- Maintenance work is going well accordingly to the schedule.
- Karabo updates: Maurizio V. understands the gateway update just makes Karabo not usable and asks if it changes anything else. His concerns are with having time for 
check. 
Janusz S. says the operating system reboot only and Karabo installations are done before. Steffen H. says that today between 11:12:00 there is an update on the gatway 
already. 
No effects are expected for devices. New servers are to be installed and commissioned. Karabo updates are being done already and there is time for checks.

LAS:
- Nothing to report.

UNSYS:
- Monday's problem with MEA and Apple-X pre-installation works: It was solved and works continue from today. It is still planned to finish until the end of the shutdown.
- For Quad in SA1/Cell18 the problem was a loosen cable and simple to recover.

SPB:
- On the damaged 20um Si attenuator: it locates at SPB branch.
- Romain L. points to a communication issue with the DAQ maintenance done yesterday: Janusz S. says that this was submitted to the maintenance and happens every 
maintenance. XO will address the case.

FXE:
- Work with crate in the tunnel: cooling water for the Mono stopped. Nerea J. says that there is works by the VAC on this crate. Cooling water will be restored after 
finished work.

MID:
- Nothing to report.

HED:
- Issues with HED Karabo update are being taking care (issues with fuses).

SCS:
- Nothing to report.

SQS:
- Nothing to report.
ELOG V3.1.4-7c3fd00