Group Selection Page HELP Controls Group Data Analysis Group ITDM WP76 DET Vacuum EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Operation PSPO XO TS Migrated2Zulip
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Technical integration and coordination logbook, Contact: A. Violante, G. Wellenreuther, Page 19 of 31  Not logged in ELOG logo
New entries since:Thu Jan 1 01:00:00 1970
Entry   Notes XO Integration Meeting 21.07.2021, posted by Frederik Wolff-Fabris on 21 Jul 2021, 10:05 
General Announcement:
- XO would like to remind instruments that in case it is planned to use beam after 23:00, please put this information in the delivery table for that all involved parts are aware of it.

CTRL:
- CTRL has prepared the fix for the new Camera and would like to apply it. Instruments are in process to be contacted to arrange the best suitable time (10min downtime).

DA:
- MID observed incompatibility in Karabo bridge and framework. Two fixes can be done and will be arranged with instrument contacts. Upgrade of Karabo bridge must be less invasive. 
Steffen H. adds that on MID the hot fix did not make the expected result, so the less invasive is better option.

EEE:
- Nothing to report.

VAC:
- Not present.

ME:
- Not present.

XPD:
- Not present.

DET:
- Tests with LPD are being carried on (for the electronics; at FXE hutch last Monday). Detector has a small issue with configuration. If LPD runs correct, then it will be available. More information to 
come until next week.

ITDM: 
- K. Wrona mentions on the internal proposals. If one wants to have a logbook this has to be requested in advance as it is not automatically created. 
The procedure for the internal proposals is set in a way that a request for the creation of logbook has to be made (and not at the last minute).

XRO:
- Not present.

LAS:
- All laser available for delivery.
- SA1 laser timing system was changed last Monday morning. If someone wants to change timing system (or accidently has changed), please contact LAS.

UNSYS:
- Klima PKG in SA3 must be still OFF. Temperatures in the vacuum chamber are being monitored.

SPB:
- Nothing to report.

FXE:
- Started preparation for commissioning and user experiment. LPD test is prevented by issue with broker control.
- PLC crates installation/update is ongoing with Loop2. This has to be coordinated as they get beam today at 15:00. Nerea J. says there are issues with that crate and it is planned to be done today.
- Access into Doocs for changing XGM settings were not permitted (due to access rights). Desy colleagues from BKR explained that the mapping to accounts have been lost. The BKR colleagues are making the 
changes when requested by FXE.

MID:
- Not present.

HED:
- Thomas P. asks if the operators table had been discussed with XO as he was absent last couple of weeks. A. Galler confirms Ulf Z. had contacted XO and the tables have been shown at the recent UOMs.

SCS:
- Commissioning phase and looking forward to the beamtime.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 19.07.2021, posted by Frederik Wolff-Fabris on 19 Jul 2021, 11:37 
General Announcement:
-  A. Galler asks the instruments to also take a look at the operators table as they have a shift-by-shift information for X-ray delivery, not only into the delivery tables.

CTRL:
- Influx logging update: CTRL might have found the couple of devices producing the problem. Solution has been found by restarting and synchronizing the timing clock.

DA:
- Nothing to report.

EEE:
- Nothing to report.
- MID cabling is done.

VAC:
- Nothing to report.

ME:
- Not present.

XPD:
- Nothing to report. 

DET:
- Assessment of the humidity issue; minor problem with the control humidity (power supply) interlock.
- A. Galler asks when PP will be available to FXE. Answer is that there is not yet a fix date.

ITDM: 
- Nothing to report.

XRO:
- Harald Sinn says the three SASEs were aligned, excluding the Monochromators. Beam is available at the end of the tunnels.
- Issue 1: at HED the M3 mirror was with Platinun strip inserted for sometime and may be damaged (it has been changed). 
- Issue 2 with backlash: running in a single mode and must be two backlash – ticket issued to CTRL and may affect the MC motors. Nerea J. is aware and get in touch with Harald Sinn (info from Jorn 
R.).

LAS:
- Trouble with humidity changes and can't guarantee beam pointing. Next few days one must be able to get back the proper operation. Changes from Desy originated the change and TS was not informed.
	
UNSYS:
- Suren K. informs that the PKG in SA3 does not work. A ZZ is needed by TS (Christian Holz). A ticket has been written for ZZ. TS has only one person allowed to go to tunnel but one UNSYS technician can 
accompany TS.

SPB:
- Nothing to report.

FXE:
- Not present.

MID:
- All fine.

HED:
- Not present.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 14.07.2021, posted by Andreas Galler on 14 Jul 2021, 09:28 

General Announcement:

  •  

CTRL:

  • InlFlux logging, some statisitics had been gathered --> but no root cause had been found.
    • Load Balancer would needed to be restarted --> data inside buffer would be

DA:

  • all good

EEE:

  • PLC team is still busy with check up of the "fuse" issue
  • MID cabling going

VAC:

  •  

ME:

  •  

XPD:

  • one XGM didn't ecevice a signal
    • quickly resolved
  • downstream XGM's are running as well

DET:

  • AGIPD
    • dark procedure fixed and seems to be working now at SPB/SFX, has to be installed at HED and MID
  • LPD
    • 3 supermodules had been moved to the DET LAB --> so far visual inspection does not show major issues
    • no module powered yet
       

ITDM:

  • nothing to report

XRO:

  • SA1 was aligned
    • SPB/SFX done

LAS:

  • humidty in PPLAS
    • TS working on it
      • PKG after maintenance did not come back to specs

UNSYS: 

  • nothing to report

SPB/SFX:

  • nothing to report

FXE:

  • nothing to report --> shutter porblem solved

MID:

  • nothing to report

HED:

  • nothing to report

SCS:

  • triggers

SQS:

  • nothing to report

AOB:

  •  

Entry   Notes XO Integration Meeting 12.07.2021, posted by Andreas Galler on 12 Jul 2021, 09:29 

General Announcement:

  •  

CTRL:

  • InFlux, still experiencing delay with querying the database (20min, karaba; 5min Grafana)
    • Jan reports that in the XGM trendlines a similar effect is seen

DA:

  • nothing to report

EEE:

  • Friday call from BKR, because of MPS blocking
    • FXE SHUT MPS signal was not reset
    • ZA comments, that the reason is not yet clear --> ZA is contact with Rathjen and MPS experts

VAC:

  •  

ME:

  •  

XPD:

  • For the FXE SHUT it seems MPS and karabo data are differeing
  •  

DET:

  • LPD
    • Hazem is back on Friday --> Supermodules will be tested then in the Lab
  • AGIPD
    • special dark procedur currently not working well

ITDM:

  • nothing to report

XRO:

  • This week, component check in all SASE tunnels
  •  

LAS:

  • nothing to report

UNSYS: 

  • Friday
    • SA1 cell 10, Suren exchanged the coupler

SPB/SFX:

  • nothing to report

FXE:

  • nothing to report
    • PLC issues loop4 and loop7 solved

MID:

  • nothing to report

HED:

  • nothing to report

SCS:

  • nothing to report

SQS:

  • nothing to report

AOB:

  • Zunaira --> beam shutter keys

Entry   Notes XO Integration Meeting 07.07.2021, posted by Andreas Galler on 07 Jul 2021, 09:14 

General Announcement:

  •  

CTRL:

  • nothing to report

DA:

  • Nothing to report

EEE:

  • XTD 10 ZZ uTCA excahange

VAC:

  • nothing

ME:

  • nothing

XPD:

  • within next three days XPD equipment to be checked with x-rays
  • DAQ test next Monday
  •  

DET:

  • LPD
    • communication with RAL and STFC, no sign of corrosion --> single module to be taken out and test in the lab

ITDM:

  • nothing

XRO:

  • nothing
  •  

LAS:

  • redmine tickets

UNSYS: 

  • nothing to report

SPB/SFX:

  • ITDM DAQ test today

FXE:

  • nothing --> hutch being prepared
  • PLC loops 4 and 7 are down due to hardware issues on the PLC --> EEE on it.
    • sample stack --> loop4 preparation delayed

MID:

  • pre is going on, everything

HED:

  • nothing

SCS:

  • nothing

SQS:

  • nothing to report

AOB:

  • Zunaira --> beam shutter keys

Entry   Notes XO Integration Meeting 05.07.2021, posted by Andreas Galler on 07 Jul 2021, 09:07 

General Announcement:

- User Operations Meeting will resume on Friday

CTRL:

- Last week found small bug for the fastADC – short down time requested

DA:

- Nothing to report.

EEE:

- Fast electronics – are planning a ZZ

- Fuses issue – MID & HED medium priority crates fixed

- SASE 3 vacuum loop has to be updated – today afternoon or tomorrow around lunch timewill be coordinated by XO with EEE and MXL

VAC:

- Nothing to report

XPD:

- Start up of equipment

DET:

- Nothing to report.

ITDM:

- Nothing to report.

XRO:

- Nothing to report.

LAS:

- Alignment Laser interlock issue at SA3, being investigated

UNSYS:

- Nothing to report.

SPB:

- some motor issues after crate restarts in connection with but not caused by the works adressing the fuse issue

FXE:

- Nothing to report.

MID:

- all fine

HED:

- nothing.

SCS:

- Nothing to report.

SQS:

- Nothing to report.

Entry   Notes XO Integration Meeting 30.06.2021, posted by Frederik Wolff-Fabris on 30 Jun 2021, 10:55 
General Announcement:
- D3 starts the radiation interlock / TUV tests at XHEXP1 today. Initially by SA1, followed by SA3 area. 
Torsten Schoen will be available to bridge SA2 power supply only when tests are to be done in these instruments. One can work in SA2 until RPOs arrive to start tests in that hutches.
- Accelerator will start next week and first delivery beam to instruments is on cw29.
- First UOM starts on July 9th possibly discussing X-ray delivery parameters.

CTRL:
- Influx logger stress tests taking place this morning between 10:00 and 11:00. 
- Karabo 11.2 is out and instrument contacts will get in touch for deployment.
- Fix for the time zone configuration together with EEE: hopefully by the end of the week this will be fixed automatically otherwise it is done manually.

DA:
- Nothing to report.

EEE:
- PLC modifications at SQS is done; then followed at SCS and FXE.

VAC:
- Nothing to report.

ME: 
- Working together with VAC, XRO, XPD and UNSYS.

XPD:
- Andreas K.is working in XTD9, testing synchronization signal for Shimadzu camera (sync signal comes from PLC).

DET:
- LPD detector at FXE had water condensation yesterday. The chiller was ON with low temperature set (15 C). Together with EEE put detector in safe state (detector was OFF but not the chiller). 
Responsible person will be back in two weeks. Martin K. adds says that temperature setpoint was then set to 22 C and there is no apparent reason for the 15C set.

ITDM: 
- Nothing to report.

XRO:
- Info to SA3 instruments: XRO would like to test SA3 mirror motors from 10:30-11:30. Please do not touch mirrors in this timeframe. SQS and SCS do not see problems with it.

LAS:
- SA1 and SA3 PP-lasers are restarted and preparing for operation.
- Trigger for SA3 PP-L after Karabo upgrade does not work. The feedback also does not regulate. Tickets were sent to CTRL. After feedback it may contact also EEE.
- SA2 Seeder oscillator is exchanged and sync has to be restarted.
- A. Galler asks about spares for Seeders. Man J. says the spare was installed in SA2; one remaining oscillator is used in the lab and then LAS must stop R&D projects in case it is used as spare for one of 
the PP-lasers.

UNSYS:
- Nothing to report.

SPB:
- Richard B. says tunnels trigger that XPD works in tunnel have no relation to the timing trigger board.

FXE:
- LPD issue: chiller appears to be dry again this morning after setting it to 22 C.

MID:
- Nothing to report.

HED:
- Fuses activity to start today. EEE and Bruno F. confirm this plan. 

SCS:
- All fine at SCS.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 28.06.2021, posted by Frederik Wolff-Fabris on 28 Jun 2021, 10:28 
General Announcement:
- A. Galler reminds that Interlock tests are coming this week to the hutches. D3 did not make a schedule with respect to each hutch and when. 
As soon as the interlock tests are done in one instruments this will be informed to XO which in turn will communicate to the respective instrument.
- Thomas P. asks if there is a way to bridge instruments only for the tests and not for the whole two days. XO will check with TS and SRP; during the tests one can't access the hutches; 
in case one has the bridge done for the two days one can also work there with the presence of the EQP.

CTRL:
- Scheduling announcement: 
1. Bug in the current fast ADC devices. This is applied at LAS and will be deployed for the whole facility. Proposition for the tunnels is today afternoon; 
2. uTCAs in general: time zone is set to Greenwich time; it is not a major issue but CTRL will ty to fix that; 
3. CTRL will use the Influx logging by testing with the Interlock signals; 
4. Legacy Read the docs will be switched OFF.

DA:
- Nothing to report.

EEE:
- Today start cabling installation at SQS.
- Fuse changing currently ongoing in SQS and to start afterwards at SCS.

VAC:
- Information for tunnels: XTD9 may open again Tuesday afternoon for other works.

XPD:
- XPD is interested to work in XTD9 when it can be opened again.

DET:
- DSSC detector activities at SQS: commissioning without beam is over and was successful. Commissioning with beam to be done on cw30.

ITDM: 
- Nothing to report.

XRO:
- Not present.

LAS:
- Nothing to report.

UNSYS:
- Nothing to report.

SPB:
- Finished all fuse works at SPB. Few issues were found on Friday and other tests are still ongoing. Richard B. will inform other groups on the issues via XO.
- Received DAQ test request from Parthasarathy T. and shall be ready for Wednesday.

FXE:
- Issue with uTCA bug on the 10Hz trigger appeared but has been fixed.

MID:
- All fine at MID.

HED:
- All fine.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 23.06.2021, posted by Frederik Wolff-Fabris on 23 Jun 2021, 10:41 
General Announcement:
- In case groups had issues with power glitch on last Sunday, please let XO know for that this will be discussed with Desy.
- Interlock tests are happening and will reach the hutches on next week. In the past there is little to no implications to the instruments. 
During the tests it shall be transparent but no access shall happen during the tests time interval. As soon as XO receives a detailed plan from SRP/D3 this will be 
communicated to the groups. 

CTRL:
- Influx logging issue has been solved by changing settings together with ITDM.
- Announced updates for the PLC (ELMO motors / settings of rotary encoders): to be deployed tomorrow early in the morning (PLC continues to run); 
For the tunnel topics CTRL proposes to make tomorrow at 8AM and instruments shall coordinate with contacts in case there is restrictions for this time.
- Found small issues with a fuse when connecting to the middle layer of Beckhoff devices. It has not been a problem.
- Natalia G. informed a motor was not working and EEE could solve it early enough. Checking systems in advance is a good practice.
- CC updates to be done tomorrow and rolled to the back properties.
- Read the Docs legacy mode will be switched off on 5th July.

DA:
- Reminder that today the offline detector calibration is not available.

EEE:
- Beckhoff terminals / Fuse issue work is ongoing. EEE waits for contact feedback from other instruments.
- SA3 balcony room and PP-lasers uTCA updates ongoing.

VAC:
- Not present.

XPD:
- One XTD2 door was defective and Jan G. reported on Monday evening to TS which informed Desy colleagues. Ralf E. informed this morning that the door was fixed. 
Issue was a disc of the magnetic contact which had fallen and therefore door was not working properly.
- Motor issue in XTD2 (stuck in inserted position): technosoft control motor for MCP detector. EEE and XPD worked on it and is mostly solved. 
One needs a feedback from CTRL to find why this particular motor looks different from similar devices.
- Tunnels works are done.

DET:
- DSSC improvements taken place and is progressing.

ITDM: 
- Nothing to report.

XRO:
- Not present.

LAS:
- Proceeding with SA1 AMPHOS maintenance and expecting to be done by today.

UNSYS:
- Nothing to report.

SPB:
- Doing well with fuses changes. It tries to finish all of them in the next few days.
- Couple of issues with uTCA updates but Bruno F. is helping.

FXE:
- Nothing to report.

MID:
- Contacted Joern R. / EEE to give feedback on cabling.

HED:
- Nothing to report.

SCS:
- All fine at SCS.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 21.06.2021, posted by Frederik Wolff-Fabris on 21 Jun 2021, 10:56 
General Announcement:
- Interlock tests starting this week. An e-mail was sent to xo-info@xfel.eu and if clarifications are needed please get in touch with XO.
- Zunaira A. asks if XO knows if emergency OFF will be tested and power would be bridged. 
XO has no info on specific tests for emergency buttons and understands power will be bridged as it was done in the past. XO will confirm with Wolfgang C. / D3.
- From Wednesday of this week tunnels will be closed. If a task is pending, please contact XO.
- Jan G. asks if uTCA maintenance in tunnels are finished. Bruno F. says that tunnels are completed.
- Sunday morning 7:30AM there was a warning on the power stations but no systems faced power outage as much as it was reported. Please check your devices and systems for 
potential power failures yesterday.

CTRL:
- Control monitors update happening this week.
- Today CTRL needs exclusive SA3 access to motion loops for middle layer devices updates.
- Cameras with Clone work in the Lima version: intervention for these cameras between today and tomorrow.
- Influx logging system: CTRL asks XPD that there are messages being received frequently from the PES and needs to switch it OFF for a while. 
CTRL will contact Joakim Laksman if tests are being made otherwise it is not a problem to stop PES for minutes.

DA:
- Nothing to report.

EEE:
- uTCA updates to continue on Wednesday.
- SPB crates modifications ongoing and discussion with other instruments is taking place.
- Missing feedback from MID and HED for cable installation. 

VAC:
- Finishing tunnels tasks.
- Question to EEE on when the issue with SA1 vacuum loop could be addressed. Bernard B. says he will check the issue mentioned Friday afternoon by today.

XPD:
- SA1 alignment of Shimadzu camera ongoing; Other works from A. Koch are finished.
- Jan G. says that tasks are finished apart of a MCP motor in SA2 (ticket has being issued and Bernard B. will take care of it after this meeting). Issue is that motor 
does not move in reality.

DET:
- Nothing to report.

ITDM: 
- Reminder was sent on creating new proposals for the next half-year. Related in a change in how to clone the commissioning proposals. Please give a feedback to ITDM 
today.

XRO:
- Working in tunnels.

LAS:
- SA1 AMPHOS activity is ongoing and takes longer than expected. To be finished tomorrow or Wednesday. It has to be discussed with XO as other activities are planned 
which affect SA1 PP-laser.
- On Friday SA3 there was cooling water maintenance that switched off PP-laser. To be addressed by XO.

UNSYS:
- Nothing to report.
- Tunnels can be accessed until Tuesday 21.06. Zunaira A. adds that the Interlock tests started this week and go on during next week.

SPB:
- Supporting EEE with changing the crates. Good progress has been done.
- Problems with uTCA crates after the upgrades (fast-ADC can't be reset; previous settings are missed after the upgrade).

FXE:
- Nothing to report.

MID:
- All fine at MID.
- Contact to EEE will be made on the cabling feedback.

HED:
- All good at HED.

SCS:
- Nothing to report.

SQS:
- Last Friday tried to run digitizer again after upgrade: minor issue and if not solved today SQS will get in touch with EEE/CTRL.
Entry   Notes XO Integration Meeting 16.06.2021, posted by Arvid Gebhardt on 16 Jun 2021, 08:37 

General Announcement:

- Interlock test next 2 weeks starting on monday - from next wednesday the photon tunnels will be closed; Tests are the XHEXP1 take place on 30.06, 01.07 and 02.07 with the last date as reserve; An email is going to be send by FWF to the xo-info@xfel.eu list.

CTRL:

- List of items to be sent to readiness: 1. problems with lima based cameras (Lima library does not work – needs to be updated: instruments contacts shall get in touch); 2. In SA1 there is legacy Undulator Karabo scenes – vector properties have to be adapted; 3. Counter Clocking motor devices upgraded next week.

- A. Koch asks if SA1 was working this morning. Steffen H. says there were updates but must be running now.

DA:

- Next wednesday will be the Offline calibration update deployment

EEE:

- Shutdown activities going well; "Wille" is short in people but scheduling adjustments with FXE and MID is organized.

- If there are short circuits or mal functions in the Beckhoff crates and current is not high enough to trigger the fuse it may be a fire risk. Solution is developed without impact in firmware, just a replacement of fuses. EEE starts today at SPB the changes; Based on this experience a plan will be made for the other systems and EEE will get in touch with groups.

VAC:

- try to get the works finished in the tunnels

- waiting for the Beckhoff crate works

XPD:

- Most of the tunnels works have been done; others are ongoing; No surprises are expected.

- MKK logbook from Desy reporting about electrical issue. XO will check. (XO update at 13:30: automatic mailing system is being commissioned and under testig; no power failure happened at the time).

DET:

- Work with DSSC in SQS going as planned.

ITDM:

- Work currently being done at FXE.

- Reminder of Friday afternoon gateway update.

XRO:

- Not present.

LAS:

- Nothing special to report.

UNSYS:

- Greasing the linear stages for undulators but not in SA2 (missing grease).

- SA1/SA2 after middle plane alignment UNSYS redefined the minimum gap and will be communicated through XO.

- Cell#36/SA2 there is a cable disconnected that need to be fixed.

- SA1/SA2 working with PS tables for extending operating tables for higher photon energies.

SPB:

- Work with EEE changing all the crates (Beckhoff)

FXE:

- Nothing to add

 

MID:

- Several ongoing infrastructure works are going fine.

- Worried with Beckhoff fuses (reported two years ago by Konstantin). It will be good to hear experience with SPB.

HED:

- Nothing to add

SCS:

- Nothing to add

SQS:

- Nothing to add

Entry   Notes XO Integration Meeting 14.06.2021, posted by Frederik Wolff-Fabris on 14 Jun 2021, 10:15 
General Announcement:
-	

CTRL:
- Announcement: tomorrow starts Karabo deployment on FXE in SA1 as well as ITDM; Wednesday the MC2 upgrade for the rest of facility (already done in SA2) will take place.
- Device clone fix to be deployed today (e-mail sent to readiness).
- Two versions of ReadtheDocs exit (Old one will be OFF on the July 5th). If someone has an old project at the old version of ReadTheDocs please change to the new 
version.

DA:
- Nothing to report.

EEE:
- Reminder that uTCA systems are under maintenance this week (interruptions planned in balcony rooms).
- EEE received report last Monday from SPB with issues on motor cables from Beckhoff controllers. Electrical current could go very high but not enough to trigger the 
fuses and consequently overheats and has a fire risk. 
EEE is looking implementations to take place this week in crates. Ordered parts shall arrive beginning of this week. 
It is a large intervention to introduce 1-2 fuses in the modules/terminals of all crates in tunnels and experimental Hall. 
- Steve A. adds that the changes are piece cases, each crate will be touched; if 50% of the crates are changed during this maintenance, one reduces 50% the chances for 
fire. 
P. Gessler comments that one has to limit the current of the 24V terminals, by introduction the additional fuse. All crates will be touched but it is a linear change.

VAC:
- Investigating the situation with motor terminals. A. Galler says tunnels will start being closed next Monday and will find the exact date for XTD6 and XTD9 closure.
- Shutdown work ongoing but no issues to report.

XPD:
- A. Koch, N. Kujala and W. Freund say there is nothing to report.

DET:
- Nothing to report.

ITDM: 
- Reminder on the e-mail of the gateway maintenance proposed to take place on Friday. In case of issues please contact ITDM.

XRO:
- Nothing to report.

LAS:
- Nothing to report.
- Pouneh S. asks when AMPHOS engineer will come this week. Man Jiang (LAS) says that work starts today from 10AM with the amplifier in SA1. 
Man J. will inform back Pouneh on a detailed schedule for this week.

UNSYS:
- After a delay in Afterburner project activities with MEA group, the infrastructure problems at the beginning of last week were solved by TS. 
The work is currently ongoing for the afterburner project and mechanical elements have been installed. 
- Today there will be adjustment of the base plates pedestals; from tomorrow work with concrete filling takes place. Planned tasks for the afterburners will be completed.
- Cell18/SA1 problem: it was not needed to replace the quad mover.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- All fine at MID.

HED:
- All fine at HED.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 09.06.2021, posted by Frederik Wolff-Fabris on 09 Jun 2021, 10:14 
General Announcement:
- Zunaira A. says that on HED on Saturday there was the 2 hour break on the search mal-function. It was solved by manual restart done by Eric B. (origin was the DACHS 
issue) and we do not have an OCD for this matter - basically depends on the goodwill of people. 
Jan G. says that there is no OCD for what Eric B. and Dennis K. did. It would be nice to find a solution for such situations - if this happens during the weekend, this 
may have the end of an experiment. 
Zunaira A. asked Eric B. to file a non-conformity report to be shared with XO.
- There is no UOM meeting next Friday.

CTRL:
- Karabo updates on most of topics are performed yesterday. Few issues in SA3 and HED are under work today. Few open points: 
1. new GUI features: a configuration may be an issue but an e-mail is sent; 
2. EuXFEL gateway hosts to be updated today after lunch with interruptions on running scenes. GUI 2.11 will be installed.

DA:
- Karabo installation on online calibration will be done under arrangements with instruments, mostly likely this week.

EEE:
- Monday point concerning cooling water effects: uTCA will not be affected (no interruptions for e.g. PP-Lasers).
- Next week schedule for uTCA maintenance: it does not affect LAS and balcony rooms. E-mails will be sent when maintenance is done and systems are available.
- SPB issue with PLC wiring on fuses - EEE is analyzing for proposing modifications.

VAC:
- Working on tunnels.

XPD:
- All XPD devices are in safe state.
- Beryllium covers in Hirex are placed.

DET:
- Nothing to report.

ITDM: 
- ITDM finished maintenance of online resources (clusters/storages/migrations). Most of the DAQ is back in operation.
- In the course of June ITDM close the commissioning like proposals. All PIs/contacts of instruments will receive an e-mail with details for procedures to be done.
- Plans for the usual XFEL gateway update: tricky to schedule. A proposed date is by the end of the next week, on Friday 18.06 later afternoon. 
Janusz S. and/or XO will send an e-mail to readiness for spotting eventual issues with this date.

XRO:
- Maintenance work is going well accordingly to the schedule.
- Karabo updates: Maurizio V. understands the gateway update just makes Karabo not usable and asks if it changes anything else. His concerns are with having time for 
check. 
Janusz S. says the operating system reboot only and Karabo installations are done before. Steffen H. says that today between 11:12:00 there is an update on the gatway 
already. 
No effects are expected for devices. New servers are to be installed and commissioned. Karabo updates are being done already and there is time for checks.

LAS:
- Nothing to report.

UNSYS:
- Monday's problem with MEA and Apple-X pre-installation works: It was solved and works continue from today. It is still planned to finish until the end of the shutdown.
- For Quad in SA1/Cell18 the problem was a loosen cable and simple to recover.

SPB:
- On the damaged 20um Si attenuator: it locates at SPB branch.
- Romain L. points to a communication issue with the DAQ maintenance done yesterday: Janusz S. says that this was submitted to the maintenance and happens every 
maintenance. XO will address the case.

FXE:
- Work with crate in the tunnel: cooling water for the Mono stopped. Nerea J. says that there is works by the VAC on this crate. Cooling water will be restored after 
finished work.

MID:
- Nothing to report.

HED:
- Issues with HED Karabo update are being taking care (issues with fuses).

SCS:
- Nothing to report.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 07.06.2021, posted by Frederik Wolff-Fabris on 07 Jun 2021, 10:29 
General Announcement:
- Accelerator has been shutdown this morning and the Summer/21 maintenance period has started.
- A. Galler asks the instruments to check the beamlines are in safe state for that tuning and setup starts after the maintenance without potentially damaging equipment.

CTRL:
- Reminder that tomorrow CTRL starts the deployment of larger Karabo topics (details with contact persons).

DA:
- Nothing to report from OCD service.
- Detector calibration: Philipp S. reminds that the pipelines/services will be temporarily removed for updates but it will be brought back.

EEE:
- Nothing apart of maintenance tasks.

VAC:
- Nothing to report.

XPD:
- Jan G. reports as PRC many technical issues happened during the weekend: 
1. Problem with DACHS system (hutch search at HED was not able to be performed). This was a communication problem and DACHS server had to be rebooted There is no OCD over 
weekend). 
2. EPD went down due to network failure (down for all tunnels and was fixed on Sunday). Martin Dommach confirms that the entry at TXD9 was possible this morning.
- XPD reports on a comment from SPB on June 1st says a damage of 25um Si was found. Jan G. asks more details which device it is. 
M. Sikorski will check that. Naresh K. says it shall be in the SPB branch.
- XGMs are powered down for the maintenance.

DET:
- DRCs/DOC is OFF during the maintenance period. If support is requested, please contact support via ticketing system.

ITDM: 
- For the shutdown period, the emergency IT phone is available only for critical service (old number 98070).
- Storage systems will be serviced and will not be in operation all the time for the next weeks.

XRO:
- Not present.

LAS:
- SA2 and SA3 PP-lasers will be running next weeks for instruments.
- AMPHOS work taking place next week: needs cooling water and timing system until June 22nd. For short interruptions of 20 minutes the doors will be opened. 
Patrick G. says that local timing is a good solution. Tomasz J. says they have equipment to provide for 1 PP-Laser.

UNSYS:
- Quad mover issue in cell18/SA1 will be looked on today or tomorrow.

SPB:
- Nothing to report.

FXE:
- Nothing to report.
- A. Galler asks if cross talk was observed during the weekend. Jan G. says he talked to SQS this morning and they made checks and on Saturday they did not find any shift 
or cross-talking. 

MID:
- All fine at MID.
- Accesses in the optics hutches may be restricted. Also the experimental hutch has restricted access. If access is needed, please contact MID staff beforehand.

HED:
- DACHS system: one has to investigate further in the cache if this will happen again. 
Jan G. says that there is an entry by D. Kruse and the hutch search is another issue. Maybe the cache works only for one and not both issues.
- For the ADC T. Preston will investigate why the bunch pattern was not read correctly when changing the settings.

SCS:
- Nothing to report.

SQS:
- Not present.
Entry   Notes XO Integration Meeting 02.06.2021, posted by Frederik Wolff-Fabris on 02 Jun 2021, 10:24 
General Announcement:
- XO reminds staff to check the safety trainings and the DACHS access rights/permissions for the tunnels when planning tunnel accesses during the maintenance period. 
- A. Galler asks all instruments who work with X-ray beam that in case it is found any damaged component, please take a snapshot and post in the operation e-log. 
This allows to get known prior/during the maintenance period.
- Last UOM prior maintenance period takes place next Friday. 

CTRL:
- For the maintenance period: CTRL will send around the Karabo schedule for updates such as MC2 motors. CTRL will get also in touch with affected people.
- Macro update announcement on Monday will not take place anymore.

DA:
- Nothing to report.

EEE:
- EEE is gathering and scheduling all shutdown tasks and will start next week with tunnel works.
- SASE1 VAC, EPS and MOV, and SASE2 MOV2 loops will be updated next week.
- EEE will also assist, if needed, on the testing of the Mc2 interface migration that Steffen H. / CTRL has informed.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- This is the last week of DOC operation. The DOC will re-start on cw28.

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- Man Jiang reports all 3 PP-Lasers are running.
- SCS can't open the shutter (interlock issue) but this is not related to LAS.

UNSYS:
- Nothing to report.

SPB:
- DOC has contacted SPB saying Maxwell calibrations failed. This will be checked.

FXE:
- Nothing to add.

MID:
- All fine at MID.

HED:
- Issue with camera at 10:30PM. It Needed to be power cycled. Steffen H. says that the camera worked this morning. Maybe case is already solved. One will keep an eye if 
it happens again.

SCS:
- Issue with Interlock mentioned by LAS. Pouneh S. is working on it.

SQS:
- User operation this week including optical laser. 
- Thomas B. says SQS struggles with temporal overlap but spatial overlap is fine. They have first to find clear signal to investigate more on the temporal overlap.
Entry   Notes XO Integration Meeting 31.05.2021, posted by Frederik Wolff-Fabris on 31 May 2021, 10:18 
General Announcement:
- Next Friday is the last User & Operation meeting for this run. We will have presentations of 3 user groups.
- Today 31.05 is a normal delivery beam day.

CTRL:
- Information for maintenance period: CTRL will update macros for compatibility at SPB and SCS instruments. CTRL will contact the instruments for scheduling.
- Undulator energies were not corrected updated in Karabo. Re-starting the servers may help. A mismatch of values with Doocs were found.

DA:
- Nothing to report - quiet OCD week from last Wednesday.

EEE:
- Nothing to report.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- Couple of connection issues due to power glitch this morning at 4:56AM. All affected systems were recovered.
- The DOC is not operational today. Tomorrow at 7AM the DOC is back to operation. Calls goes today directly to DRC.

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- PP-Laser in SA1 is down due to power glitch. Cooling water (8 or 11 C) for AMPHOS was affected and caused this downtime. Water has come back few minutes ago. 
- SA2 and SA3 lasers were not affected. There are different pumps for each SASEs. Lorenz K. is investigating (e-mails from GLT and no warning from MKK). 
- SA1 PP-laser will be stable by the afternoon as requires time for stabilization.

UNSYS:
- Nothing to report.

SPB:
- Laser interlock on Wednesday to Thursday night was triggered: panic button switch was falsely indicated that was pressed. It seems to be a failure in the system. 
Desy / BKR reset it and operation could be restored. 
Zunaira A. says that if panic switch is pressed, then the beam shutter will not be able to be moved (SPB will not be able to receive beam). 
There is no relation with the power glitch.

FXE:
- Nothing to report.

MID:
- Looks fine at MID. Joerg H. asks for an e-mail informing on situations like the power glitch for that groups be informed and check if devices are affected. 
A. Galler says currently the reason for the power glitch is under investigation and will be communicated. 

HED:
- This week will be a busy week due to energy changes already at 7:00AM.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 26.05.2021, posted by Frederik Wolff-Fabris on 26 May 2021, 10:23 
General Announcement:
- XO reminds the procedure for ZZ access is organized through the PRC. 
If a ZZ is needed, please get in touch with the PRC for advice and fill it up the Redmine access request (link located at the TTfinfo e-log). 
The PRC will organize and communicate the access with machine RCs, specially in cases of urgent matters. 
It is not beneficial to do not inform the PRC as components in tunnels have to be checked and/or grounded prior the ZZ access takes place.

CTRL:
- Announcement for the summer maintenance: when updating to Karabo 2.11 some instrument macros have to be changed. CTRL will care that and will get in touch with 
instruments to properly organize it.

DA:
- Couple of E-log entries referring to DA but nothing major to report.

EEE:
- Reminder to FXE, MID, SPB, SCS: please check processes for eligible documentation. 
Bruno F. And Joern R. inform that in Alfresco there are various folders with pending documentations (automatic e-mail was sent to referents). Please contact Jorn 
Reifschlager in case of doubts.
- PES system in SA3: digitizers were stopping after acquiring data for a random amount of time. This will be addressed during the maintenance period, as the fix needs 
several hours of ZZ access.

VAC:
- Not present.

XPD:
- Nothing to report.

DET:
- Couple of issues with FXE Jungfrau detector this morning: solved or under fix.

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- Everything is fine with Lasers.

UNSYS:
- All good with Undulators.

SPB:
- Progressing well with beam activities during the nights.

FXE:
- Nothing to report.

MID:
- All fine at MID.

HED:
- Nothing to report. HED does not receive beam this week.

SCS:
- Nothing to report.

SQS:
- Nothing to report. PES digitizer issue affects SQS but one can continue with it until the maintenance period.
Entry   Notes XO Integration Meeting 19.05.2021, posted by Frederik Wolff-Fabris on 19 May 2021, 10:13 
General Announcement:
- A. Galler says the Interlock Tests schedule is placed at the EUXFEL Infrastructure Calendar. 
Concerning the TUV tests at Schenefeld side, this happens between June 30th and July 2nd (the 2nd is a reserve date). When a detailed schedule is made, this will be 
communicated. 
Tomasz J. asks on the effects for the PP-lasers when, e.g. triggering NOT-AUS. XO will enquire with Zunaira A.

CTRL:
- The ADQ digitizer fix for SQS is working well. If other instruments would like it deployed, please contact CTRL.
- Bassler camers upgrade worked for SPB. One can also contact CTRL for the deployment.
- ITDM will need to exchange memory module in SA2 - Karabo will go down. This has to be scheduled between tomorrow and Friday. It will be coordinated by the PRC and CTRL.

DA:
- Nothing to report.

EEE:
- Yesterday incident in SQS: faulty PLC CPU triggered the OFF for 5 CPUs. Four of them have recovered and the fifth one will be replaced or fixed today.

VAC:
- Not present.

XPD:
- FD studies are ongoing this week. Nothing else to report.

DET:
- Nothing to report.

ITDM: 
- Today the update on the Maxwell cluster. Action take place between 10:00 and 12:00 and running jobs are not affected. Submission of new jobs will not be possible during 
this time.
- Issues with Network yesterday: Janusz S. says they do not have yet the final e-mail from Desy-IT. 

XRO:
- A. Galler says that on Monday the beam power reached 32 W at 2125 bunches. Mirrors were working properly during the whole test period.

LAS:
- All fine with PP-lasers.
- Tomasz J. mentions LAS will ask CTRL for update on the functionality of sync system properties for the PP-laser. In case instruments have also interest on it please 
contact LAS.
	
UNSYS:
- Issue with cell#18/SA1 quad mover: it was agreed to run in this condition until the shutdown.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- All fine at MID.

HED:
- All fine at HED.

SCS:
- Nothing to report.

SQS:
- PLC issue yesterday afternoon: vacuum was lost from ^-11 to ^-6. This was a near-miss and almost made SQS to cancel next experiment. It seems to be under fix now.
Entry   Notes XO Integration Meeting 17.05.2021, posted by Frederik Wolff-Fabris on 17 May 2021, 10:25 
General Announcement:
- Adrian Mancuso tells on the workaround for the crosstalk between SA1/SA3 documented by Harald Sinn. The idea was to switch off the feedback prior the bunch changes. 
Harald S. says that it is not sure if this has worked. Adrian M. says that fir the future this has to be addressed as both SA1 and SA3 would like to change bunch number.

CTRL:
- Follow up from the DOC last week: some cameras in HED started in unexpected states. This has been understood and when the update is ready the deployment has to be 
coordinated with HED.

DA:
- From DOC OCDs side only minor issues, that were solved by restarting devices.

EEE:
- Due to the special FD week starting today, there is no DOC this week. 
The DRCs (Patrick G. until Thursday and Monica T. from Thursday) will receive the calls: for normal issues, please send a ticket; for urgent cases call the DRCs. 
One can also contact directly the individual groups.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- Incident at SPB with AGIPD detector: damage to several pixels. The cause for it is not yet known. 
The pixel modules have the replaced and the cause relates to intense radiation. It's important to follow up and understand how it happens. SPB will investigate and 
communicate findings.

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- Everything good with Lasers.

UNSYS:
- Issue with Quad mover in cell18/SA1 - Suren A. could address it without need of access but further investigations have to be done on-site.

SPB:
- Small injection incident over the weekend.
- Problem with one DAQ: number of pulses was OK but not the values. This was solved by the DOC and some data were wrongly saved for the users (attenuation values).

FXE:
- Timing tool tests at FXE during the night: crosstalk between SA1/SA3. When number of SA1 bunches were changed, the beam pointing was changing in SA3. 
So FXE was requested to do not change bunch numbers what hindered the tests.
- LPD issue: progress has been made last week and is being accelerated.

MID:
- Quick warning: until Wednesday some Seeding tests will be ongoing at MID.

HED:
- Successfully experiment last week: HED thank all involved people.
- Addressing CTRL deployment: HED will contact CTRL after this meeting to discuss some details before the deployment action goes on.
- On last Friday at 13:00 one camera corrected configurated did not acquire data and DOC was contacted.
- On Saturday the timing drifted linearly for 0.5ps. HED contacted PRC and DRC and is not yet completely understood.

SCS:
- Nothing to report.

SQS:
- Confirm what FXE has said on the crosstalk with SA1/SA3.
- Sometimes MCP detector was inserted and trigger the EPS to beam stop. Jan G. says that there was a mistake in the interlock configurations for going above 30 bunches.
When SQS wanted to go to 67 bunches it triggered the beam OFF.
Entry   Notes XO Integration Meeting 12.05.2021, posted by Arvid Gebhardt on 12 May 2021, 09:21 

General Announcement:

- User Operations Meeting takes place on next Friday 09:00.

CTRL:

- CTRL would like to excuse itself to people receiving an automatic SMS tonight for notification. This was a test message and now it’s turned OFF (Good side: test for lasers went well).

- ADQ digitizers: two fixes are driven and based for SQS commissioning. CTRL encourage instruments to get in touch with contacts for making the update for the last version.

DA:

- Follow up from Monday / calibration update (on behalf of cal team): it worked as planned. AGIPD seems to run faster now.

- For SQS Remi detectors/digitizers can also be used.

EEE:

- nothing to report

VAC:

- nothing to report

XPD:

- are preparing for FD studies next week

DET:

- Follow-up on LPD online calibration pipeline pointed last Monday’s meeting: work is on progress and is expected to be ready for next week.

- DAQ processing for AGIPD: a minor bug in validation is reported and under investigation. But it is currently working.

- Issue reported for SPB for data aggregators: follow up with CTRL.

ITDM:

- nothing to report

XRO:

- nothing to report

LAS:

- nothing to report

UNSYS:

- nothing to report

SPB:

- not present

FXE:

- Thank to DET and DA for pipeline calibration. Initially it looks promising.

- Last week: digitizer went to wrong configuration. To be fixed with new updated.

- FXE will use the beam during the nights. D. Khakhulin will inform PRC and XO via e-mail.

MID:

- all fine

HED:

- not present

SCS:

- nothing to report

SQS:

- nothing to add

ELOG V3.1.4-7c3fd00