Group Selection Page HELP Controls Group Data Analysis Group ITDM WP76 DET Vacuum EEE WP78 FXE SPB HED SQS SXP Sample Environment Operation PSPO XO TS Migrated2Zulip
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Technical integration and coordination logbook, Contact: A. Violante, G. Wellenreuther, Page 24 of 32  Not logged in ELOG logo
ID Date Author Location Severity Subject
  Draft   12 Oct 2020, 09:12 Andreas GallerGeneralInformationNotes XO Integration Meeting 12.10.2020

General Announcement:

  • .

CTRL:

  • issues SA3 vacuum loop
    • gets more and more diffcult to recover
      • problem not clear, PLC comminucation is lost without obvious reasons
      • no software changes took place from either CTRL nor EEE ... component issue?
  • fastadc issues --> EEE
  • mirror in SA3 not always following a move ommand XTD10 M1

DA:

  •  

EEE:

  • OCD at HED --> hexapod
  • fineDelay

VAC:

  • preventive action in XTD10 for GATT scroll pump

XPD:

  • SA2 imager XTD6 pop in 45 after M3 small mark on the imager --> imager still usable

DET:

  • nothing to report

ITDM:

  • OCD call data aggregator at MID
    • need to understand better how to avoid the situation
  • users complained to maxwell service (DESY directly) about limited resources becuase of high load by other users
    • there are reserved nodes --> use them!
  • issues with scratch
    • more than 300 TB had been accumulated within a relatively short time
      • it seems that data was calibrated to scratch not to proc
      • MID comments --> a special calib mode was used that could not save to proc which is why it was saved to scratch
  • problem with one of the proxy servers --> degraded performance of data migration

XRO:

  •  

LAS:

  • issue at SA1 with Galvo
    • after shift change to FXE, laser was not working --> Galvo was out of phase
    • FXE resetted something (not clear) and the laser came back
    • LAS investigating the issue

UNSYS: 

  • nothing special
    • a couple of times the undulators opened suddenly without any command issued.
    • O. Henssler from DESY proveds the logs

SPB/SFX:

  • coupling with SA1 and SA2 (SA2 using train on demand) is an issue
    • beam walks off the XTD9 XGM aperture
  • offset mirrors M2
    • pitch movement got stiff
  • smaract cotnrollers
    • most fixed by increasing timeout windows

FXE:

  • shutter can be opened despite closed vavales

MID:

  • used pulse on demand
    • users were happy

HED:

  • damage on M3 mirror
    • due to focusing scheme --> 9keV and intermediate focus --> during alignment unfortunately the focusing point came too close to M3
  • meeting with XPD and XRO at 11:30
  • hexapod issue reported to EEE is not quite fixed
    • ´status is not reporting the correct status of the hexapod
    • hexapod started working at some point and fell back to weird operation later again
  • CRL arm7 seems to be at the limit of the x-axis
    • if FEL stays where it is, XTD1 chamber might need to be moved
  • JUNGFRAU issue
    • up to a point the data is fine in the preview
      • after some runs data seen in the preview is not written to file

SCS:

  • nothing to report

SQS:

  • l
  167   08 Oct 2020, 08:52 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 07.10.2020
General Announcement:
- Discussion on access rights based on FXE issue:
- The new Dachs system does not send notification that access rights will expire. Every staff member has to identify at the system when his/her rights will 
expire at each location. 
- Thomas T. says EuXFEL has made a request to Desy in order to modify this and currently it is at the pipeline at Desy.  
- Jan G. mentions that for the labs in his responsibilities he can see the access rights are being expired soon and he manually notifies the people.

CTRL:
- Two OCDs on Tuesday night: 1. SCS motor not moving (was fixed); 2. One SPB smarACT device server crashed (fixed). 
- CTRL is following up both incidents as well as a motor in HED/SA2.

DA:
- Agreement with CTRL (see last Monday's minutes) was done.

EEE:
- Nothing to reports on EDS, PLC.
- CPU for SA1 PP-laser was replaced last Monday. No issues observed since then.

VAC:
- Nothing to report.

XPD:
- No news to report.
- SA3/XGM operation this week (change of settings due to different photon energies range) is less problematic than initially thought. 
Procedure has been integrated to the BKR operators who will make the adjustments at each shift change.

DET:
- Nothing special.

ITDM: 
- Nothing new.

XRO:
- All ongoing, nothing to report.

LAS:
- SA1 PP-laser is running again after exchange of CPU.
- All PP-lasers running.

UNSYS:
- Tests with quad movers: helping with STAB task force.

SPB:
- SmarACT issue: communication error between local control and Karabo.
- SPB reports beam instability issue when SA3 changes, for example, the photon energy or bunch number. BKR was contacted and is aware of it. 

FXE:
- Issue with Interlock yesterday: new access rights for all staff in FXE. GABS has blocked the search prevention. 
Zunaira A. mentions that Frederico L., Dmitry K., Martin K. and Peter Z. can grant access to the staff members. Zunaira A. is not allowed to provide this 
access grants.

MID:
- All fine.

HED:
- User experiment this week. 
- The CRL1 in XTD1 had issue while moving arm in y-direction. A ticket was sent to CTRL. Contact for this ticket is Thomas Preston.

SCS:
- User beamtime this week.

SQS:
- Two color operation with magnetic chicane ongoing this week during day time, making use of the PES and XGM.
- One issue with saving digitizer settings. We open a ticket to ITDM.
  166   06 Oct 2020, 10:36 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 05.10.2020
General Announcement:
-  XO has sent to the support groups and instruments the call for the winter maintenance tasks. Deadline for submission is Oct. 16th. 

CTRL:
- Friday night incident with signals of SA3 vacuum loop. It took hours to recover the system.
- A deployment/restart of online cluster nodes will be done today meaning 10 minutes downtime. Devices / clone devices shortly unavailable during the 
deployment.
- CTRL reminds that tickets that may require Doocs bridge are better worked if sent during the week time. 

DA:
- No major issues to report.
- DA will carry an offline discussion with CTRL on the cluster nodes deployment. CTRL says this is for the CPU nodes.

EEE:
- Nothing major to report. No incidents during the weekend.
- Looking into PL/fast ADC mTCA issue with SA1 PP-laser. To be discussed separately with LAS, XO after the meeting: next solution is to exchange CPU - 
needing coordination with ITDM and CTRL.

VAC:
- No major issues. Karabo SA3 VAC loops look fine now.

XPD:
- PES: ZZ on Friday to fix issue with a broken gauge, mostly likely related to the power failure. Cables had to be switched. PES works again. 
- Tests next week using PES: Joakim L. will set the system.
- Change of SA3 XGM settings during this week: Theo M. will change setup during weekdays.

DET:
- Nothing major to report.

ITDM: 
- No OCD calls during the weekend.

XRO:
- Nothing to report.

LAS:
- Shutdown AMPHOS in SA3 PP-laser (SCS/SQS): LAS asks for one single point of communication with the instruments; This laser needs work today morning to do 
not compromise the week. 
- E-mail for communication can be scs@xfel.eu and sqs@xfel.eu where all group members receive the message. 
- SA2 PP-laser is ready for next week.
- SA1 PP-laser still show problems with ADC cards. CPU will be exchanged - to be discussed after this meeting.

UNSYS:
- ZZ intervention last week.
- Couple of hiccups remotely fixed.

SPB:
- Nothing to report, besides issues with PP-laser.

FXE:
- ADQ with different sampling rates issue was solved by EEE.
- Plan is to work on the Jungfrau commissioning.

MID:
- MID requests if there is planned a meeting to discuss the train-ID issue. Steve A. comments that yes, a meeting will be organized next week. 

HED:
- Asks on the request for a pulse on demand test during today. F. Wolff-Fabris says this has been sent to the machine RCs and will be discussed during the 
RC meeting at 10:00. 
As soon as a decision is done this will be communicated.

SCS:
- Nothing to report.

SQS:
- Nothing to add apart of PP-laser issue.
  165   30 Sep 2020, 12:08 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 30.09.2020
General Announcement:
- XO informs the Call for the Winter Maintenance tasks will be sent to the support groups and Instruments today. 
Please note it is not named "shutdown" anymore are critical services such as basic infrastructure must be maintained. At least in this round it will be called as "Winter 
Maintenance" to avoid confusion among the staff. 
The tasks list shall be sent to xo-planning@xfel.eu. 
- In case of need to go to tunnel via ZZ, please contact the PRC at 9-4800.
- Gerd W. informs on the SXP construction work that starts on Nov. 23rd. The plan aims for a minimal impact in SA3 area at XHEXP1. 
There will be new connections to the cooling water system in SA3and civil constructions. 
Cooling water will be cut from Nov. 23rd until Christmas. This means rack rooms and laser will be affected. 
- Gerd W. answers Raul V.: the cut cooling water supply does not involve tunnels. 
- Tommaso M. says instruments need to have permanent cooling water supply. 
Gerd W. states the electronics must be shut down and will not be able to re-start before Christmas as it takes time to empty the system, weld, do pressure tests and fill 
it up again. 
- XO suggests that SA3 instruments must coordinate closely with Gerd and also involve MB (Serguei M.).
- Nerea J. asks if this applies to SA3 balcony room also. Gerd W. says that the rack rooms will be affected. 
- Gerd informs there is a series of meetings taking place on Thursdays at 14:00 and this construction work can be addressed. The SCS and SQS group leaders have been 
invited to this series. 
If someone else wants to participate, please contact Gerd W. for getting the Zoom link, 
- Monica T. says that this lack of cooling water may impact the DSSC move to SQS by delaying its test.

CTRL:
- CTRL experiences some login hiccups related to information sent to InfluxDB. This will be fixed Sunday night (Monday at 02:00AM). There is no reason this issue will 
affect devices until the fix is done.

DA:
- Train-ID investigation for AGIPD offset is ongoing.  DA understands from now on DET is responsible for the leading efforts. 
- Monica T. comments it has been identified the issue related to the AGIPD firmware (2019 version, accordingly to Jolanta). This will require a significant change and to 
do it now is not an option. 
The good news is that this is a systematic issue and DET know how to take care of it.
- A. Galler asks the small task force on the train-ID to make a small presentation during next XO Integration Meeting. 

EEE:
- ADC in PP-laser (SA1) is confirmed to be solved.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- Issue with DSSC yesterday: one Interlock signal was permanently enabled. EEE solved after restarting the device. It will be further investigated. 
ITDM: 
- Desy/IT requested ITDM a time slot to fix redundant parts of the routers between "ours" and "accelerators". To do so Desy/IT and MXL suggests to apply the fix (do not 
expect side effects) today before lunch time. 
No relation to the timing system of lasers is expected (low risk). None in this meeting's audience raises an issue against the proposed time.  

XRO:
- Nothing to report.

LAS:
- All 3 PP-lasers are up. Currently LAS still make some studies and instruments must send a message in case the need of use. Lasers are ready to be provided to 
instruments.

UNSYS:
- A ZZ is currently ongoing to fix issues with failed couplers in SA3 control cabinets.
- Beckhoff replies the cause of failure is either an overload of current or relations to temperature. Temperature seems not to be the issue (accordingly to UNSYS).

SPB:
- Nothing to report.

FXE:
- Plan to test digitizer (HQ412): issue is that sampling rate is not reproducible as in the lab. Probably it will happen tomorrow together with PP-laser use.

MID:
- The vacuum issue with the monochromator is under control.

HED:
- Preparing the user next week (that uses the pp-laser).

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  164   28 Sep 2020, 11:02 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 28.09.2020
General Announcement:
- Andreas G. informs the winter maintenance period will happen in two months approximately. The call for tasks will go out this week to the support groups and 
instruments. 
- XO informs Desy and TS are investigating the Thursday's event of power cut but do not yet have a clear reason for it.
- Jan G. informs that SCS hutch will be closed and searched this afternoon for the FD on Gain Studies.

CTRL:
- Notification service informed on a broken event. After a Karabo shutdown the FXE topic is fine again. 
- Power cut: CTRL sees no issues as leftovers.
- Investigation of missing data in DOOCS (10 seconds outdated): CTRL has two colleagues looking into it.
- Supporting EEE and LAS on the ongoing working with PP-lasers.
- Update of dataloggers has to be made again. It means a 2 minutes downtime during the course of today/afternoon if nobody has something against.

DA:
- Question to CTRL: a notification service was forward to us. DA needs further description on that. Steffen H. says it was related to the python server and this is not 
deployed by CTRL. 
This is the reason why was forward to DA.

EEE:
- Follow up from Friday recover on the power glitch of Thursday: some cards in SA1 balcony rooms were not reachable anymore on Friday. These lead to a complete restart of 
the whole crate (means interruption of timing). After additional local intervention communication to the MPS was restored. 
- Changed the fast ADC of PP laser in SA1.

VAC:
- Nothing to report.

XPD:
- No issues to report.

DET:
- Agipd was power up after the power cut and had no issues.

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- SA3 PP-laser: problems with SQS site. It misses the power energy (dropped down) and is under investigation. Maybe it is related to some optics assembling.
- SA2 PP-laser: power supply for AMPHOS was lost on Friday. The spare part arrives today at 11:00 and will be changed this afternoon.
- SA1 PP-laser: problem with uTCA (no ADC running and not possibility to login). Crate hangs after every few hours. Working together with EEE (100% in EEE side).

UNSYS:
- The problems with cell1/SA2 not moving were fixed by Suren K.
- Cell2/SA3 hardware problems (couplers) found this morning relates to an Ethernet card which needs to be replaced by ZZ. This cell is not operational.
- Phase shifters in SA3, cell4 and cell5 are not moving. The hardware works and it may be some higher level controls.
- Couplers were sent to Beckhoff for further investigation in order to find solution for decreasing the number of failures in future.

SPB:
- Nothing to report.

FXE:
- Due to issues with PP-laser the FXE did not test the timing tool during the weekend.

MID:
- All fine: still minor vacuum issue in the optical room but MID hopes to be solved soon.

HED:
- Pulse on demand tool was tested last Monday.

SCS:
- Nothing to report.

SQS:
- Nothing to add.
  163   23 Sep 2020, 11:05 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 23.09.2020
General Announcement:
- XO is anticipating in one week the delivery table preparations to gain more time to spot possible problems related to beam delivery. The cw42 table was sent to the 
instruments last Monday.

CTRL:
- CTRL confirms but updates on the dataloggers and time servers were done successfully.
- LAS brought some issues to CTRL that are under investigations.

DA:
- Nothing to report.

EEE:
- EEE conducted yesterday the SA1/SA2 ATT interlock logic modification. Summary can be found in these links:
https://in.xfel.eu/elog/SASE1+technical+commissioning/1982
https://in.xfel.eu/elog/SASE2+technical+commissioning/830

VAC:
- VAC reminds in general that EuXFEL staff shall check their access rights in the DACHS database. To have trainings up to date is not enough. 
In case your rights are expired, please contact Martin Dommach via e-mail. 

XPD:
- FD week had a good start with GATT bleaching studies. Today there is the FD K-mono 4-Bounce ongoing.
- Machine switched back to 14 GeV on Monday; XGM/SA1 gas was exchanged back; graphite screen in SA1 is inserted.

DET:
- Nothing to report.

ITDM: 
- The SASE2 online data storage was diagnosed and reconfigured.

XRO:
- A. Trapp adds on the solid attenuators interlock modification for SA1/SA2: from now it is not possible to remove the diamonds if the silicon is in. 
For more info please check the e-log or contact M. Vannoni: 
https://in.xfel.eu/elog/SASE1+technical+commissioning/1982
https://in.xfel.eu/elog/SASE2+technical+commissioning/830
- Yesterday there was a ZZ in XTD9 for SPB to inspect BPLM: seems to be OK but minor issues to be resolved for the winter shutdown.

LAS:
- SA1 in maintenance: no risk for FXE during the weekend. It must be operational tomorrow morning. 
- SA2: issue with ADC cards - the NOPA is lost. Reported to CTRL.
- SA3: no issues.

UNSYS:
- ZZ in SA2/Cell31 is scheduled for tomorrow (24.09) morning at 09:00AM.

SPB:
- Involved in the update of attenuator. 
- Helping the stability task force activities this week.

FXE:
- FXE informs the second Gotthard is back: Karabo can't start or reset. CTRL suggests that when there is an urgent case one shall call the OCD. Otherwise sending a CTRL 
ticket is most suitable.
- Last week issue with digitizer: A new card was installed but has different sampling frequency. EEE is aware and is looking into it.
- FXE comments it is hard for the instrument staff to attend the two Graphana trainings due to night shifts/compensation, etc. FXE asks on possibility of additional 
trainings. 
Steffen H. says one can organize an extra training. A blue week is more suitable for the instrument staff. The extra training will be organized for the coming days/weeks. 

MID:
- Train-ID issue is progressing.
- MID asks for help from technical and engineering staff to find parts with M20 holes adaptors in order to lift granite stone.
** Post meeting update: VAC group helps MID.

HED:
- Not present.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  162   21 Sep 2020, 16:06 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 21.09.2020
General Announcement:
- Last week issue with Oracle database upgrade was fixed by effort during the night. People entered tunnel by ZZ after this communication issue was fixed.

CTRL:
- It is planned to happen a Data loggers update today. 
- Time server update: related to a bug which happened twice in five years. It will be carried out today afternoon (after XPD beamtime) or tomorrow morning.
- A. Galler asks on updates on pulse pattern decoder: Steffen H. says it is ready to be deployed and tested.

DA:
- DA received only one OCD call last week: no specific issues during the week.

EEE:
- XO informs that the ATT interlock PLC update will be done tomorrow (22.09) morning.

VAC:
- OCD call on Friday from MID related to the cryocooler of monochromator: it was clear issue was related to the power supply. TS was involved to solve the problem by 
exchanging cryocooler. 
VAC informs the OCD number to be dialed is 9-4900 and not 4900.

XPD:
- It was observed problems with SA2/XGM spinning motor gauges.

DET:
- Nothing special: quiet week.

ITDM: 
- There is a problem with SASE2 online data storage. It happens data were not migrated from Schenefeld to Desy or it was very slow which in turn affected MID. Partially 
solved by making system live. 
- ITDM needs to diagnose the GPFS filesystem in SASE2 in order to understand the issues we experienced over the weekend. This may lead to some instabilities or even 
unavailability of the SASE2 online data storage. 
- XO suggests ITDM to coordinate separately with MID and HED.

XRO:
- Nothing to report.

LAS:
- SA3 had power drops and today LAS makes tests regarding Daniel Rivas info.
- SA1 currently replacing laser diode and updating uTCA system.
- SA2 nothing to report.

UNSYS:
- Terminals for SA2/cell31 have arrived and are ready to be installed in next ZZ access.
- Problem with air coil in SA3/cell12 this morning will be taken care.

SPB:
- Commissioning last week using 5 keV beam.

FXE:
- Mono commissioning.

MID:
- Recovered vacuum issue on cryocooler on SAT morning with help from TS. Beam was back on Saturday morning (+-10AM).
- Timing tests were running on Friday by EEE. MID waits for results to be analyzed. Train-ID issue seems to be progressing and many people work on it.

HED:
- User beamtime was very successful. Stability was very good.
- Pulse on demand test aimed to be able to have single PP shot synchronized with FEL. Today from 10AM CTRL and LAS will temporarily change bunch pattern (communicated to 
the PRC). 
No need for X-ray beam to the hutch.

SCS:
- No special issues to report.

SQS:
- Two weeks ago the monochromator was used. X-ray beam was twinkling and not reproducible. Seems to be connected to higher heat load when using 300 pulses. 
SQS says that this needs to be addressed when beam is back again.
  161   16 Sep 2020, 10:20 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 16.09.2020
General Announcement:
- Yesterday evening a ZZ in XTD10 was planned but it turned unsuccessful due to no access in the turnstiles. D3 solve the problem in the middle of the night and since 
then ZZ is possible again.
- Eric Boyd mention on the SQS shutter: a XTD10 ZZ was planned for 8:30AM. He has currently no news so far.

CTRL:
- XGM Pulse pattern decoder issue is under investigation.
- Vacuum issues (giving unknown state in Karabo): also under investigation.
- Next Monday CTRL plans to update Karabo login system. Groups shall inform CTRL if there is any issue against this.
- Last Influx training will be next Friday An e-mail to participants will be sent. 

DA:
- No issues to be reported.

EEE:
- SA1/ Solid Attenuator Interlock problems: EEE is investigating and news will follow. FXE found an issue within the motion loop last night and XRO also helps. 
It is the Interlock on the attenuator itself and not in the EPS.

VAC:
- Nothing to report.

XPD:
- XGM signals were monitored when SA1 went to 5keV for a short time yesterday night. No issues were observed.

DET:
- SCS made an OCD call on the DSSC which has been fixed.
- Agipd issue: under investigation together with ITDM (a ticket was opened to ITDM). This is not a calibration issue. 

ITDM: 
- ITDM will follow on the Maxwell issue with Agipd. 
- CTRL and ITDM working and progressing on the bunch patter issue.

XRO:
- Issue with SA1 solid attenuator: same behavior can be expected also in SA2.
- Mirror inspection in XTD2: it shows no big damage on it. A full service will be made later. Next Monday inspection on XTD10 mirror to understand situation.
- Meeting to investigate possible upgrades to drive motors faster will take place. Participation of CTRL, DA and instruments.

LAS:
- Nothing to report.

UNSYS:
- Suren K. informs Beckhoff Hardware for cell#31/SA2 was received and is under test. As soon UNSYS is ready for a ZZ it will inform PRCs for scheduling a date. 
Mostly likely ZZs will occur on Tuesday and not Monday due to continuation of 11.5 GeV studies. 
- Communication problem with one undulator on Monday was quickly fixed.

SPB:
- Working on nano KB mirrors.
- 5 keV last night: gives right trajectory. It looks like the beam performance was sufficient for SPB alignment. Fine tuning has to come.

FXE:
- Affected by the shutter problem during the tentative ZZ access yesterday.
- Solid Attenuator issue in discussion with EEE.
- Sampling rate of ADC has changed. Peter Z. contacted EEE and it has been accessed.

MID:
- Not present.

HED:
- User experiment ongoing.
- Some stages worked intermittently and has to be investigated (related to crystal alignments).
- Pulse picker is not behaving correctly. It may be a Hardware issue and has to be investigated. Then HED will communicate to EEE.

SCS:
- PP laser was down last night and the OCD was contacted. There is the suspicion the crystal is damaged and the OCD informed it will be fixed this morning. 
Daniel Kane will try to get some info inside LAS and report back t SCS.

SQS:
- It has users this week and shutter becomes a serious issue. In Karabo the shutter state changed but it is disconnected. It is not clear if the ZZ team is progressing 
right now.
- Problem is that when trying to close the shutter via JDDD interface it went to an intermediate state but shutter did not close. 
This cause interlock not opening the hutch and the beam could not be sent to the hutch. No beam since 5PM yesterday. Also locally operated in the panel it does not work. 
The JDDD interface worked nicely the whole last week. Eric Boyd asks if problem appeared at the first operation. Tommaso M. says they did a lot of times prior having this 
issue.
- Waiting for updates from CTRL mentioned.
  160   14 Sep 2020, 15:34 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 14.09.2020
General Announcement:
- None.

CTRL:
- CTRL will deploy an update on time server configurations for SA1 and SA3. Bunch time decoders will be down during few minutes.
- SPB and SQS reported during the weekend they do not have pulses per train correctly presented. This relates to the update on server configurations. CTRL is looking into 
it with SPB today.

DA:
- Minor OCD calls during the weekend with no severe issues.

EEE:
- EEE works with SPB on configurations of motors (in general with several other instruments).
- Looking into XPD issues.

VAC:
- It notices quite often one has to restart C++ servers due to communications issues. CTRL and EEE are investigating: it does lose connection and then does not properly 
restart. 
PLC continues running in the background. CTRL recommends restarting CPP server as workaround. 

XPD:
- XGM in SA3 shows not accurate number of trains per pulse. First pulses of a train were missing. It will be followed up with CTRL and SQS.
- There is an agreement in how to enable the 5keV operation. Instruments shall be aware of ahead planning when changing photon energies (band region of resonances which 
requires exchange of gases). 
In general SA1 and SA3 instruments are aware.

DET:
- Working on calibration issues.
- Problem from SCS with Karabo device going in unknown mode has been under investigation.

ITDM: 
- Comment to DET: it has been understood issue with Maxwell nodes last week - jobs running and certain nodes were in bad state. It was a particularity of the 
configuration. This affected the calibration. 
- Bunch pattern issue: we were communicated around 2AM on an issue that data recording was not the same as the scene. ITDM asks for communication of major issues must be 
done in earlier times when experts are around. 
XO will talk with CTRL and ITDM, as well as SQS.
- exfelgateway and Karabo installation: we will move today the installation. Link will redirect to the next location. No changes in how to start Karabo GUIs.
- Tomorrow a maintenance affecting Oracle databases will take place from 7AM to 1PM. For example, DACHS/DARF, UPEX will be down. 

XRO:
- Nothing to report.

LAS:
- Nothing critical to operation to be reported.

UNSYS:
- Beckhoff terminals for the cell31/SA1 are ordered. Components are to arrive.
- Problems with SA1/cell7 yesterday have been fixed.

SPB:
- Hardware exchanged late Friday and during weekend.
- Bunch pattern recording issue was discussed with CTRL last week during the day. It is of importance to correlate the data with number of bunches.

FXE:
- Minor issues with components motors: when pressed step up /step down in the motor, the Karabo interpret that we pressed twice. It is not critical but annoying. Issues 
are related to MC2 motors. 
CTRL will get in touch with EEE in an offline discussion. Issue has a different nature compared to the HED problems with motors.
- Tests on Monochromator show energy drifts. For long range scans one has to correct manually the calibration. FXE will report to CTRL today or tomorrow.
- Friday beam instability due to horizontal jitter: FXE took some data and will communicate. 

MID:
- Number of bunch train issue was also observed.
- Train IDs going to AGIPB are correct and verified.

HED:
- CRL must be investigated (motors). It moves one way but not for backwards.
- We made a ticket for Mono1: problem came up again during the weekend.
- EEE wants to make uTCA installations (after HED request) on next Tuesday. HED and EEE will discuss a suitable time together.

SCS:
- Issue with DSSC mentioned by DET.
- Nothing else to report.

SQS:
- Issue in past weeks: shutter does not respond but it seems to be working now. F. Wolff-Fabris will ask the Desy colleagues for an update on the situation.
  159   09 Sep 2020, 10:10 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 09.09.2020
General Announcement:
- XO reminds the groups to please inform staff to check for self-rescuer training date in the DACHS system. In case this is expired please contact Michael Prollius or SRP 
group.
- Martin Dommach informs fthe access rights to the photon tunnel and accelerator has also expired for several people in August. Please check that.

CTRL:
- Yesterday evening XPD informed on an issue with Karabo GUI for exflgateway. It has been under work. LAS has a work around. CTRL encourages to do not work until it is 
fixed (likely in the next 30 minutes).

DA:
- Nothing to report.

EEE:
- Nothing to report.

VAC:
- Nothing to report.

XPD:
- All is fine. XPD asks CTRL to please send instructions to bypass the Karabo GUI issue mentioned by CTRL. CTRL says it will be fixed in next 30 min.

DET:
- OCD call yesterday has been solved. 

ITDM: 
- Video conferencing system is on the HED control room and under test.

XRO:
- Maintenance in SA1/M3 mirror for Tx spindle took place on Monday as a ZZ. Mirror/spindle seems fine and we did maintenance without affecting mirror position or 
settings. 
XRO waits for spare parts to be delivered for additional maintenance.

LAS:
- SA1 and SA3 lasers are in operation; SA2 laser is in maintenance.

UNSYS:
- Problem with SA2/cell31 is serious: the complete bus terminals are damaged in the rack. Currently SASE2 works up to cell 31.
- New set of terminals is needed from Bekhoff to replace the full instance of the rack. Suren K. will inform on updates/status and when parts arrive for asking tunnel 
access. 
The old ZZ request is still valid. Order will be placed soon and Beckhoff promises delivery in one day after receiving order. 

SPB:
- Minor Problem with one motor but it is under investigation. 

FXE:
- Problem with a motor: EEE is informed and today they will check it.
- Andreas G. asks if FXE sees changes on mirror positions due to Monday maintenance. Martin K. will inform the group to verify during the night shift.

MID:
- Not present.

HED:
- M3 re-alignment is very good. HED get the first Mono aligned and continues today with preparations/alignment. 
- Thomas Preston says issues with a motor stages is under investigation (it worked in the past).

SCS:
- Yesterday morning machine had tuned beam to SCS photon energies. Somewhere this has been lost and SCS and BKR had to do it again on the afternoon. PRC will investigate 
with RCs.
- Smaller issue: For 2x already there is an issue with pulses that DSSC send to online read (sometimes we get only 8 pulses). 
DA states it is related to the calibration pipeline when this is reset (default is 8). 
One has to change/correct manually in the config manager. DET asks SCS to place a ticket for the support. 
SCS plans to use DSSC for user experiment this week. It is not critical issue but it would be nice to fixed for once.

SQS:
- Preparing for user's time on next week. SQS has commissioned the Monochromator with grating for the first time. 
  158   07 Sep 2020, 14:37 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 07.09.2020
General Announcement:
- XO thanks instruments and support groups for using the E-logs while reporting activities. Please place names and groups in the entries to make a follow-up easier.

CTRL:
- SA3 vacuum loop is recovered.
- Today afternoon we want to move SA1 gui's to a more powerful server. If someone has an issue please contact CTRL.

DA:
- Not present.

EEE:
- Tests for MID to take place this afternoon.
- Cabling activities are ongoing.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- Nothing to report.

ITDM: 
- The video conference system needs to be tested in the control hutches. ITDM wants to set procedures with WOCO and also mounting it in experimental hutches. 
Instruments that are willing to help with the test can contact ITDM. The idea is to test in a Linux machine and test with remote users. SQS and HED are initially 
interested. 

XRO:
- Not present due to M3/SA2 re-alignment.

LAS:
- SA2 updates must be done by the end of today.
- SA1 and SA3 must be operational by the end of the day.

UNSYS:
- Requested ZZ to go to tunnel to fix communication issues with SA2/cell31. PRC arranged with RC to take place this morning.

SPB:
- Preparation for a couple of experiments next weeks.

FXE:
- Nothing to report.

MID:
- All fine at MID: checks with EEE to be done this afternoon and on Wednesday.

HED:
- Preparing M3 and other internal activities for user run next week.

SCS:
- Users will have beam time this week.
- SCS asks on the time window: Andreas G. says it is typically 400us but one can find in the delivery tables. 
If instruments request for more, please communicate to XO and OB will discuss it together with RCs.

SQS:
- Preparing next beam times.
- Shutter remote control: waiting for an update.
- Absorber in SA3 is currently in an unknown state. Nerea J. will check with Maurizio V.
  157   02 Sep 2020, 13:33 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 02.09.2020
General Announcement:
- If instruments find the machine is not performing as you expect when comparing to previous weeks, please contact PRC that he may help you to address it. 
This is also valid for changes of beam parameters if not previously reported in the operation tables. 

CTRL:
- CTRL is supporting the ongoing Laser installations. 

DA:
- Nothing to report.

EEE:
- Fast ADC in HED: this is solved. The only limitation is if the system is restarted the ADC is misconfigured. In this case please inform EEE for loading the 
configurations.
- SCS switch issue is also fixed.

VAC:
- Working on the M3/SA2 mirror. Mechanical problems were fixed by XRO. Leak test ongoing and closure of the tunnel afterwards. Beam can be back to XTD6 this afternoon.

XPD:
- Nothing to report.

DET:
- Nothing to report.

ITDM: 
- No big announcements at this moment.

XRO:
- M3 mirror: mechanical axis was disconnected and mirror was not moving. XRO and VAC fixed the problem. Hopefully beam can be injected to XTD6 this afternoon. 
- It was chosen not open the full chamber to make the repair in 2 days' time. As beam is there XRO will re-align mirror. Cooling system is disconnected.
- After closing tunnels, it will allow beam in MID certainly and to HED we will look after the re-alignment of the mirror (to be scheduled). Maurizio V. is open to 
clarifications/discussions.
- Ulf asks on the plans for re-alignment of the beam: Maurizio says either after the Self-seeding on Friday or on Monday.

LAS:
- Upgrades are ongoing in all lasers: a bit behind schedule.
- SA1: ADC has to be serviced by EEE; SA2: delays due to microTCA.
- SA1 and SA3 shall be available tomorrow afternoon.
- Tests with HED laser pattern on demand: LAS demands to be included in discussions for October use of PP-laser. Synchronization must be developed to run properly.  LAS 
can't guarantee it will work from the first try.
- Cw37: SCS needs laser, as well as MID has preparations. LAS states both lasers shall be back in operation on THU afternoon shall be available.

UNSYS:
- Nothing to report.

SPB:
- Getting ready for test experiments and commissioning.

FXE:
- Nothing to report.

MID:
- Setting up for user experiments.

HED:
- Waiting for M3.

SCS:
- SCS/XGM presents issues with interlocks being activated due to pressure levels. This required intervention from expert. 
If this happens in the middle of the night, SCS proposes to develop an automated way to reset it or to be trained by XPD experts. XO, SCS and XPD will follow up. 
- Extra-foam: SCS asks on the possibility for access to remote users. DA says is under discussion between DA and ITDM to extend the service but no decision has been made. 
It will anyway need access to online clusters.  

SQS:
- Not present.
  156   31 Aug 2020, 11:31 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 31.08.2020
General Announcement:
- XO reminds every day at 15:00 there is an informal BKR chat where one might get interesting news and ideas. If you would like to join, the link appears in the BKR e-
log.
- K. Wrona asks instruments if there are things to be improved regarding remote user communication or process, please send suggestions and/or comments to him/ITDM.

CTRL:
- Electronics team is installing new digitizer with LAS group.

DA:
- Nothing to report: OCD was quiet during last week.

EEE:
- Fast ADC system issues: problem with HED hutch. Signals were not properly given due to wrong configurations. It has been solved.
- All XPD systems had same issue: last Karabo update had a default address wrongly set and was the cause for reading wrong numbers. 
This was solved with help of CTRL but one crate remains to have the ADC card re-started, probably today. 
- SCS auto scanner: suspicion links to the loop that runs the motor is not fast enough.
- SCS and SQS have cabling installations planned for this week.
- Theo M. asks which ADC had a train-ID issue. Patrick G. answers that looks the XTD10, crate 3.2. It has been taken care already.

VAC:
- PRC contacted VAC on Thursday with XGM in XTD1: faulty pump that survived the weekend. VAC will exchange it today.
- HED problems with M3: VAC and XRO are working on it now and it probably to exchange an spindle or mechanical structure.
- SCS GATT stopped working on Saturday: power glitch caused a long shutdown of cooling water that switched OFF pumps and GATT.

XPD:
- Restarted XGM; also SCS XGM had a faulty gauge.

DET:
- Nothing major: Detectors were working during the weekend.

ITDM: 
- Not aware of any major issue.

XRO:
- M3 issue: mirror looks fine but the mechanical structure to move the mirror horizontally failed. Mirror surface looks mostly fine, only one InGa drop is seen. 
XRO and VAC are in tunnel to try to make it a fix now. There may be also a problem with Platinum coating if drops of InGa are on it.

LAS:
- SA1 laser will be down for the entire week for exchanging parts.
- SA2 laser uTCA update today: shall be back on Tue/Wed;
- SA3 laser issues with Amphos are being exchanged/fixed. Probably by WED afternoon this laser is back.
- Upgrade of control PCs ongoing this week.
- LAS states SA3 laser is planned to be available tonight.

UNSYS:
- Yesterday night a problem in one cell in SA1: fixed today in the morning and is fine.

SPB:
- No major issues during the week.

FXE:
- Continuing with commissioning this week. 
- Helium supply was exchanged yesterday during the weekend. 
- FXE also says they had remote users and process/communication worked nicely.

MID:
- Would like to remind about the bunch train-IDs. MID need feedback to inform users who have experiment in two weeks.
	
HED:
- Stopped operation On Friday night due to M3 issues: photon beam can not be directed to HED.
- Problems with ADCs and controls last week: help was received.

SCS:
- Not present.
- Remote experiment also seems to have worked.

SQS:
- Remote shutter control seems that worked once but no reasons/correlations were observed.
- Experiment with remote users worked nicely.
  155   26 Aug 2020, 13:49 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 26.08.2020
General Announcement:
-  XO is looking forward to receive today the Delivery and Operator tables from the instruments.

CTRL:
- CTRL has carried out the time server deployment with newest version for devices and upper channels. 
- Nothing else severe to report.

DA:
- Working with HED on recording data - ongoing today.
- K. Wrona states that should be treated as experimental issue. An offline discussion will take place in defining how to interpret and run in the proper way.

EEE:
- The implementation of SA3 pre-absorber into the Interlock system was done, tested and it is working.
- 

VAC:
- Systems are running well.

XPD:
- Graphite filter in SA1: SPB has checked and found out the graphite filter is not damaged. The crack related to an attenuator. 
XPD will find an agreement/compromise for operation at higher energies when filter is retracted due to the wave-front distortions for the hard X-ray in SA1 and SA2. 
XPD needs more info from instruments. Discussion will follow.
- XGM resonances: a clarification is made that no matter which gas it is there is a resonance. Exchanging gases requires XPD to make an intervention for about 1 hour.
This has to be taken into account when, e.g. SCS and SQS require such changes.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- The Karabo GUI for SA3 is redesigned due to the presence of the pre-absorber. XRO will be happy in hearing comments and suggestions.

LAS:
- All Laser working accordingly to the specifications.

UNSYS:
- All is fine.

SPB:
- Operation going fine.
- Timing team found 2 issues: 1. Pulse pattern recording device seems not be synchronized with train IDs of other devices; 
2. Bunch arrival timing monitor has 25% repeated data (they have the same time stamp but different train IDs). 
K. Wrona says this may indicate there is no data. Robert Schaffer states the bunch arrival had no changes, so it seems to be another issue.

FXE:
- Starting user experiment and all going fine; pump probe signal seems good and FXE thanks LAS for fixing it yesterday; Digitizer issue was resolved by CTRL yesterday.
- Bunch arrival monitor is also repeated showing same numbers for the different trains.

MID:
- All fine.

HED:
- DAQ tests ongoing.
- The Shot on demand for laser stopped working at 3:00AM today (BBP signals). It seems to be a PPU problem. Nerea J. will contact T. Preston to look into it.
- Trying to get the A0 monitor working. After restart uTCA it solved one out of 2 problems. HED need someone to look into it onsite at the instrument.

SCS:
- Issue with pop-in imager last night: not allowing interlock. It has been under work now and is a similar issue as the SQS pop-in last week. This time it is the SCS-
XTD10 Pop-In IMG-PI (type I).
- Reducing SA3 bunches number were affecting SA1.

SQS:
- Nothing to report. All good so far.
  154   24 Aug 2020, 11:39 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 24.08.2020
General Announcement:
- The safety rules require the use of masks when moving around as well as the limitation on the number of allowed people per room. 
XO asks people to stick to rules of 1 person per office as well as using masks when working closely. 

CTRL:
- Few minor issues during the weekend. Major one related to SQS optical spectrometer which did not reach 10 Hz.
- Today an upgrade in the archiving system will take place. The update of timing servers for all SASEs will take this afternoon. 
The property “bunch pattern table” will not be filled anymore.

DA:
- Few OCDs calls were all manageable. DA reminds instruments and groups to let system online to be monitored.

EEE:
- One OCD call during the weekend.
- Cabling with Detector group to happen.
- EEE asks if the SA3 interlock/pre-absorber will be tested today.

VAC:
- Nothing to report.

XPD:
- There was a problem with XTD2/SA1 graphite filter accordingly to Operation E-log entry. Maybe it got damaged between 20. and 21. This will be further investigated 
between XPD and SPB/SFX.

DET:
- 1 OCD call which was easily solved.

ITDM: 
- Friday the Scratch system (for temporary data) was out of space and data were removed (70Tb). It may be a problem again and ITDM would like to remind people to keep 
data only for short time. 
There is 1.5 Petabytes storage with currently only 60Terabytes free space.
- An e-mail about this issue was sent to a distribution list stating that from 01/09 data will be removed. ITDM asks people to clean their data in the proposals 
directories. 

XRO:
- Preparing for ZZ accesses in XTD2 and in XTD10.

LAS:
- SA1 laser is temporarily fixed with stable operation during the weekend. It required changes in software. This PP-laser is working and further exchanges are postponed. 
- LAS reminds that OCD calls regarding timing synchronization between laser pattern and beam must be addressed with CTRL OCDs.
- Jan G. offers assistance with 5Hz operation on diagnostic cameras. A. Galler suggests to include also EEE and CTRL in discussions.

UNSYS:
- Nothing to report.

SPB:
- Graphite issue: inserted on Tuesday for 15 keV and was in the beam for 4 days until Saturday. J. Gruenert says this is not wrong. An e-log entry was done by Romain 
Letrun.
- 1MHz images in camera worked during the weekend.

FXE:
- Issues: 1. Electron bunch arrival monitor recording did not work; 2. When SASE3 changes to many bunches, then FXE sees decreased intensity; 3. PP-laser seems not 
suitable for our operation. 
- For #1, ITDM will have a look in it; For #2, this will be discussed with machine; For #3, further discussions will happen in separate meeting.

MID:
- No issues: Split delay line is under commissioning. It was quite successful week.

HED:
- Successful week.
- The shot on demand feature was tested with EEE and CTRL.

SCS:
- Issue with saving sample position.

SQS:
- SA1 and SA3 interactions: FXE suffers when we have many pulses. M. Meyer proposes to have discussion with machine. 
A. Galler proposes to discuss during the machine meeting at 10AM and asks for additional info per e-mail.
  153   19 Aug 2020, 12:08 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 18.05.2020
General Announcement:
- A. Galler reminds the audience on the daily informal BKR chat taking place at 15:00: link was sent by e-mail. 

CTRL:
- Tests on the HED bunch patter / 5Hz were done yesterday;
- Five devices related to the timing server will be re-started on Monday. This update of timing server shall be transparent.
- Other requests will be discussed separated in another rounds with respective involved groups.
- For Laser switch between SCS/SQS please call LAS OCD for troubleshooting (experts mean faster solutions). 

DA:
- DA reminds the group on its Redmine ticketing system that was implemented in February and helps on the planning and scheduling of activities. Instruments are encouraged 
to use the DA ticket system.

EEE:
- Initial test with HED 5 Hz pulse on demand went successfully yesterday.
- Missing crate in HED will be installed.
- SCS installation of cables will be done. 
- The special trigger for overlapping bunch in SQS was fixed this morning. CTRL was asked to prepare another parameter in Karabo. 
This shall be OK and tomorrow it shall be fine to use the adjusting the timing. S. Hauf points a device has to be adjusted. 
- A. Galler informs the tentative date for the SEPS update will be next Monday. 

VAC:
- ZZ done on Monday to check status of SA3 devices.

XPD:
- X-ray PES undergoing tests at Petra-III / Desy.
- A SQS pop-in could not be driven out of the limit switch this night. This was solved in the morning (back to work) and it was related to a problem with motor counts. 

DET:
- Preparation for user run at SQS: still some data to be taken with DSSC but it has been under work.

ITDM: 
- Together with CTRL and DA, it was set dedicated server for logging in to get more insight in the experiment. 
- In the main page of user proposal there is a permanent Zoom link to be used for communication with users. It stays for 2 weeks: SQS is working and other two experiments 
will be set today.
- In addition each experiment will have a dedicated zoom room.

XRO:
- SA1 M1 continues stay in place. By the other side, XRO would like to ask for a ZZ to complete the chiller level.
- Interlock tests in SA3 did not happened (changing of Interlock from GATT to pre-shutter) Z. Ansari informs that from her side it can take place on Monday 24th.

LAS:
- SA1 laser: the front-end is switching off in regular base (3x since Monday). There is not enough power for experiment. 
Meeting with manufacture take place today at 10 to build strategy to investigate and decide next steps. LAS will inform next steps. 
PP-laser is expected to be working for this and coming weeks. 
- SA3 Amphos: it can be operated. A final fix will be done in the in next blue weeks or during winter shutdown. 
- SA2 laser is fine.

UNSYS:
- Nothing to report.

SPB:
- Working on CRL alignment and also testing of camera. 
- Some alignment activities were interrupted due to the Laser issue. At 20% lower energy, it is not enough. Impact on commissioning if laser is not back may affect user 
experiments later. 

FXE:
- Nothing to report.

MID:
- Commissioning of the split delay line: lower branch is successfully done.

HED:
- Setting up for experiment; few issues with diodes.

SCS:
- Nothing to report.
- XO reminds the protocol to increase bunch numbers out of what is agreed on the delivery tables: 1. try to discuss with other experiment first; 2. call the PRC.

SQS:
- The zoom account was tested last night.
- Meeting with DET today. 
- All are going fine.
  152   14 Aug 2020, 10:40 Andreas GallerGeneralInformationNotes XO Integration Meeting 17.08.2020
General Announcement:
- An informal Run coordinators' BKR chat to exchange ideas happens every day at 15:00. 
It is a forum in case technical and scientific people wish to make formal requests. XO will send an e-mail with Zoom link.
- XO would like to ask instruments to pay attention to the parameters of the Delivery and Operators table, especially regarding the bunch limits for the North branch.
Ideally we shall discuss one week before beam delivery.
- H. Sinn notices that if SPB move some motors, this is temporarily cutting SA3 beam due to MPS. SQS has not observed this effect. Harald will further investigate. 
Adrian M. says SCS impacts SPB in different ways.
- A. Galler mentions that SRP/task force will distribute updates related to the currently raising Covid issues.

CTRL:
- One group of motors at the same SCS/PLC was not accepting changes. A re-start with servers in small loops must help.
- Timing servers (switching off archive): CTRL wants to perform today or tomorrow morning the installation of the new version. Nobody seems against it.

DA:
- Nothing to report.

EEE:
- EEE understand the team request regarding the 5 Hz trigger will be done tomorrow.
- EEE waits for confirmation of SEPS update, possibly happening today or tomorrow. XO mentions Z. Ansari will be able to confirm today after lunch time.

VAC:
- Nothing to report.

XPD:
- Not present.

DET:
- XO inquires on the DSSC activities in SCS: DET says it may be delayed a bit due to other activities; DET got a ticket regarding operation; DA believes the DSSC was 
running and used.

ITDM: 
- Comment on DSSC: it was used but we shall not forget that on the first day there was not a preparation and we could expect hiccups.
- A faulty memory module must be replaced and the exflgateway will be shut down shortly for this activity at around 12:00. An e-mail will be sent but nobody seems against 
to it. 

XRO:
- Nothing to report.

LAS:
- SA3 AMPHOS photodiodes still has problems. System is partially working and can be operated. LAS knows beam size and pointing do not change but not if loses power. 
AMPHOS is contacted. 
The consequence is that switching ON and OFF takes more time because it is done manually. Further measurements will be done and SA 3 instruments will be updated 
accordingly.
- LAS informs its OCD team is not responsible for synchronization issues. 
- SA1 and SA2 lasers are fine.

UNSYS:
- Small issues with SA3 PLC crashes: SA3 is operated without first cells. A re-start of the servers is needed, probably today or tomorrow. UNSYS will inform SCS and SQS 
when this is fixed. 

SPB:
- Nothing to report.

FXE:
- FXE says that SQS will need to perform some tests: this will be discussed in separate round.

MID:
- All fine.

HED:
- Data recording on Saturday night was not saved. Shift crew realized at the end of the shift that it was not saved - main data for the shift. 
- ITDM investigated the issue after ticket arrived yesterday. It confirms data was not recorded and can't see why this happens as ticket arrived late. Even the folder of 
the data was not recorded. 
For the future: there is an assumption to look at the data every few minutes. ITDM will share procedures. Further discussions on flexibility for different systems/setups 
have to be done.
- HED says the 5Hz test must be tomorrow by the morning. XO states that currently this is only a test then we will see what happens. HED has this understanding.
- HED has recorded several hundreds of microns in horizontal jitter. XRO says that it is important to work together for investigating the jitter. 
HED will send the data to XRO and/or the coordinator of stability task force.

SCS:
- Not present.

SQS:
- Preparing next week user operation; still some problems with Zoom connection: SQS and ITDM will discuss the issue.
  151   12 Aug 2020, 10:52 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 12.08.2020
General Announcement:
- Andreas G. thanks all instruments that have so far sent back to XO the cw35 Beam Delivery tables and reminds the missing ones to do so until Thursday (tomorrow).
- Jan G., as PRC, informs the access to SQS shutter will probably happen on next week. In case of possibility during this week he will directly inform the respective persons.
- Steve A. mentions on the timing related issues: it has been investigated with the help of instruments.
- XO asks groups for any time feedback on issues related to Covid rules, e.g. amount of masks. 
- Jan G. informs several members of XPD team (and also CTRL and ITDM personnel) will be working at PetraIII while performing beamtime, from Thursday until mid-next week. 

CTRL:
- Activities on GATT: Follow-up of Karabo update shows incompatibility with new version. CTRL, Raul and XO rolled back to the previous version and it works again.
- At around 8:00pm a notification service in SASE3 was sent: watchdogs went in unexpected state.

DA:
- Nothing special to report.

EEE:
- Today we bring back the crate for MID/STL and we start with HED requested changes.
- XO thanks Nerea on yesterday's work of Interlock conditions for the solid attenuators in the tunnels. 
To protect the silicon screen first one has to insert the diamond screens. Nerea J. says this is in the motion loops and not EPS.

VAC:
- Raul V. thanks for the quick reaction of CTRL and XO to solve the code of GATT (which is 2.5years old). 
If we have a chance during the next winter shutdown a change on the software system will be planned to permit the use of new Karabo versions.
- VAC has requested a couple of ZZ's for next days/weeks: on SQS shutter and other devices inspections.

XPD:
- No incidents since Monday to be reported. However, last Saturday there was a downtime on the XTD1/XGM due to a high voltage setting. 
Probable cause was a wrong command at the DOOCS server. XPD believes it was a onetime incident and will look into it if it happens again.

DET:
- Working with Jungfrau in SPB; DSSC in SQS/SCS.
- Supporting other groups' activities.

ITDM: 
- The DAQ update has been finished: so far it looks good.
- ITDM is ready to act but waits for more clarifications on the SRP requested work on Interlock. 

XRO:
- Not present - group has helped with solid attenuators activities.

LAS:
- Everything is running and interlock is set.

UNSYS:
- Nothing to report.

SPB:
- Detector program ongoing with Junfgrau and AGIPD.

FXE:
- A ZZ was done to switch off the M3 cooling. The jitter has then reduced from 295u (RMS) to about 211u. FXE considers this only moderate jitter and will proceed with commissioning.
- Feedback system is fixed with parameters configurations – we are following it up to find when this was changed (if so).

MID:
- Issues with feedback Macro are observed and Robert S. investigates together with MID.

HED:
- Not present.

SCS:
- Not present.

SQS:
- Nothing to report.
  
  150   11 Aug 2020, 11:01 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 10.08.2020
General Announcement:
- Beam delivery starts this week. XO reminds the reason to send the Beam Delivery table is to provide machine with parameters. Please take in mind that we shall not fill 
out tables during Friday's UOM. 

CTRL:
- Two configurations changes planned for today if agreed: 
1. In SA3 machine changes the 10Hz and may affect the archiving. This means time serving in Karabo has to be changed during the day today; 
2. CTRL updated last week most of Karabo devices in instruments, but few tunnel instruments remain and shall be done today - few time down and then re-starts.
- HED issues with VAC/SA3 have been investigated together with EEE.
- InfluxDB update was done and OK.
- LAS comments a laser pattern is required in order to compare laser status between different runs. Follow-up discussion with beamlines, LAS, CTRL is needed.
- AG asks if SA2 and SA3 are aware of the 5Hz operation mode. Tomasz from LAS says all servers see the bits are changing. 
- Steffen concludes that CTRL will proceed with updates today and by next Monday CTRL will switch on the archive again with the solution we will have by then. 

DA:
- Nothing to report.

EEE:
- Taking out crate of MID; making changes on the request of HED.

VAC:
- Nothing to report - all running.

XPD:
- Nothing to report.

DET:
- Not present.

ITDM: 
- DAQ recent bugs were mostly fixed: today FXE and HED will be fixed. Afterwards all are done.

XRO:
- Nothing to report.

LAS:
- SA3 laser had a probably on Saturday: warming up devices. LAS may be able to fix today (Sunday's effort did not work).

UNSYS:
- Issues in SA2 with cells #1 and #33 have been fixed by ZZ on last Wednesday.
- Also hardware problem in SA3 cell#14 was also fixed.
- Software development in response to MXL complaints is under work and needs a maintenance and/or shutdown time. 

SPB:
- Nothing to report.

FXE:
- Meeting with EEE to look in the digitizer - issue could be solved, it is now running stably.
- Used Beam feedback to stablish the beam position was not working reliably: spontaneous jumps were observed. FXE will look together with CTRL on Wednesday. 
One idea is to pick beam position from imager. No other instruments have this observation.

MID:
- Synchro will arrive today and thus SA2 laser will not be available.
- Train matching offset between AGIPD and XGM reported two weeks ago: MID is asking for an update. SA will check today and give information on Wednesday.

HED:
- HED had problems with MC2 axis in Beckhoff motors during last week and asks to have a follow up from EEE. Events of losing parameters are happening quite often.
- Karen A. mentions they added manually parameters and they had to reset again. HED-LOOP1 will not be reset today (Steffen). SA2 loops will have to be checked. 
- Steffen and Marijan add the issue is now understood by sacrificing one of the HED PLCs. One has to fix the code of the framework and this can't be solved by Wednesday.  

SCS:
- Motors of the DSSC support were also lost. They have been fixed.
- Issue with pump is also solved.
- New installed devices during shutdown (pressure gauges) were tested on Friday.

SQS:
- Not present.
  149   05 Aug 2020, 09:02 Andreas GallerGeneralInformationNotes XO Integration Meeting 05.08.2020

General Announcement:

  • .

CTRL:

  • SA3 vac loop
    • devices lose connection to the PLCs every now and then (every few days)
  • karabo fix for small movement error on MC2 motors
    • for the tunnel topics CTRL suggests to do that Thursday morning
  • InfluxDB

DA:

  • no issues
  • upcoming commissioning
    • da infrastructure up and ready

EEE:

  • cw36, cable installations require

VAC:

  • no issues, normal activities

XPD:

  •  

DET:

  • no issues

ITDM:

  • continuing with Monday tasks

XRO:

  •  

LAS:

  • increas priotity on karabo integration for lasermet interlock
  • SH: for SA1 and SA2 much of the interlock data is

UNSYS: 

  • today ZZ --> cell 33 should be fixed today as well as cell1

SPB:

  • nothing outstanding
    • DAQ testing
    • VAC intervention

FXE:

  • FXE and XRO is switching off M3 cooling
  • no update on the digitizer issue

MID:

  • no issue

HED:

  • MC2 motor timeout problem, karabo fix seems to work
    • there are other time out errors that ar not addressed by this
    • SH: suggests a zoom session for demonstration of these
    • TP: e.g. stop button gives time

SCS:

  • no issues
  • installation of girder
  • bestec is working on hRIXS
  • recommissioning of Mono

SQS:

  • laser interlock issue
    • Lasermet is visiting today

ELOG V3.1.4-7c3fd00