Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Technical integration and coordination logbook, Contact: A. Violante, G. Wellenreuther, Page 16 of 29  Not logged in ELOG logo
Entry   Notes XO Integration Meeting 10.11.2021, posted by Frederik Wolff-Fabris on 10 Nov 2021, 10:16 
General Announcement:
-	 

CTRL:
- Issue with mc2 motor (pop-up issue for step-up command): it has been identified and fixed. New version will be deployed in the shutdown. Workaround until then is to stop and restart device.

DA:
- On the slow migration/calibration at MID: it is understood as overload of cluster nodes responsible for migration; mitigated by adding two more nodes. Calibration services shall run better from now. 

EEE:
- Drifts with SQS digitizers: yesterday Bruno F. was working on it and it shall be fixed now.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- Nothing to report.

ITDM: 
- Nothing else to add apart of DA report - still more investigation is ongoing.

XRO:
- Nothing to report.

LAS:
- All fine with lasers.

UNSYS:
- In SA3: two encoders that were exchanged (cell#17 and cell#20) on Monday's ZZ. 
- Another PS (SA3/cell21) stopped working. Motor has to be replaced in a next ZZ (request placed). 
Suren K. also says that the whole intersection is not working (not able to recover after restart the system - Quad stays in position for operation). 
- SA1/cell14 a coupler of the undulator terminal was replaced.

SPB:
- AGIPD issue also observed last week and is under investigation. DET is aware and under investigation.

FXE:
- Nothing to report.

MID:
- Issue with calibration: MID would like to test it in order to close the review.

HED:
- Running user experiment this week.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 08.11.2021, posted by Frederik Wolff-Fabris on 08 Nov 2021, 10:07 
General Announcement:
- During the weekend there was a cryo plant failure which caused more than 30 hours downtime. This was due to the cold compressor failure on Friday evening. 
Machine work hard to get back in operation and Sunday by 06:00AM beam was available to the experiments.
- Chris Y. asks if FXE had used the PAM. It seems not to be the case due to the beam downtime. C. Youngman will contact Yifeng J.

CTRL:
- Nothing to report.

DA:
- DA is interested on the MID migration problem (discussion is following below).

EEE:
- Problem with SQS digitizer regarding a drift when looking into pulse laser pattern. Problem seems to be coming from the source; to be further investigated;
- Beckhoff PLC at SCS had a problem and will be investigated today.

VAC:
- No issues to report.

XPD:
- This week XPD will measure at HED with the calorimeter.
- XPD needs confirmation from MID if Diamond detector was used at MID.

DET:
- Few OCD calls related to the AGIPD operation support.

ITDM: 
- The MID issue seems not be linked to migration in a first analysis. It may relate with calibration. Queue was busy as many experiments taking data simultaneously. 
By the other side, there were no indications of calibration being used. Today the migration was running normally.

XRO:
- Nothing to report.

LAS:
- Not present.

UNSYS:
- Another Phase shifter (SA3/cell20) presented a problem like the cell17. Waiting for getting access to fix and investigate the encoders. ZZ is scheduled for this morning.

SPB:
- Problem with AC unit at the laser hutch. TS was called onsite during the weekend and it was solved.

FXE:
- Nothing to report.

MID:
- Issue with data processing last night: if it looks good for IT and DA, then MID is relieved.
- Diamond detector use: looks reasonable and data was taken. The final analysis has still to be seen.
- MID refers that it was positively impressed how fast the seeding was brought back after the cryo failure.

HED:
- Nothing to report.

SCS:
- EEE got a call about scanner-y motor. A problem with cable was found and it was exchanged on Sunday morning. Since then it appears to be solved.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 03.11.2021, posted by Frederik Wolff-Fabris on 03 Nov 2021, 10:12 
General Announcement:
-	 

CTRL:
- Nothing major to report.

DA:
- Nothing to report.

EEE:
- Nothing to report.

VAC:
- Not present.

XPD:
- Nothing to report.

DET:
- Issue concerning AGIPD cooling system at MID being not very effective: there is ice formation which stopped the flow of water. This already happened once but it is not so often. 
Fix consists in flushing with dry air. Later today Detector will be running again. 

ITDM: 
- Fire incident yesterday on the labs (ITDM/EEE) was caused by a broken cooling system; the lab cooling water did not work for hours and let to problems with GPFS system in the lab as well as with servers 
(same type of racks as the ones in the rack room). 
- ITDM suggests the handling of such alarms have to be improved.

XRO:
- Nothing to report.

LAS:
- Nothing to report.

UNSYS:
- Issues with SA3/cell17: Phase shifter can not move. After rebooting PLC system one had to power cycle leading to lose half the SA3 undulator system. 
A ZZ was done to recover downstream cells but finally the encoder of the PS motor is found damaged and need replacement. A request for access is created and is needed 4 persons for 2-3 hours.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- All fine apart of the mentioned Detector issue.

HED:
- HED asks if the last Sunday's problem with machine (drop in intensity) is understood or if it may happen again. XO says until yesterday this was not fully understood and will enquire again with BKR 
colleagues.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 01.11.2021, posted by Frederik Wolff-Fabris on 01 Nov 2021, 10:10 
General Announcement:
-  XO is currently setting scheduling meetings with the groups for planning and cross-checking the preparation for the Winter maintenance 2021. Meetings will take place between this and next week.

CTRL:
- Nothing to report.

DA:
- Announcement on the online calibration: for SPB it will be upgraded to Karabo 2.11. Today is preparation and later this week it will be deployed for the user beamtime.

EEE:
- Nothing to report.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- Nothing to report.

ITDM: 
- Together with CTRL and DA and HED/MID instrument: solving hardware problem of online cluster - one has to swap locations of SA3 and SA1. This is ongoing right now.

XRO:
- Nothing to report.

LAS:
- Water leak in SA1. TS is aware and fixing it. The PP-laser was not switched OFF.

UNSYS:
- All is good; The seeding crystal in SA2 is on the right position for the self-seeding. Support will be available for helping the expert.

SPB:
- Nothing to report; Interesting data was acquired along the week and analysis will take few weeks.

FXE:
- Nothing to add.

MID:
- All fine.

HED:
- User experiment;
- Yesterday after midnight beam intensity dropped down from 1mJ down to 300uJ and BKR did not managed to recovered it.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 27.06.2021, posted by Frederik Wolff-Fabris on 27 Oct 2021, 10:34 
General Announcement:
-	 

CTRL:
- Nothing major to report.

DA:
- Nothing to report.

EEE:
- Nothing to report.

VAC:
- Nothing to report.

XPD:
- Not present.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- Nothing to report.

UNSYS:
- Issue with mono in cell 18 / SA2 self-seeding: Encoder for the y-motor is found to be damaged. UNSYS tried to fix it during several hours ZZ but was unsuccessful. Encoder is damage for the y station. 
Later a solution with stepper without feedback (only image) was put in place and this managed to insert crystal in the proper position. 
- Probably re-writing software to switch from encoder to image feedback may be a solution. The full fix need to open the vacuum chamber. 
It is not sure if this action will take place during winter shutdown. This taks will be included in ME list and involves several groups.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- All fine.

HED:
- It seems that beam @18keV was seen at the HED hutch, differently from the 30keV situation. 

SCS:
- Nothing to report.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 25.10.2021, posted by Frederik Wolff-Fabris on 25 Oct 2021, 10:50 
General Announcement:
- An e-mail was sent to "xo-info" mailing list concerning the cooling water maintenance scheduled for one week starting on Dec. 6th. 
More information will be sent by the end of this week and if you have any concerns, please contact us at xo-planning@xfel.eu.

CTRL:
- Shimadzu camera at SPB to be followed up; Also, the pop-up motor at HED needs a feedback.
- Related to DRC: on Friday SQS was using the bunch patter server and the machine server was going back to zero pulses. Cause was another Karabo device at SCS topic which was working / forgotten and was 
setting bunches to zero. 
Important is that none was knowing this was running. Follow up with XO for new procedures.

DA:
- Nothing major to report.

EEE:
- PLC side: backlash 2 step compensation successfully tested.
- Cabling at FXE had some troubles and today there will be a recheck.

VAC:
- Friday incident with Interlock on SA3 (faulty gauge at GATT): reason is known and was communicated to the involved parts. Long term plan to mitigate is in place.

XPD:
- Involved at high energy tests in SA1 and SA2; SA1 worked well delivering beam at SPB; SA2 had 300uJ in XTD1 but a high intensity at HED was not achieved. On Sunday HED colleagues did some tests; 
Calorimeter did not see beam.
- Imagers YAG imagers could see the beam at the end of HED station. YAG is not too bad at these high energies (only factor 2x less). Diamond is not suitable as one needs to integrate lot of pulses to get 
signal.
- Upgrade on Imagers together with Andrea Parenti is already concluded, tested and shall be working fine. Some Karabo devices had to be restarted in SA1, SA2 and SA3. In case of issue, please contact 
Andrea Parenti.

DET:
- DSSC activities with DEPFET ladder measurements at SQS went well; happy with acquired data.

ITDM: 
- Nothing to report.

XRO:
- SA1 re-alignment of mirror was not immediately possible and therefore done in several attempts. Started from none position but went well at the end. 
- In SA2 re-alignment was not possible (settings of mirrors not ideal and therefore drop of beam intensity); In future a second attempt shall be made with the lessons learned. In SA1 went well.
- SA3 activities went well without problems.

LAS:
- From SQS high energy fluctuations were seen at PP-L and fixed after switching to another setting. 

UNSYS:
- Motor of monochromator of chicane 2 / SA2: remotely action did not recover it. Access is needed. Suren K. needs a 2-3 hours of access (realistic time) and there is no guarantee it will work.

SPB:
- Got beam at 24keV. 
- On Saturday a problem with camera Shimadzu not communicating to PLC was solved.
- Beam drift at downstream of SA1 (mm order) was seen.

FXE:
- Preparing for Users this week.
- Work with cabling ongoing.

MID:
- All fine.

HED:
- Having the 30keV beam and trying to align; Diffraction seen but could not say that the beam goes to the beam stop. Beam intensity too low for absorption edges.
- Preparing for Users this week.

SCS:
- Not present.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 20.10.2021, posted by Frederik Wolff-Fabris on 20 Oct 2021, 10:28 
General Announcement:
- XO received some enquires on the status of the winter maintenance scheduling: We have about 750 tasks submitted and we are currently analyzing all of them to spot conflicts to be solved as well as 
identifying the infrastructure dates. 
In case you have any question or would like to bring any point to our attention, please feel free to contact us at XO. 

CTRL:
- Nothing to report.

DA:
- Today a minor update of offline calibration system occurs at 10:00. No service interruptions will happen.

EEE:
- From the PLC team: 1. An e-mail will be sent as reminder for tomorrow SA2 move2 update (together with XRO); 2. Today SA3 GATT EPS update will take place.

VAC:
- Not present.

XPD:
- XPD team is busy with the facility development week as well as with a beamtime at Flash.
- SA1 is setting up to 24keV. Is under tuning and has so far achieved 500uJ intensity

DET:
- Nothing to report.

ITDM: 
- All fine.

XRO:
- SA1 beam transport is aligned with 24keV beam.
- SA2 will be also aligned from today using 30keV beam.

LAS:
- Not present.

UNSYS:
- Issue with 1 motor in the chicane cell#18 / SA2 (crystal) that triggered the limit switch. The motor is stuck and an attempt to remotely fix it will take place.

SPB:
- From tomorrow SPB/SFX will work with beam.

FXE:
- Preparing activities and all is OK.

MID:
- All fine at MID.

HED:
- Nothing to report.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 18.10.2021, posted by Frederik Wolff-Fabris on 18 Oct 2021, 10:14 
General Announcement:
-	 

CTRL:
- Nothing to report.

DA:
- On the mention of offline calibration being slow: DA reminds to call the DOC as soon as the issue occurs. It is hard to find root causes at a later time.

EEE:
- Issue with SCS Scannery: solved during the weekend and follow up further;
- Coax cable installation in FXE to start from this Tuesday 19.10.

VAC:
- Nothing to report.

XPD:
- No issues to report; This week XPD is involved at Hard X-rays activities with 24keV in SA1 and >30keV in SA2.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- Attempt to measure the beam position in SA2 this morning was missed as machine started to change parameters.

LAS:
- Not present.

UNSYS:
- Nothing to report.

SPB:
- Observed beam drift of up to 2mm on the 17.10; Theo M. confirms that horizontal direction moved up to 7mm at the XGM.

FXE:
- Nothing to add.

MID:
- All fine at MID; successful user beam time; Issues with Laser being helped during the weekend.

HED:
- Agipd-mini half back to HED; checked with DAQ; tests during this week.
- Also calibration for the single shot operation this week (Single shot with Agipd; picking only trains that have signal).
- Weekend to get 30keV beam: Zuzana K. is the main contact for communication and planning. 

SCS:
- Scanner-y issues: it does not run stable (not allowing to be used in automated motion); Beamtime successful.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 13.10.2021, posted by Andreas Galler on 13 Oct 2021, 09:26 

General Announcement:

  • This meeting is a tool to share information/experiences across scientific and technical groups

CTRL:

  • system are working

DA:

  •  

EEE:

  • next week
    • update on GATT and EPS loop in SA3 in roder to allow for new protection of GATT for the whole beaemtime
    • SA2 on Thursday (maybe Friday), try to correct backlash issue --> loop update

VAC:

  • all is running
  • HED VAC event
    • miscommunication between operators led to this issue

XPD:

  • no issue to report
  • next week, during the whole week there'll be a high photon energy test at SA1 and SA2 see a big involvement of XPD
    • 24 keV @SA1 (Tue)
    • ~30 keVC @ SA2 (Wed/Thu)
    • PI/Planner is Frank Brinker

DET:

  • investigating JF1M issue of 4-6Hz instead of 10 Hz operation

ITDM:

  • nothing

XRO:

  • SA1 M1/M2 drifts under investigation
  • XRO is involved as well with next weeks high photon energy effort as well as EEE loop updates

LAS:

  • sub sync

UNSYS: 

  • nothing

SPB/SFX:

  • user exp this week, 24 keV next week

FXE:

  •  

MID:

  • all fine at MID

HED:

  • next week high photon energy

SCS:

  • nothing to report

SQS:

  • next week material tests, maybe also detector group.

AOB:

  •  

Entry   Notes XO Integration Meeting 11.10.2021, posted by Andreas Galler on 11 Oct 2021, 09:27 

General Announcement:

  •  

CTRL:

  • nothing report

DA:

  • nothing to report

EEE:

  • several motors in SPB/SFX had trouble, all originating from the same crate

VAC:

  • VAC problems at HED last Wed
    • monochromator section in the tunnel, two unidentified vacuum bursts

XPD:

  • nothing to be reported

DET:

  • nothing to report

ITDM:

  • nothing to report

XRO:

  • FXE (PZ) reported a large jump in the bender setting, sebsequently Ry and pitch drifted for days and stabilized later
    • M1 M2 alignment changed as well
    • currently stable and being investigated

LAS:

  • nothing to report

UNSYS: 

  • nothing to report

SPB/SFX:

  • unstable pulse energy jittering ~ 35% over days.

FXE:

  • Experiment went well, apart from minor issue with calibration pipeline with JF

MID:

  • all fine

HED:

  • nothing to report

SCS:

  • not present

SQS:

  • not present

AOB:

  •  

Entry   Notes XO Integration Meeting 06.10.2021, posted by Andreas Galler on 06 Oct 2021, 09:28 

General Announcement:

  •  

CTRL:

  • nothing to report

DA:

  • nothing to report

EEE:

  • nothing to report

VAC:

  • nothing to report

XPD:

  • nothing to report

DET:

  • nothing to report (SPB reports JF1M issue --> suspected readout board issue)

ITDM:

  • issues with Nagios
    • misconfig by puppet mangement (DESY)

XRO:

  • nothing to report

LAS:

  • nothing to report
    • SA3 PPL up and running

UNSYS: 

  • Phaseshifter tables for higher energies in blue week had been uploaded
  • two quad movers from SA2 moved to 0
    • triggered by doocs --> quad movers moved back but it is unclear if they actually returned the BBA optimized position
    • clarification with M. Scholz confirms that quad movers did not move.

SPB/SFX:

  • JF
  • nothing to report

FXE:

  • User Experiment starts
  • C&C update requested until next week for LPD (uTCA)

MID:

  • all fine at MID

HED:

  • nothing to report

SCS:

  • not present

SQS:

  • nothing to report

AOB:

  •  

Entry   Notes XO Integration Meeting 04.10.2021, posted by Andreas Galler on 04 Oct 2021, 09:30 

General Announcements
none

 

CTRL
- late train IDs at XGM, being sorted

 

DA
- nothing to report

 

EEE

DET

ITDM
- nothing to report

XRO
-

LAS
- Failure of Power SUpply on AMPHOS in SA3, had been replaced over the weekend,
- observed jump on ODL in SA2 around midnight --> being investigated

UNSYS
- nothing to report
- PKG status to be discussed

 

SPB/SFX
- nothing major to report

 

FXE

 

MID
- Feedback for M2 stopped working, started calculating wrong values

HED
- nothing to report

SCS
- problems with DAQ: DA1 stuck --> DOC and ITDM are aware

SQS
- nothing to report

 

AOB

 

 

 

Entry   Notes XO Integration Meeting 29.09.2021, posted by Frederik Wolff-Fabris on 29 Sep 2021, 09:49 
General Announcement:
- Tomorrow 30.09 is the deadline to submit the winter maintenance task list. In case of questions please do not hesitate in contacting XO.

CTRL:
- Nothing to report; systems are fine.

DA:
- Nothing to report.

EEE:
- Nothing to report.

VAC:
•	Nothing to report.

XPD:
- High pulse energy in SA3: about 15-16mJ was seen at 1keV and XPD confirmed the accuracy of this value. By the other side, XPD is checking for potential damages in the YAG screens (not yet identified but 
this is close to the limit).
- A. Koch sent information on the screen limits and corresponding watchdogs. Info will be shared at the readiness mailing list.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- Lasers are running. Question on spectral stability in SA3 from Monday: LAS investigated but they lack some diagnostics; LAS will need to work with SQS colleagues (Gotthard) to further complement 
diagnostic.

UNSYS:
- Alarm that PKG of SA3 is off. Nevertheless, SA3 is well performing with good temperatures.

SPB:
- Issue resolved by DRC in seeing the beam.

FXE:
- Nothing to report.

MID:
- All fine at MID; all in progress.

HED:
- Setting up experiment.

SCS:
- Progress with new setup.

SQS:
- Nothing to add; in touch with LAS.
Entry   Notes XO Integration Meeting 27.09.2021, posted by Frederik Wolff-Fabris on 27 Sep 2021, 10:06 
General Announcement:
- The subscription for the User and Operation mailing list can be found at the regular announcements. Please forward the e-mail to new colleagues who are interested in getting the meeting link. 
- For any required operation that is not in the normal envelope, please keep in mind to discuss with XO in advance, to better planning and organization together with Desy-MXL / BKR colleagues. 
If possible, please let XO know with weeks in advance.

CTRL:
- No major updates from CTRL to be announced.

DA:
- Quiet blue week in terms of support.

EEE:
- Nothing to report.

VAC:
- Nothing to report for VAC.
- From PRC / Raul V.: photon intensity >15mJ in SA3 seems to be real. Spectrum analysis is under way and confirms >14mJ and it may be related to the chirp studies.

XPD:
- Self-seeding studies during the weekend (13keV @ HED): seeded signal of about 400mJ - data to be analyzed.

DET:
- Nothing to report.

ITDM: 
- Last week Gitlab update: some bug fixes were done during the weekend. In case of issues please let ITDM know. Gitlab is now available at the distributed link: gitlab.xfel.eu.

XRO:
- SA2 mirrors changed to platinum stripe.

LAS:
- Nothing to report.

UNSYS:
- Nothing to report.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- All fine at MID - thanks to XRO to have changed the optics.

HED:
- Nothing to report.

SCS:
- Nothing to report.

SQS:
- Issues with spectral stability of PP-lasers. To be addressed by LAS.
Entry   Notes XO Integration Meeting 22.09.2021, posted by Frederik Wolff-Fabris on 22 Sep 2021, 09:47 
General Announcement:
- A reminder that in case staff members suffer from cold symptoms, please remain at home and do home-office.
- TS informs the restrooms at XHEXP1 are out of service. The fix is under way.

CTRL:
- Update of Beckhoff mc2 devices at all tunnels and experiments was done yesterday. No substantial problems occurred and first checks show also no issues. Please check if past configurations are used as it 
may cause a crash. 
- PP-Laser device (PPL multi-pattern device) will be update at instruments and down during this time. In case instruments do not want this upgrade, please contact CTRL / Valerii Bondar.
- No reports from DOC.

DA:
- Nothing to report.

EEE:
- Fast electronics: adding uTCA for SCS.
- Cabling installation at HED ongoing.

VAC:
- Nothing to report.

XPD:
- Yesterday ZZ with Gotthard was done and went as planned. It is now working nicely.
- XPD is prepared for the activities related to the blue/development week.
- Wavefront measurements were successfully done last Monday.

DET:
- First test of DSSC at SQS taking place today and tomorrow.

ITDM: 
- Reminder for the Gitlab update taking place tomorrow at 16:00.

XRO:
- Nothing to report.

LAS:
- Nothing to report.

UNSYS:
- Issue with SA3 quad movers that were blocked on Monday. A re-start of Movers and phase shifter was done which solved the issue.

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- All fine at MID.

HED:
- Nothing to report.

SCS:
- Not present.

SQS:
- All good at SQS.
Entry   Notes XO Integration Meeting 20.09.2021, posted by Frederik Wolff-Fabris on 20 Sep 2021, 10:19 
General Announcement:
- On last week's cryogenic failure at the machine: the root cause is tracked to a failed temperature sensor that bring down several pumps.

CTRL:
- Time slot for Beckhoff update of Mc2 motors is tomorrow between 09:30-11:00. This update is for all topics in tunnels and experiments. 
Change of parameters must not occur (for the ones which are stored in Beckhoff). Nevertheless, it is good for groups to check parameters that are not stored. 
An e-mail will be sent to communicate it and a second one when the update is finished.

DA:
- Nothing to report.

EEE:
- EEE supports the mentioned loop updates (care of PLC system).
- Cabling installation in FXE and HED have started and are ongoing during this week.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- Nothing to report.

ITDM: 
- Gitlab update takes this week, on Thursday at 16:00. An e-mail will be sent to readiness.

XRO:
- Nothing to report.

LAS:
- Nothing to report.

UNSYS:
- Nothing to report.

SPB:
- Nothing to report.

FXE:
- Stable operation during the weekend with a problem solved by DOC. A beam jitter was also observed on the weekend related to a feedback.

MID:
- All fine at MID.

HED:
- Finished user experiment; nothing to report.

SCS:
- Nothing to report.

SQS:
- Not present.
Entry   Notes XO Integration Meeting 15.09.2021, posted by Frederik Wolff-Fabris on 15 Sep 2021, 10:37 
General Announcement:
- Machine stop running yesterday around 21:00 due to problems with the cold compression. A repair was done during the night but there are not yet stable conditions. It is unclear at what time today the 
machine will be back. 
By the other side, gun conditioning was done during the night which may help to have less gun trips.
- Steffen H. on behalf of DRCs reminds the instruments to please attend the jour-fix meeting on Mondays. 

CTRL:
- Beckhoff upgrade is set to take place next Tuesday 21.09 at 09:30 (during ZZ access). It relates to only Karabo devices with Mc2 motor loops; the PLC continues to run. 

DA:
- Nothing to report.

EEE:
- An update of SA2 motion loop to integrate the shutter / Gotthard is to take place next Tuesday 21.09 morning. Nerea J. will coordinate with CTRL (Valerii B.) and Naresh K. on the best time.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- Reported last Monday that SA1 PP-laser was down due to air conditioning. In fact, it was a broker chiller that is repaired already Monday was a broker chiller. The PP-laser in SA1 is available since 
yesterday.

UNSYS:
- Nothing to report.

SPB:
- Change of setup happened yesterday. It will be ready for beam at 23:00 if possible.

FXE:
- Nothing to report; not yet clear if program will be affected due to the beam down.

MID:
- All fine at MID.

HED:
- Got beam yesterday morning and made use of it.
- Had issues with Interlocks (see operation-2021 e-log). A DACHS terminal stopped working and could not do hutch search. The Dachs terminal was replaced by Desy colleagues. 

SCS:
- Issue with the GATT mentioned last meeting: Jan-Torben D. has contacted XO (F. Wolff-Fabris). Discussions with further groups will take place.

SQS:
- Not present.
Entry   Notes XO Integration Meeting 13.09.2021, posted by Frederik Wolff-Fabris on 13 Sep 2021, 10:04 
General Announcement:
-	 

CTRL:
- Next week CTRL will upgrade Beckhoff devices containing MC2 loops. This is done to avoid the PLC to crash. This is only Beckhoff devices and is for all tunnels and loops. This is a Karabo devices upgrade 
and not the PLCs. 
Naresh K. says systems are still needed on Monday morning. A. Galler tells that a ZZ will take place on Wednesday and this may be a better time for the update. XO and Valerii B. will discuss offline.

DA:
- Nothing particular; DOC and OCDs were quiet.

EEE:
- Nothing to report.

VAC:
- Yesterday effect of the power glitch at 15:03. VAC-OCD checked with SCS - the interlock reacted and GATT stopped for a while.
- SCS comments that the problem with GATT gave 300x more photons than expected to the sample and detector. A better safety / interlock is to be prepared. 
Raul V. says that topic was first discussed in 2019 with SQS (using the B4C block in the interlock loop for the GATT). It may require interaction from SA3 instruments, VAC, XRO, CTRL.

XPD:
- Small confusion on the SA3 XGMs during the weekend: BKR mixed the SCS and SQS XGM's not working and this triggered a few reactions on the weekend. A better way to do not mix up XGMs will be made. 
Please look to the right device before informing experts on possible errors.

DET:
- PnCCD detector is brought back to operation.

ITDM: 
- Next week (not yet date) a follow up of the Gitlab update will take place. Mostly likely on Wednesday; details will come by e-mail.
- Update of the GPFS metadata: to be replaced on a time without activity. Shall be transparent.

XRO:
- Nothing to report.

LAS:
- Lost SA1 PP-laser due to change of temperature and humidity at midnight this morning. No information when it will be made available for use.

UNSYS:
- Nothing to report.

SPB:
- Looks fine apart the fact it did get only 188 and not 202 bunches.

FXE:
- Nothing to report.

MID:
- All fine at MID - experiment running smooth; seeded beam running well. Only issue that Gotthard in tunnel has triggered Big Brother a couple of times. It was not a real signal. Naresh K. will talk to 
Ulrike B.

HED:
- All fine at HED.

SCS:
- Nothing else to add.

SQS:
- Successfully brought up pnCCD. It replaced physically one sensor. Reasons for the crash is understood at SQS (bad communication among the involved people). 
Entry   Notes XO Integration Meeting 08.09.2021, posted by Frederik Wolff-Fabris on 08 Sep 2021, 10:06 
General Announcement:
- Quick report of yesterday incident of water running down to XHEXP1: a washing machine in the clean room at ground level leaked; the water went down to the SA4/5 area of XHEXP1. 
Both ground floor and XHEXP1 floors were wet. The washing machine is taken out of service.

CTRL:
- The ticketing system "control-integration" is working again and can be used.

DA:
- Nothing to report.

EEE:
- Fast electronics announcement: tomorrow late afternoon EEE will apply the fix to DSSC camera to correct train-IDs.

VAC:
- A test on the signal optimization in SA3 vacuum loop was done. VAC found a fix that will be applied during the shutdown (together with CTRL, EEE).

XPD:
- Nothing to report.

DET:
- pnCCD risk analysis: DET says that there is a path to avoid accident again and has been discussed with instrument. The misbehavior of the bottom module is to be investigated and replaced.

ITDM: 
- Nothing to report.

XRO:
- Nothing to report.

LAS:
- Improvement of sync system in SA3 laser hutch took place this week. The laser is available to instruments.

UNSYS:
- Nothing to report.

SPB:
- Nothing to report.

FXE:
- Nothing to add.

MID:
- All fine at MID.

HED:
- Nothing to report.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
Entry   Notes XO Integration Meeting 06.09.2021, posted by Frederik Wolff-Fabris on 06 Sep 2021, 11:00 
General Announcement:
- XO thanks the instruments for posting in the Operations e-log.
- Jan G. says calorimeter measurements last Friday on HED hutch took place in order to measure transmission of pulse energy in the hutch and compare with tunnel HED-XGM. 
It is found a factor 2 loss - half beam intensity arriving at the end of the hutch. 
- Lorenz K. says that the Barista machine triggered a fire alarm. TN did a check and may be caused by the self-cleaning program of the machine by producing enough steam.
- Call for tasks to be carried on next Winter maintenance period were sent out to the are sent out via e-mail last Friday. Groups shall submit one group list by 30.09.2021.

CTRL:
- From tomorrow morning all the mails sent to the "controls integration" ticketing service will be offline due to an update. Please contact DOC instead. An e-mail will be sent as soon as the service is 
back.

DA:
- Nothing to report.

EEE:
- OCD calls from SQS last week were solved. 
- Nerea J. and F. Wolff-Fabris say the issue with SQS EPS is temporarily solved by now (masked signal at the Big Brother). SQS has to plan when it wants the EPS running.

VAC:
- Quiet week in terms of OCD.
- Today in the morning: please refrain to use this morning any SA3 device like GATT.

XPD:
- Nothing to report.

DET:
- Follow up of the pnCCD detector: upper part of the detector has scratches after Thursday accident. SQS will replace parts this week. The lower part of the detector has also some issues (noisy). 
It is unclear if the detector can be used.

ITDM: 
- Today and tomorrow ITDM carries the integration of the offline storage into the new system (new storage blocks; it shall be unnoticed by the users). The old one goes out by replacement.

XRO:
- Apart of the beam point instability @ HED (stochastic instabilities that appear from time to time) there is nothing else to report.

LAS:
- Change repetition rate at SA2 PP-laser this week.
- SA1 has a higher jitter than normal that has to be investigated on-site.

UNSYS:
- All fine at Undulators.

SPB:
- Running night shifts: on SAT night some X-ray trains not arriving; It did not disturb operation but a bit disturbing.

FXE:
- Lost of pulses and many issues on Saturday such as instability and tuning without prior communication. To FXE team.
- F. Wolff-Fabris says the beam became more stable on Sunday afternoon after the restart of a server and the feedback for the compression.

MID:
- All fine at MID.

HED:
- Suffered from beam jitter: measurements were done with different mirrors settings, CRL configs; MID branch. Analysis ongoing this week (Sebastian Goede).

SCS:
- Nothing to report.

SQS:
- Nothing to report.
ELOG V3.1.4-7c3fd00