Notes XO Integration Meeting 29.05.2024, posted by Frederik Wolff-Fabris on 29 May 2024, 09:45
|
General Announcement:
-
CTRL:
- Nothing to report.
DA:
- Nothing to report.
EEE:
- Nothing to report.
VAC:
- Nothing to report.
XPD:
- Nothing to report.
DET:
- Nothing to report.
- Silicon oil leak in DET lab: team was investigating and seems to be fixed by now. It is particular to this lab installation and is not similar to the ones in the instruments.
ITDM:
- Rack move in E.0: rack has been moved to final position. Related components also moved; at the moment coordinating with room managers to make inside installations. All going smoothly and accordingly to
the plan.
XRO:
- Not present.
LAS:
- Issue with timing jumps by SQS: debug has been done with EEE and Sync groups. Front end was changed yesterday but did not solved.
The uTCA slave card (in the PP-laser rack) was drifting and this card was also changed last evening. There is less jitter and issue seems to be solved now.
UNSYS:
- Nothing to report.
SPB:
- Preparing beamline for next user.
FXE:
- Nothing to report.
MID:
- All fine at MID.
HED:
- Not present.
SCS:
- Nothing to report.
SQS:
- Issues from the weekend: 1. interlock hutch door contact broken; 2. Misunderstanding on tuning for SA1 without notifying SQS members.
- A. Galler comments that the tuning was discussed with instruments and likely another shift crew in the instruments were knowing the tuning operation and this information was not passed to all member of
SQS.
SXP:
- Not present. |
Notes XO Integration Meeting 27.05.2024, posted by Frederik Wolff-Fabris on 27 May 2024, 09:41
|
General Announcement:
- Thanks to all groups who have submitted the Summer/24 maintenance task list. In case you haven't done yet, please inform at xo-planning@xo.eu when you are planning to do so.
CTRL:
- Nothing to report.
DA:
- Nothing to report.
EEE:
- Nothing to report.
VAC:
- Nothing to report.
XPD:
- Nothing to report.
DET:
- Issue with AGIPD-1M yesterday evening. DOC was called because of a misbehavior: hardware problem since several exits show high current and causes channels to trip for M1 module.
Detector is back online but with 4 channels OFF (30% of this module). More investigation will follow.
ITDM:
- Nothing to report: progressing with IT rack change and hopefully will meet deadline by Tuesday next week.
XRO:
- Nothing to report.
LAS:
- Just got a message from SPB/SFX with problem in wavelength in SPB/SFX laser. Will be looked at after the meeting.
UNSYS:
- Everything fine.
SPB:
- AGIPD and PP-LAS issues already reported.
FXE:
- Nothing to report.
MID:
- All fine.
HED:
- Fine at HED.
SCS:
- Not present.
SQS:
- Not present.
SXP:
- Not present. |
Notes XO Integration Meeting 22.05.2024, posted by Frederik Wolff-Fabris on 22 May 2024, 09:53
|
General Announcement:
- Next Friday 24.05 is the deadline to submit maintenance task lists. Please contact XO in case you are not prepared to submit by the deadline.
CTRL:
- Nothing to report.
DA:
- Not present.
EEE:
- Issue with Hexapod in HED: under investigation by EEE and Bernard B. Not having the Hexapod will affect the experiment this week. A back plan exists but no guarantee it works if a fix can't be done.
VAC:
- Nothing to report.
XPD:
- Nothing to report.
DET:
- Julabo chiller at SPB/SFX does not maintain the low temperature - under work.
- Two weeks ago (user experiment) some AGIPD modules at SPB/SFX were exchanged and damage has been found at the new modules.
A report by SPB/SFX will be written for that it does not happen again as if damages are frequently happening one will run out of spare modules.
ITDM:
- Works started in the network at lab areas and are ongoing.
XRO:
- Nothing to report.
LAS:
- Flatness of SPB PP-laser under investigation;
- SA3 PP-laser stain issue did not go away: manufacture of front-end amplifier is contacted; further tests to be done today.
UNSYS:
- Not present.
SPB:
- Nothing to report.
FXE:
- Nothing to report.
MID:
- All fine at MID.
HED:
- Hexapod issue already mentioned.
SCS:
- Nothing to report.
SQS:
- Nothing to report.
SXP:
- Nothing to report. |
Notes XO Integration Meeting 15.05.2024, posted by Frederik Wolff-Fabris on 15 May 2024, 09:44
|
General Announcement:
-
CTRL:
- Nothing to report.
DA:
- All fine from DA.
EEE:
- Nothing to report.
VAC:
- Not present.
XPD:
- All fine with diagnostics;
- First shift yesterday for studies with beam steering in SA1 and today the continuation.
DET:
- Nothing to report.
ITDM:
- Reminder for the announcement on the network works on next Tuesday in the lab areas (see also sent e-mail). No strong objections were presented so far. Please contact urgently ITDM in case of questions.
- Room managers have to grant access to the workers during the Network maintenance.
XRO:
- Everything fine.
- Working today with Euler MDL.
LAS:
- On timing jumps and spectrum shifts for SA1 PP-laser reported last Monday: timing jumps under investigations by EEE (not happened since Monday); changes during the shifts under investigation.
UNSYS:
- All fine.
SPB:
- Nothing to report.
FXE:
- Nothing to report.
MID:
- All fine at MID.
HED:
- Nothing to report.
SCS:
- Not present.
SQS:
- Nothing to report.
SXP:
- Not present. |
Notes XO Integration Meeting 13.05.2024, posted by Frederik Wolff-Fabris on 13 May 2024, 09:43
|
General Announcement:
- A. Galler reminds that entries from the instruments taking beam at the Operation-2024 e-log is highly appreciated.
CTRL:
- Nothing to report.
DA:
- Nothing to report.
EEE:
- Nothing to report.
VAC:
- Nothing to report.
XPD:
- Issue Friday night at 02:28AM: the SA2/XTD1 XGM stopped delivering single shot data. There was an interlock of high voltage HAMP (over current happened).
It was repaired earlier in the morning around 08:30AM but further investigation is ongoing.
MID did not take beam during that time due to another issue happening in parallel, so no data needed from XGM were lost.
DET:
- Nothing to be reported.
ITDM:
- Nothing to report.
XRO:
- Nothing to report.
LAS:
- Not present.
UNSYS:
- Everything is fine.
SPB:
- Piezo motors for the PP-laser had issue but now it's solved.
FXE:
- Problem with PP-laser (fundamental spectrum) was fixed by OCD.
- PP-laser timing jump after shift changes from SPB/SFX.
- Problems with dark taking for the Jungfrau which was reported to DOC - as DRC, Phillip Schmidt reports that refreshing the myMDC page permits to make data visible.
MID:
- Nothing to report.
HED:
- Nothing to report.
SCS:
- Not present.
SQS:
- Users are taking beam.
SXP:
- Not present. |
Notes XO Integration Meeting 08.05.2024, posted by Frederik Wolff-Fabris on 08 May 2024, 09:39
|
General Announcement:
- A. Galler inform that if a hutch radiation alarm is triggered please familiarize yourself with the procedures. It can be helped by Hall Crew and/or D3. Operation is stopped when this alarm is triggered.
CTRL:
- Nothing to report.
DA:
- Nothing to report.
EEE:
- Nothing to report.
VAC:
- Nothing to report.
XPD:
- Nothing to report.
DET:
- Problems with AGIPD-1M at MID: one module does not send proper data. Under work;
- Last week issue with AGIPD at SPB: modules were flickering and major intervention is needed to further investigate. Issues with calibration and data quality: work is ongoing.
ITDM:
- Everything is fine.
XRO:
- Nothing to report.
LAS:
- Nothing to report.
UNSYS:
- Everything is fine and yesterday the ZZ was not needed.
SPB:
- Issue with AGIPD-1M data quality is been worked on.
FXE:
- Not present.
MID:
- AGIPD module issue already mentioned by DET.
- 2.4mm CVD foil attenuator seems to be damaged; it will be discussed with XRO.
HED:
- Nothing to report.
SCS:
- Not present.
SQS:
- Nothing to report, starting to take the beam.
SXP:
- Not present. |
Notes XO Integration Meeting 06.05.2024, posted by Frederik Wolff-Fabris on 06 May 2024, 09:21
|
General Announcement:
- Summer maintenance task list was sent to the groups. Please contact XO in case of questions or if your group did not receive the list.
CTRL:
- Nothing to report.
DA:
- Nothing to report.
EEE:
- Discussion ongoing for the summer maintenance tasks.
VAC:
- No OCD calls for VAC and systems seemed to be not affected by this morning's power glitch at 05:47AM.
XPD:
- Everything fine with diagnostics.
DET:
- Nothing major to be reported.
- 500k AGIPD over the weekend was helped by DOC and DATA OCDs solved.
ITDM:
- Nothing to report.
XRO:
- Event of misalignment of M6 on Friday for SA3/SXP under investigation. It will be discussed with SXP.
LAS:
- Not present.
UNSYS:
- All fine with undulators.
SPB:
- Nothing to report.
FXE:
- Nothing to report.
MID:
- Nothing to be reported.
HED:
- Running and thanks to DOC and OCDs for AGIPD help.
SCS:
- Not present.
SQS:
- Nothing to report.
SXP:
- Not present. |
Notes XO Integration Meeting 29.04.2024, posted by Frederik Wolff-Fabris on 29 Apr 2024, 11:35
|
General Announcement:
- Martin Doering announces the 2024 summer maintenance period:
1. Release MTL on May 3rd;
2. deadline to submit back tasks on May 24th to xo-maintenance@xfel.eu ;
3. Maintenance starts on Jun19th.
4. Interlock tests on July 1st-11th;
5. There are 119 recurring tasks that happen often during maintenances which are showed in XO Alfresco page under Maintenance Planning (start and ending dates will be determined during scheduling period);
6. For further questions please contact XO at xo-planning@xfel.eu
- Janusz S. and Kimon F. announce an eminent downtime on network for Lab and T0 areas to perform the exchange of the battery UPS location. It will take place on May 21st.
Please affected groups to give a feedback. Safety group will also be involved as it affects the wireless network. Network shutdown takes place during two weeks.
A. Galler asks all groups that have rooms in lab areas to contact Kimon F. and/or Janusz S..
- Next Wednesday due to the public holiday there is no XO Integration Meeting.
CTRL:
- Tomorrow the SA2 broker update takes place in coordination with XO.
DA:
- Nothing to report.
EEE:
- Nothing to be reported.
VAC:
- Trouble with Ion pump controller at HED branch on Thursday evening. Clarified by VAC-OCD and PRC and an access tomorrow morning is needed to exchange the controller.
XPD:
- Nothing to report.
DET:
- Nothing to be reported.
ITDM:
- Janusz S. informs on tomorrow gateway reboot taking place tomorrow between 10Am and 11AM.
XRO:
- Not present.
LAS:
- Not present.
UNSYS:
- SA3 cell 21 phase shifter needs ZZ in tunnel.
SPB:
- Problems with uTCA for some controllers contacted with DOC.
FXE:
- Issue with data aggregator giving fault when too many were acquired and some data were lost. Steffen H. said is was addressed and shall be stable now - a test by FXE will be done.
MID:
- Small problem scanning photon energy with the seeding crystal.
HED:
- Nothing to report.
SCS:
- Nothing to report.
SQS:
- Nothing to report.
SXP:
- Change on experimental plan but parameters are kept the same for cw19. |
Notes XO Integration Meeting 24.04.2024, posted by Frederik Wolff-Fabris on 24 Apr 2024, 09:49
|
General Announcement:
-
CTRL:
- Broker incident on SA2 and LAS topics last Saturday: update to be done in a split mode;
SA2 topic could not be done yesterday so is planned for Tuesday 30.04 morning and LAS topic to be done still this week as none uses PP-laser.
DA:
- Nothing to report.
EEE:
- Nothing to report.
VAC:
- Nothing to report.
XPD:
- Everything fine;
- SA2 FEL IMG issue: linked mainly to a bridge connection to DOOCS (left over from broker issue on Saturday). Restart it only yesterday and not during the weekend.
DET:
- Nothing major;
- Feedback from Jungfrau test at SPB last week: unfortunately, did not fully run as expected as user Bragg magnifier scene was optimized at 10keV and not 21keV.
Nevertheless, data could be seen and it was useful to have beamtime.
ITDM:
- On EXFEL Gateway: need to apply a fix and update security; an e-mail will be sent for scheduling on next Tuesday.
XRO:
- Not present.
LAS:
- Nothing to report.
UNSYS:
- Everything fine.
SPB:
- Nothing o report.
FXE:
- Problem with middle layer server reported to DOC this morning. It seems solved after server restarted.
MID:
- Nothing to report.
HED:
- Not present.
SCS:
- Nothing to report.
SQS:
- Nothing to report.
SXP:
- Issue with detector/data found last week and on the way to be fixed for next week. |
Notes XO Integration Meeting 22.04.2024, posted by Andreas Galler on 22 Apr 2024, 09:28
|
General Announcement:
CTRL:
- Broker Issue in SA2 on Saturday evening
- LA2 and SA2 topic restarted
DA:
EEE:
VAC:
XPD:
DET:
ITDM:
XRO:
LAS:
UNSYS:
SPB/SFX:
FXE:
MID:
HED:
SCS:
SQS:
SXP:
DRC
PRC
- HED was not taking beam during the SA2 broker issue, as a hardware change was being done
- by 2 am Sunday the systems were recovered and working
AOB:
|
Notes XO Integration Meeting 17.04.2024, posted by Frederik Wolff-Fabris on 17 Apr 2024, 09:47
|
General Announcement:
- A. Galler inform on the transponder/access issues at XHEXP1 last two days: when turnstiles are not working, people shall not get though and enter experimental Hall.
This is a safety break that will be taken by SRP. Please do not enter Hall if turnstiles are not working.
- As DRC, A. Silenzi informs there is nothing to report so far.
CTRL:
- Together with XPD and XRO a new version of DAQ in tunnels was installed and tested. All went fine.
DA:
- Nothing to report.
EEE:
- Nothing to be reported.
VAC:
- Nothing to report. Repair on Monday went successful.
XPD:
- Nothing to report.
DET:
- Nothing to report.
ITDM:
- DAQ Switch in SA3 was exchanged and work fine.
- GPFS update is postponed to a later date (tbd).
XRO:
- SA2 ATT #5 (1.2mm CVD) is replaced and working.
- SA1 mirror is calibrated to work with Euler motions.
- SPB/SFX is aligned with 22keV beam.
LAS:
- Nothing to report.
UNSYS:
- PS motor in SA1/cell23 was replaced yesterday by a ZZ.
SPB:
- Nothing to report.
FXE:
- Nothing to report.
MID:
- All fine at MID.
HED:
- Not present.
SCS:
- Nothing to report.
SQS:
- Nothing to report.
SXP:
- Not present. |
Notes XO Integration Meeting 15.04.2024, posted by Andreas Galler on 15 Apr 2024, 09:31
|
General Announcement:
CTRL:
DA:
EEE:
VAC:
- involved in XTD1 solid attenuator repair
- inform control once its done for MDL
XPD:
DET:
ITDM:
- FES switch for SA3 DAQ update will be replaced today --> DAQ won't be available
tomorrow gpfs pclayer update
XRO:
- SA1 Solid Attenuator repair & SA1 21-22 keV beam transport alignment had been done
LAS:
UNSYS:
SPB/SFX:
- beam is prealigned for 21- 22 keV this week, lots user prepartion
FXE:
MID:
HED:
SCS:
SQS:
SXP:
DRC
PRC
AOB:
|
Notes XO Integration Meeting 10.04.2024, posted by Andreas Galler on 10 Apr 2024, 09:26
|
General Announcement:
CTRL:
DA:
EEE:
VAC:
XPD:
DET:
ITDM:
- FES switch reboot in SA2 successful
XRO:
LAS:
UNSYS:
SPB/SFX:
FXE:
MID:
HED:
SCS:
SQS:
SXP:
DRC
PRC
AOB:
|
Notes XO Integration Meeting 08.04.2024, posted by Andreas Galler on 08 Apr 2024, 09:27
|
General Announcement:
CTRL:
DA:
EEE:
VAC:
XPD:
- everything fine, maybe ZZ tomorrow
DET:
ITDM:
- short interuption of DAQ Switch for SA1 tomorrow
- in coordination with CTRL
- GPFS clients on all PClayer servers planned for tomorrow
XRO:
- XTD1 ATT repair planned for next Monday
LAS:
UNSYS:
SPB/SFX:
FXE:
- train issue with JUNGFRAU
MID:
HED:
SCS:
SQS:
SXP:
DRC
PRC
AOB:
- XPD is planning for a ZZ in SA2 tomorrow, UNSYS wishes for ZZ in SA3 --> both topics to be discussed in the following RC meeting
|
Notes XO Integration Meeting 03.04.2024, posted by Andreas Galler on 03 Apr 2024, 09:28
|
General Announcement:
CTRL:
DA:
EEE:
VAC:
- Leak in SA2 Attenuator
- Arm5, had been removed and a blind flange
- Wajid asks if arm 5 was disabled from the middle layer device --> Mikako set the interlock for this arm and Wajid and MIkako will check together
XPD:
DET:
ITDM:
XRO:
- see VAC ...
- arm5 = CVD 1.2 mm
- spare CVD available,
LAS:
UNSYS:
- cell 11 and cell 34 in SA2 not repsonfing
SPB/SFX:
- nothing to report, AGIPD operational
FXE:
MID:
HED:
- AGIPD didn't send traiIDs for some modules -> fixeed on Monday by DOC
SCS:
SQS:
- easter experiment was good
SXP:
DRC
- HED trainID issue
- related to legacy data aggregators and not understood, but related to the legacy DAQ version from which HED will depart soon
- issue will not be investigated
- HED scheduled for rollout of new DAQ in cw 15
PRC
|
Notes XO Integration Meeting 27.03.2024, posted by Frederik Wolff-Fabris on 27 Mar 2024, 10:01
|
General Announcement:
-
CTRL:
- Nothing to report.
- No DAQ updates today.
DA:
- Things are fine; nothing to report.
EEE:
- Nothing to report.
VAC:
- Pressure issue in XTD2/SA1 during the night stopped beam permission to North Branch. One controller for ion pump needs to be replaced in a ZZ.
XPD:
- Ticket was sent to CTRL about missing data in DAQ at slow 10Hz data.
DET:
- Nothing to report.
ITDM:
- Nothing to report.
XRO:
- Nothing from XRO.
LAS:
- Nothing from LAS.
UNSYS:
- Nothing to report.
- If ZZ in SA3 can be done, a replacement of a Pandora box may take place. Suren K. will contact Mikako M. (PRC).
SPB:
- Nothing to report.
FXE:
- Not present.
MID:
- All fine at MID.
HED:
- Nothing to report.
SCS:
- Nothing to report.
SQS:
- Nothing to report.
SXP:
- Nothing to report. |
Notes XO Integration Meeting 25.03.2024, posted by Frederik Wolff-Fabris on 25 Mar 2024, 10:24
|
General Announcement:
- A power glitch happened last night around 02:50AM.
CTRL:
- Nothing to report.
- DAQ update: MID had operation during the weekend and seems to run fine; one issue after several hours needed a recycling but further investigation is ongoing to provide a fix in the coming days.
DA:
- Nothing to report.
EEE:
- Nothing to report.
VAC:
- Nothing to report.
XPD:
- Nothing to report.
DET:
- Nothing major to be report.
- AGIPD in SPB/SFX is running with 16modules; issue with connection caused one module to do not work (due to positions). There is a golden position and for next quadrant move has to be observed.
For a fix one needs a heavy intervention (disassemble half the detector - for the big shutdown).
ITDM:
- Nothing to report.
XRO:
- Nothing to report.
LAS:
- Not present.
UNSYS:
- Everything is fine.
SPB:
- Nothing to report.
FXE:
- Not present.
MID:
- All fine at MID.
HED:
- Nothing to report.
SCS:
- Experiment goes well so far.
- Hall crew will support SCS this week.
SQS:
- Nothing to report.
SXP:
- Not present. |
Notes XO Integration Meeting 20.03.2024, posted by Frederik Wolff-Fabris on 20 Mar 2024, 10:12
|
General Announcement:
-
CTRL:
- Nothing to report.
DA:
- All fine at DA.
EEE:
- PLC team received SCS calls regarding interlocks; under investigation.
VAC:
- Last weeks a shutdown on seven ion pumps happened on Friday but was restarted remotely.
XPD:
- All running good from XPD.
DET:
- AGIPD follow-up: nothing obvious was found, but module started working again after quadrant was moved; it may relate to vacuum issues and results from operation or electrical connection.
ITDM:
- Nothing to report.
XRO:
- Nothing to report.
LAS:
- Nothing to report.
UNSYS:
- Everything is fine;
- On Monday successful operation from BKR operators regarding Apple-X.
A. Galler clarifies the Apple-X is not yet available for instruments and coordination with Unsys, machine and photon RCs are still needed.
SPB:
- Nothing to report.
FXE:
- Taking the beam and everything is fine so far.
MID:
- Nothing to report.
HED:
- Not present.
SCS:
- Since yesterday, Tuesday, an issue with a O2 sensor happens but TS and TN were informed.
- Interlock issues that EEE is also informed.
SQS:
- Not present.
SXP:
- Not present. |
Notes XO Integration Meeting 18.03.2024, posted by Frederik Wolff-Fabris on 18 Mar 2024, 09:58
|
General Announcement:
- Machine is currently down due to the file system issues / controls. People are working with priority to recovery systems.
CTRL:
- Nothing to report;
- DAQ Uodate: Steffen Hauf informs the new DAQ version at SPB/SFX running last week had issue with data aggregator on Saturday. Debugger output is being performed in the nights at SPB;
Deployment at MID will be discussed; Data reduction inconsistencies need to be further checked with SPB/SFX.
DA:
- Nothing to report; quiet week with DA/DOC.
EEE:
- Nothing to be reported.
VAC:
- Not present.
XPD:
- Everything working good with XPD.
DET:
- AGIPD at SPB/SFX: 1 module was lost last week and excluded of the operation (top module); correlated to when quadrants were moved;
Changing of config and inspection will be done from tomorrow; there is a chance we run with only 15 modules until end of the run. There is no spare module to be replaced.
- Chiller at SPB/SFX was exchanged and running now.
ITDM:
- Nothing to report.
XRO:
- Nothing to report.
LAS:
- Not present.
UNSYS:
- Everything is fine.
SPB:
- Already reported: Back to old DAQ; AGIPD module missing (top corner) - would be important for PCS beamtime.
FXE:
- Nothing to report.
MID:
- All fine at MID.
HED:
- Nothing to report; user experiment ongoing fine; happy users.
SCS:
- Two dewars of liquid nitrogen are requested for liquid jet experiments - Hall Crew will prepare dewars.
SQS:
- Nothing to report.
SXP:
- Not present. |
Notes XO Integration Meeting 13.03.2024, posted by Frederik Wolff-Fabris on 13 Mar 2024, 11:30
|
General Announcement:
-
CTRL:
- Nothing to report.
DA:
- Not present.
EEE:
- Nothing to report.
VAC:
- Nothing to report.
XPD:
- Nothing to report.
DET:
- Nothing to report.
ITDM:
- Nothing to report.
XRO:
- Nothing to report.
LAS:
- Nothing to report.
UNSYS:
- Everything is fine. ZZ on Monday was successful.
SPB:
- Nothing to report;
- Problem with AGIPD chiller: seems solved for the moment - see how it goes next days.
FXE:
- Nothing to report.
MID:
- All fine at MID.
HED:
- Starting with the beam.
- SCS:
- Prepared equipment; maybe electronics will be contacted later.
SQS:
- All good.
SXP:
- All not present. |