ID |
Date |
Author |
Location |
Severity |
Subject |
305
|
02 Mar 2022, 10:12 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 02.03.2022 |
General Announcement:
- There is a high probability that we will run out of Helium gas due to difficulties with stock. If an instrument needs He on next weeks please get in touch with TS to verify its availability.
CTRL:
- Last Monday intervention on the SA3 GATT middle layer servers was successful.
DA:
- Today a major upgrade of offline calibration is scheduled during which services won't be available.
EEE:
- Supporting different tasks at SQS (recommissioning motors), HED (motor encoders), SCS and FXE.
VAC:
- Ion pump in XTD9 shows a potential risk of tripping interlock: a ZZ on Friday 14:00 will take place to change parameters.
- Another ZZ in XTD2 to attempt to fix the solid attenuator in SA1 (hole in the arms reported by SPB / 0.5mm Si damaged); try to change the blocking mechanism.
- Dmitry K. asks on the Si intervention in XTD2: Martin D. says a change of Si is a major intervention as it involves need of clean tent etc… and will not be done this Friday.
The idea is to use a fresh spot on the attenuator. Conditions for interlocks have to be later checked with Liuba S.
XPD:
- ZZ on Monday to remove Shimadzu camera was successful.
DET:
- Nothing to report.
ITDM:
- Problem with Influx cluster which did not accepted data for 3 hours: search for fixes last days and today a new configuration will be applied, followed by restart afterwards (minutes downtime). No effect
in tunnels DAQ.
XRO:
- Commissioning beamtime for SA2 mirrors: available beamtime was short. The coating stripes were found in beamlines in respect to motor positions. More beamtime is needed to continue commissioning of M1,
M2 and M3 in XTD6.
LAS:
- Nothing to report.
UNSYS:
- Apple-X commissioning ongoing: working on Control systems commissioning. Last cell was controlled; more tests ongoing today. The phase shifter tables are not yet ready.
SPB:
- Working with different groups during the week.
FXE:
- D3 was present on Monday to test the BTM; it was successful.
MID:
- Radiation alarm triggered due to a false alarm at MID hutch. Thomas P. from HED helped by calling RPOs; W. Clement, Eric B. and M. Prollius helped to solve it.
HED:
- Preparing for the high intensity laser and also working on motors.
SCS:
- Not present.
SQS:
- Not present. |
297
|
02 Feb 2022, 08:39 |
Andreas Galler | General | Information | Notes XO Integration Meeting 02.02.2022 |
General Announcement:
CTRL:
- observation from DOC
- macros some times after the upgrade to Python 3.8 --> please contact CTRL?
DA:
- significant upgrade to Offline Analysis -->
- proc data won't inlcude a copy of raw data any longer
EEE:
VAC:
XPD:
- no incidents
- 2 tunnel accesses on Monday --> succesful
DET:
- DET commissioning at SPB (AGIPD JUNGFRAU 1M), MID (AGIPD), HED (ePIX, JUNGFRAU)
ITDM:
- E0.604 rack room, Wed next week
- fixing power distribution units in every rack --> TS and external company will need a full day
- affected services are: Lab DAQ, LAB control servers (EEE; CTRL, DET), GitLab runners, one machine for data analysis, PLC database, karabo project database (?)
- Yesterday short interruption with influx reading note --> test requested for next Monday causing a 1 hour interruption
XRO:
- SA1 / SA2 M3 PBLMs have been equipped with diamond plates and can be used for beam stability measurements
- Backlash Controls implemented last week --> values
- report of lost positions of vertical slit in SA3
- in case of similar issues please contact DOC prior to self fixing.
LAS:
- SA2 PPL is good
- SA3 PPL planned to be up today
- SA1 PPL being investigated as agreed with SA1 instruments
UNSYS:
- transparency test for APPLE X went successful
SPB/SFX:
- SPB/SFX aligned since yesterday, no issues
FXE:
- blown fuses in crates --> solved with EEE
MID:
HED:
- Com yesterday
- outstanding issue: fastADC not working EEE aware of that
SCS:
SQS:
- GATT always worked but very slowly responding
- OCD contacted
- Raul comments that this is a known issue and should be communicated to CTRL
- SH nesures that Raul creates the ticket
- XTD10_PES
- digitizer display frozen almost all time (connected to 2 DAQs) --> reported to DOC
- SH comments that when connecting to two DAQs (tunnel and SQS), should be connected to only one DAQ.
|
283
|
01 Dec 2021, 09:49 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 01.12.2021 |
General Announcement:
- Info that today the 20C cooling water will be switched to the towers was sent. Please also open rack doors to help until further notice. Tomorrow we will understand if cooling water tower is working and
if not, then A. Block and XO will communicate.
- Fire alarm happened this morning but not affecting people working at XHQ.
- Steffen H. says that DOC is not operational until middle January.
- Next Friday there won't be an UOM.
CTRL:
- Start with deployment today.
DA:
- Nothing to report.
EEE:
- Fully busy with preparation works and starting updates today.
VAC:
- Maintenance period activities been prepared. Tunnels are opened - if staff access rights are expired, please contact M. Dommach.
XPD:
- Not present.
DET:
- Nothing to report.
ITDM:
- Starting the maintenance activities today; On-line processes are unavailable until end of the week.
XRO:
- Last Monday: ramp down activities (stored motor positions for instruments with proper beam trajectories; XPD also worked with MCP detectors for all 3 SASEs (not done in SCS);
- XRO activities will be reported during this meeting series.
- Calibration SASE2 mirrors FD proposal was submitted for starting 2022.
- One PC at BKR (middle one) is extremely slow and shall be investigated during the maintenance time.
LAS:
- Maintenance on the PP-lasers are started.
UNSYS:
- Not present.
SPB:
- Not present.
FXE:
- Nothing to report.
MID:
- All fine at MID. It will investigate the water leak that happened this morning with chiller.
HED:
- Preparing XTD6 activity (exchange screen in monochromator) next week.
SCS:
- Nothing to report.
SQS:
- Nothing to report. |
465
|
01 Nov 2023, 10:04 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 01.11.2023 |
General Announcement:
- Jan G. as PRC comments: 1. reminds SQS and FXE instruments to place entries at the Operations e-log;
2. machine is running well and ZZ accesses happened on Monday (hindered by issues with tunnel entrance) but all done;
3. the XTD2 issue with upstream differential pump close to the XGM: one pump is defective and VAC will exchange if a ZZ is allowed next week.
CTRL:
- Nothing to report.
DA:
- Nothing to report.
EEE:
- FSSS motor in MID: OCD received a call yesterday and device was restarted and came back to operation.
VAC:
- Not present.
XPD:
- Nothing to report from XPD.
DET:
- Nothing to be reported.
ITDM:
- Nothing to report.
XRO:
- On the XTD10 ZZ last Monday: V-slit was checked and a faulty cable for the encoder was found. For the time being this was fixed by tapping it and will continue monitoring.
LAS:
- Nothing to report.
UNSYS:
- All fine with Undulator.
SPB:
- Nothing to report.
FXE:
- Beam was not stable the last night / down for few times. To be investigated internally at FXE and reported to XO.
MID:
- Roll motor for M2 mirror at tunnel was moving very slowly; to be seen with XRO.
HED:
- Nothing to report.
SCS:
- Nothing to report; working in hutch preparations.
SQS:
- Nothing to report.
SXP:
- Not present. |
273
|
01 Nov 2021, 10:10 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 01.11.2021 |
General Announcement:
- XO is currently setting scheduling meetings with the groups for planning and cross-checking the preparation for the Winter maintenance 2021. Meetings will take place between this and next week.
CTRL:
- Nothing to report.
DA:
- Announcement on the online calibration: for SPB it will be upgraded to Karabo 2.11. Today is preparation and later this week it will be deployed for the user beamtime.
EEE:
- Nothing to report.
VAC:
- Nothing to report.
XPD:
- Nothing to report.
DET:
- Nothing to report.
ITDM:
- Together with CTRL and DA and HED/MID instrument: solving hardware problem of online cluster - one has to swap locations of SA3 and SA1. This is ongoing right now.
XRO:
- Nothing to report.
LAS:
- Water leak in SA1. TS is aware and fixing it. The PP-laser was not switched OFF.
UNSYS:
- All is good; The seeding crystal in SA2 is on the right position for the self-seeding. Support will be available for helping the expert.
SPB:
- Nothing to report; Interesting data was acquired along the week and analysis will take few weeks.
FXE:
- Nothing to add.
MID:
- All fine.
HED:
- User experiment;
- Yesterday after midnight beam intensity dropped down from 1mJ down to 300uJ and BKR did not managed to recovered it.
SCS:
- Nothing to report.
SQS:
- Nothing to report. |
256
|
01 Sep 2021, 10:36 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 01.09.2021 |
General Announcement:
- A change of meeting room occupancy will happen soon (increase by some %) and will be posted at each meeting room door.
CTRL:
- Together with EEE, CTRL updated the pnCCD system and is working again. Hardware train-IDs acquisition was used by SQS yesterday afternoon and was successful.
DA:
- Nothing to report.
EEE:
- Nothing special to report.
VAC:
- Nothing to report.
XPD:
- Nothing to report.
DET:
- Follow up for the pnCCD today (offline calibration fixed). Detector is being cooled down and then data will be collected. DET supports CTRL that one had to make better plan earlier.
ITDM:
- Nothing to report.
XRO:
- Nothing to report.
LAS:
- Nothing to report.
UNSYS:
- Nothing to report; Cell#16 in SA3 got repaired on Monday.
SPB:
- Nothing to report.
FXE:
- Nothing to report.
MID:
- All fine at MID.
HED:
- Yesterday the beam was available for delivery later than 15:00 due to issues with machine tuning.
SCS:
- Not present.
SQS:
- Not present. |
345
|
01 Aug 2022, 10:02 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 01.08.2022 |
General Announcement:
- Today the SEPS interlock tests take place at all SASEs. This happens usually after maintenance periods and shall use the full day.
- For cw32: above 6.5keV only intensities of 500uJ shall be expected. An e-mail will be distributed by XO.
CTRL:
- SASE2 and SASE3 vacuum loops were not responding; both VAC loops were restarted.
DA:
- Nothing to report.
EEE:
- PLC team is doing a ZZ in XTD6 and handover to the instruments.
- This morning timing servers to be restarted (5 sec intervention) - no control on triggers during this time; the signals for triggering continue to be generated.
VAC:
- Issues with SA2 and SA3 loops already reported.
XPD:
- All fine with XPD.
- Gas changes for XGM are organized with Theo.
DET:
- Nothing major to report.
ITDM:
- Nothing new to report.
- GPFS problem reported last week: meeting with Desy experts is to take place.
XRO:
- XRO worked with SA3 on Saturday: M6 new mirror commissioned (found new position for this mirror); optical path for SCS and SQS is established.
- Vertical slit checked and not damaged; Device is working; Interlock was tested and an e-mail will be sent.
- Prepared for SEPS interlock tests of today (many modifications).
- Still to be done: beam illuminating SXP tunnel (maybe POP-IN imager is not working, but not sure); Still to check the soft-mono and the beam path.
- Question from Michael Meyer referring to hutch access today: as Interlock tests take place at 16:00, hutch access when closing the shutter has to be discussed with Safety / RPOs.
- SA1 and SA2 beam recommissioning are done; except of the SEPS interlock tests.
LAS:
- SA2 PP-laser shall be ready to go;
- SA1 and SA3 PP-laser will be available at latest Tuesday next week. The 282kHz mode is now available for SA1.
UNSYS:
- Air coils in SA3 cell 14 and cell20 had a problem and now it shall be solved after communicated between M. Yakopov and BKR.
SPB:
- Laser interlock issue was observed and solved.
FXE:
- Worked with D3 last week to recalibrate spare BTMs. Currently D3 had no spare parts and if the SA3 BTM would be triggered again it could stop North branch operation until a spare part would be available.
- There is an object in the beam path that can be seen: likely a cable belonging to the mono.
MID:
- All fine at MID.
HED:
- Nothing to add. HED is part of the ZZ in XTD6 together with EEE.
SCS:
- Nothing to report.
SQS:
- Nothing to report. |
526
|
01 Jul 2024, 09:40 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 01.07.2024 |
General Announcement:
-
CTRL:
- Done with updates in tunnels, BKR and instruments. Today continue with lab areas accordingly to schedule;
- Update of Beckhoff version with introducing units for datalog inputs. Working on a fix for some middle layer devices. A rollback can be done in few minutes if desired.
DA:
- Need to do fine tuning deployment for some packages in Maxwell, but not critical.
EEE:
- Nothing to report.
VAC:
- Well in time going with schedule. Tasks in XTD9 to be finished today.
XPD:
- Finishing last tasks;
- Bring Gotthard detector in XTD6 to work with Hirex. If needed access in XTD6 may be requested after Interlock tests.
DET:
- Inspection of AGIPD-1M at SPB/SFX happening with Desy colleagues.
ITDM:
- Nothing to report.
XRO:
- Everything fine.
- Couple of tasks ongoing in XTD6 (needed manual restart).
LAS:
- Not present.
UNSYS:
- Everything is fine.
SPB:
- Bug in the PLC for the chiller controllers.
- Problem with digitizers - in contact with Bruno F.
FXE:
- Broken Ion pump controller to be fixed with help from VAC.
MID:
- Nothing to report.
HED:
- Nothing to report.
SCS:
- Nothing to report.
SQS:
- Not present.
SXP:
- Nothing to report. |
138
|
01 Jul 2020, 13:53 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 01.07.2020 |
General Announcement:
- Interlock tests are starting in SASE3 instruments right now. Zunaira, Eric and Wolfgang Clement are coordinating the TUV tests in the XHEXP1.
- MXL announced a draft for the machine start-up schedule which is published at the BKR e-log. The link to the schedule is:
https://ttfinfo.desy.de/XFELelog/show.jsp?dir=/doc/Schedule&pos=2020-06-29T15:40:57
CTRL:
- Group has a plan to switch the data loggers today; MID was already done in the past; Migration of old data was already done in advance.
- There was a report of issues with the GUI server. Currently it is under investigation. A workaround is to disconnect and reconnect again or move to a second GUI.
More information will follow.
DA:
- DA has two major plans for the upcoming days/weeks:
1. Implement auto triggering in pipelines for the instruments (used for data analysis); 2. Stablish a plan to have spread knowledge on development tasks.
EEE:
- Installation of a SCS component is arranged for July 8th.
- Cabling in HED is scheduled to be performed in cw31; EEE will contact FXE to fix a cabling installation date.
- More than 50% of Beckhoff modules are changed.
- Working on PLCs business as usual.
VAC:
- All fine: nothing to report.
XPD:
- Nothing to report.
DET:
- Nothing to report.
ITDM:
- DESY/NOC needs to perform software update of the control network routers for all SASEs.
This will take place next Tuesday, the 7th of July, between 6AM and 8AM in the morning. An e-mail will be sent to the Readiness list.
XRO:
- Not present.
LAS:
- All lasers are running.
UNSYS:
- Nothing to report.
SPB:
- Nothing to report.
FXE:
- Nothing to add.
MID:
- All running fine.
HED:
- Nothing to report.
SCS:
- Nothing to report.
SQS:
- Nothing to report. |
330
|
01 Jun 2022, 09:52 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 01.06.2022 |
General Announcement:
- Martin Doering presents the status of the maintenance planning: currently XO is about to release the maintenance task list on next Friday;
major tasks such as electricity, electrical distribution cabinets will be done (power outlets OFF, emergency lights off);
cooling water maintenance will take place at XHEXP1 on 29.06.2022 (short interruptions);
Online computer server replacement on 22-23.06 (tbc) and no DAQ available;
elevator maintenance and TUV on 21-22.06 and 27-29.06, respectively;
master oscillator and timing system update on 27.06;
emergency OFF bridging and unbridging at XHEXP1 on 13-14.07 (need the EQP present if work is to be done at hutches).
- Total of 630 tasks are planned for this maintenance period. The infrastructure calendar available at Zimbra will contain the dates.
- When receiving the maintenance task list on Friday, please check for your submitted activities, the locations that are important for your group, and activities where your group is mentioned as support
group.
- In case of doubts or questions please contact Martin Doering at xo-planning@xfel.eu.
CTRL:
- Nothing to report.
DA:
- Nothing to report.
EEE:
- On the reported issues with conditional trigger of LPD at FXE: no update at this time.
VAC:
- Not present.
XPD:
- Nothing to report.
DET:
- Issues with train-ID at the LPD: No new info on its status.
ITDM:
- Not present.
XRO:
- Nothing to report.
LAS:
- Nothing to report.
UNSYS:
- Major action yesterday with motion sensor at quad mover in SA1/cell#18; the ZZ progressed during the whole day and the issue was fixed.
SPB:
- Photon energy request of 12.4keV: XO is working on that and will keep SPB updated.
FXE:
- Conditional trigger not yet tested.
MID:
- All fine at MID.
HED:
- Nothing to report.
SCS:
- Timing issue last week during beamtime: optical synchronization when used made the overlap with timing was lost. It is under discussion with LAS and Desy groups.
- Yesterday there was an issue with Vacuum with the DSSC: a bellow got damage due to overpressure. Working on a solution for next week’s beamtime. SCS shall contact VAC for available parts if needed.
SQS:
- Nothing to report. |
399
|
01 Mar 2023, 09:41 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 01.03.2023 |
General Announcement:
-
CTRL:
- Nothing to report.
- Problems with FXE motors were solved at the DOOCS side. It was not a Karabo issue.
DA:
- Nothing to report.
- As DRC P. Schmidt says all is running quietly this week.
EEE:
- Remind on the deploy of ADQ new digitizer to be done next Monday morning. It will be done in all instruments apart of SQS. In case of question please contact Bruno F.
VAC:
- All fine with VAC systems.
XPD:
- All fine with Diagnostics.
- The PES issue was resolved by exchanging the low voltage module in a ZZ also together with CTRL. Under investigation why the board was damaged.
DET:
- Nothing to report.
ITDM:
- Nothing to report.
XRO:
- Not present.
LAS:
- Nothing to report.
UNSYS:
- Nothing to report.
- Issue with FXE motors / undulators will be further investigated.
SPB:
- Nothing to report.
FXE:
- Nothing to report.
MID:
- Nothing to report.
HED:
- Setting up experiment.
- Problems with Karabo being slow which affected night progress. CTRL and DA will investigate with DOC.
SCS:
- Several problems with Karabo devices happening during the night. It seems to be solved by now. Jan-Torben D. will get further information.
SQS:
- Nothing to report.
SXP:
- Nothing to report. |
203
|
01 Mar 2021, 10:49 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 01.03.2021 |
General Announcement:
- An e-mail from Steve Aplin informs on how to contact the DATA operation center during beam delivery times. It changes contact phone numbers for OCDs.
Old numbers are discontinued. The 98089 is the new number.
- The lead scheduling for machine/operation can always be found at the TTFINFO link (BKR E-log). Any other schedule is not official.
- Hutch search training goes invalid for many scientists in the instruments. Please check your status at the DARF-DACHS system or with RPOs.
- If there is anything unclear with masks or Corona rules, please give feedback in this meeting series or to the corona task force.
- Gerd W. says that works on SCS chicane are taking place right now. Afterwards a check will be done until Wednesday. The SCS key is still removed.
CTRL:
- Next days CTRL would like to solve DAQ situations while restarting devices. For SPB it is under discussion when to proceed.
DA:
- Not present due to planning meeting for end-to-end DA commissioning.
EEE:
- Fast electronics: a problem with SA3 PP-Laser (timing issue) was found and a board will be replaced.
- PLC side: deploying SA3 laser interlock. EEE will get in touch with XO for agreeing on a date.
VAC:
- XTD6 is still open and will be closed tomorrow (Tuesday 02.Mar) afternoon.
XPD:
- Friday at 15:00 there was a wide spread network issue and XGMs were giving warnings. The XGMs came back rather quickly but beam was lost until Saturday.
DET:
- Preparing for the SPB detectors commissioning with beam this week. One module was exchanged and will be evaluated next Monday.
ITDM:
- Nothing to report.
XRO:
- Not present.
LAS:
- SA3 PP-laser: issue on Thursday afternoon late; Replacement boards were received. Tomasz J. informs the triggers were lost in the last 5 minutes.
- Tomasz J. question if LAS is going to receive enough support on Mondays from the DATA center as they have to prepare lasers for Tuesday.
LAS expect same level of support on Mondays from DATA department. Steffen H. says that the OCD and Data Run coordinator will support the activities.
UNSYS:
- Nothing to report.
SPB:
- Receiving beam from tomorrow on.
FXE:
- Working with EEE to get Beckhoff loops finished for the AIBS test taking place at FXE on Thursday.
MID:
- All fine at MID.
HED:
- HED asks for the status on the ADC issue. Bruno F. says it is being fixed today (crate is up and running) and objective is to finish by today.
- Question to CTRL on cameras: S. Hauf says that CTRL will ask HED to test the fix. HED will contact Dennis G.
- Pouneh S. says that for laser safety googles it is exceptionally allowed to use FFP2 masks with filters. A. Galler points that the Corona task force strictly forbids
this type of masks at XHEL as protection against Coronavirus.
This subject will be brought to the Task Force for more clarifications.
SCS:
- Sliding door issue is ongoing. Eric Boyd says that Zunaira A. is in contact with the company and they will come to XFEL on Wednesday (it is caused by the controller of
the door).
SQS:
- Nothing to report. |
391
|
01 Feb 2023, 10:56 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 01.02.2023 |
General Announcement:
- A. Galler reminds instruments to use the Operation-2023 e-log for daily reports.
CTRL:
- Issue with Karabo dataloggers connection to newly available Proxies (not connecting). Problem is understood and a fix in under made. Then one shall apply to topics (takes 5-10 minutes downtime).
DA:
- Nothing to report.
EEE:
- Nothing major to report; working on a received ticket.
VAC:
- Last night FXE reported issues with SA1 ion pump. Vacuum was OK but the status of Karabo was wrong. It's under further investigation and Wajid E. comments a ticket was sent and is being addressed.
XPD:
- Nothing to report.
DET:
- Detector installed back to HED (ePix) after successfully intervention.
ITDM:
- Updates of Maxwell cluster was done yesterday. If something unexpected happens please get back to ITDM.
XRO:
- Instruments taking beam at hutches and no major problems have seen so far.
LAS:
- SA1 and SA2 PPL's are in operation.
- SA3 PP-laser is under preparation.
UNSYS:
- Issue with cell24/SA1 undulator motion happened and was fixed on Monday.
- Gap of exchanged undulator in SA2 seems not be correct and it is needed a ZZ for the gap calibration, possibly next Monday (tbc).
SPB:
- Camera devices goes to error and needs power cycle.
- After power cut some motor lost positions.
FXE:
- He gas supply: A. Galler informs that currently there is no shortage of He for the next two weeks.
MID:
- Making good progress by setting things up at instrument.
- One sample stage has problems and EEE will work on Friday.
HED:
- Preparing for taking beam on Friday and currently working on Dipole laser.
SCS:
- Problem with new Interlock and BKR had to overwrite it. Beam is now at the instrument.
SQS:
- Not present. |
195
|
01 Feb 2021, 09:06 |
Arvid Gebhardt | General | Information | Notes XO Integration Meeting 01.02.2021 |
General Announcement:
- The test of the emergency automatic switch of power bridge is scheduled for Tuesday, 2nd of February 2021, 09:00. This will affect orange outlets in XHQ and green and orange outlets in XHEXP1. A short interruption in the power supply lines will happen. We expect all groups have taken appropriate measures to place devices in safe mode or connected to white power outlets.
CTRL:
- not much to report, things are running
- Read the docs is operational again. A given feedback to CTRL is welcome.
DA:
- Nothing special to report.
EEE:
- Tomorrow update sase1 motion loop at 13:00: an email will be sent to readiness mailing list.
VAC:
- Nothing to report.
XPD:
- Maintenance work ongoing: Imagers in XTD6; Work with EEE in XTD6 and XTD9.
DET:
- AGIPD: new control with new gain is tested. DAQ issue with data is fixed (K. Wrona informs it was related to a wrong hidden parameter setting).
ITDM:
- Downtime on Offline calibration system / GPFS: update to be made in about two weeks from now. K. Wrona says that ITDM would like to have one day of GPFS maintenance; it is important to switch to the new scratch files before we start operation. Data taking shall not be affected by this.
- Jan G. asks when would be required by the earliest. K. Wrona says they need to copy a lot of data before the update and it is estimated in two weeks (+-2 days), to take place in the second half of February. As photon activities take place in the last two weeks of February, one needs coordination to find a suitable date.
XRO:
- everything fine.
- Today closing of soft mono chamber in XTD10.
LAS:
- Upgrade in SA1 uTCA: information will be given to LAS this afternoon.
- Two Desy colleagues needs access in SA1 hutches. Use of FFP2 masks is mandatory.
UNSYS:
- ZZ in XTD4 is planned for Wednesday (for cleaning undulator area).
- Suren K. asks if the balcony rooms are effected by test emergency power switch. This will be discussed offline.
SPB:
- Nothing special to report.
FXE:
- Nothing special to report.
MID:
- all fine
HED:
- Nothing special to report.
SCS:
- Nothing special to report.
SQS:
- Nothing to report. |
204
|
03 Mar 2021, 09:23 |
Arvid Gebhardt | General | Information | Notes XO Integration Meeting 03.03.2021 |
General Announcement:
- Hick-ups in the beam operation are happening since last night. There is no obvious indications on the origin of the problem and MXL is investigating to restore a normal beam delivery condition.
- There is an issue with “Operation-2021” e-log where some SPB staff can’t login to create entries. This will be addressed by XO/PRC and ITDM (see ITDM entry).
CTRL:
- SA1 DAQ was dropping some trains (the late ones) in the XGM. CTRL and ITDM are following up and will test the XGM late this week or next week. CTRL will contact XPD for deployment first in SA2 and SA3.
DA:
- News from the DOC: deployment of major updates ongoing/to take place.
EEE:
- nothing to report
VAC:
- not present
XPD:
- Commissioning and setting up for SA3 HIREX
DET:
- preparing for commissioning Detectors
ITDM:
- Janusz S. says the configuration for the “Operation-2021” e-log uses the same configuration as previously set for 2020. F. Wolff-Fabris likens the issue with possible new users and asks SPB to provide the name of users who can’t login into the e-log.
Janusz S. says one can use the copy function from instruments e-log to place a copy into the Operations-2021 e-log. Jan G. says that login is necessary to avoid the entry being as “Anonymous”.
XO and ITDM will address it offline.
XRO:
- not present
LAS:
- In SA3 PP-laser one had exchange of power supply for AMPHOS due to communication errors.
- In SA1 PP-laser one observes a loss of 1/4 of power in AMPHOS. LAS is not sure if there is enough power for users.
- Two problems with triggers on Monday: 1. a faulty board in SA3; 2. MCS group update timing system caused trigger loss in all hutches (due to a bug in their server).
UNSYS:
- nothing to report
SPB:
- Couple of Helps asked to DOC and SPB/SFX are thankful for that.
- Login at Operation-2021 e-log does not work for 4 people.
FXE:
- Prepared for AIBS. Few PLC problems remain but not related to AIBS.
- Next week between Tuesday/Friday there are no access to the hutch due to floor work ongoing.
MID:
- all fine
HED:
- all fine
SCS:
- sliding door will probably be repaired today with an external company.
SQS:
- nothing to report |
309
|
16 Mar 2022, 10:39 |
Frederik Wolff-Fabris | General | Information | Notes XO Int. Meeting 16.03.2022 |
General Announcement:
- The Summer maintenance planning period is approaching and next Wednesday at the end of the XO Int. Meeting a presentation of the changes/improvements will be made.
Please communicate to the colleagues who are responsible for your group’s maintenance planning to join. This will be done after the regular round of discussions.
CTRL:
- Not present.
DA:
- Nothing to report.
EEE:
- Continuing with support tasks to the groups.
VAC:
- Not present.
XPD:
- XGMD was fixed (ADC broken down twice last week): Desy people is also investigating; root cause not yet found.
- FEL Imager (YAG screen) in SA3 is found to be damaged. It was moved to a different spot for the time being.
- Ventilation in all tunnels caused beam jitter for 30-40 minutes yesterday.
It was caused by outside humidity (not common, 2-3 times per year) that filled up the filters and clogged it with water droplets leading to overrunning of the regulation schemes of pumps; then pressure
changed in tunnels.
DET:
- Nothing to report.
ITDM:
- InfluxDB: large issues yesterday (cluster crashed on MON evening); it took all day yesterday to brought up and data is now visible also at Karabo.
- ITDM has a root cause now and DAQ matrix devices were switched OFF yesterday which provides a fix. Last crash there was a lot of data that had to be synchronized and lacked resources.
- ITDM found a way to start without data from Monday evening to Tuesday 21:00. This data will be injected to InfluxDB / cluster in the coming days. In the meanwhile, one needs to use Graphana to look at
this data, not Karabo.
- Discussing future measures to trigger alarm to avoid the crash.
- Please don't start DAQ without the GO from ITDM via e-mail.
XRO:
- FXE jitter last week: not yet clear if it was the clean tent or the cooling water for M1/M2 the real cause; hard to find as cooling water was refilled and the clean tent was switched ON accidently, both
in parallel.
LAS:
- Issues with Sync system in SA1 persists: spurious 10Hz signal. PP-laser still do not have optical signal. LAS has a rough idea of the cause and is in contact with instruments.
UNSYS:
- Phase shifter in cell11/SA3 the motor was replaced and more 10 motors were ordered as spare parts.
- Quad mover in SA1#cell 18 was fixed.
- Quad mover in cell25/SA3 (wrong movement direction) is still to be addressed. MXL will work together with UNSYS.
- Tables for Phase shifters of Apple-X still to be uploaded.
- One new PS on the Apple-X is not working; Frank Brinker is informed and a ZZ is needed before the next blue week.
SPB:
- Influx issue but could use Graphana.
- Pulse energy is low this week: 2mJ while last week was 3.5mJ;
- Crosstalk with SA2: SA1 energy gets worse when changes happen in SA2 but recovers shortly after.
- SPB did not see any vibration on Tuesday 15.03. Also last week beam was stable.
FXE:
- Nothing to add.
MID:
- All fine at MID.
HED:
- Not present.
SCS:
- This morning a filter of RIXS spectrometer broken and has to be exchanged (filter gauge valve). VAC group is helping with the exchange.
SQS:
- Nothing to report. |
308
|
14 Mar 2022, 10:41 |
Frederik Wolff-Fabris | General | Information | Notes XO Int. Meeting 14.03.2022 |
General Announcement:
- On the Summer-22 maintenance period: In about 2 weeks (by end of March) the call for the summer/22 maintenance period will be send to the groups.
CTRL:
- Deployment of new framework in order to fix an issue (this week): instruments shall agree with CTRL contacts on a suitable time. It affects cameras and/or similar devices that are installed.
DA:
- Report on last week issue with processing on Maxwell including offline calibration: people were not able to open files that were there; small selected notes were not present and were corrected on Friday.
Since then it seems no issues recurred.
EEE:
- Starting equipment installation of SXP racks in rack rooms.
- PLC side calls from SQS on weekend: issues with motors to be followed up; train-IDs not getting proper.
VAC:
- Not present.
XPD:
- XGMD in FXE hutch under investigation: new issue happened at the end of the week and may be again related to last Monday's one. People are working on it (XPD, FXE and Desy).
DET:
- One comment to DA: Jolanta S-D was on DOC and issue with offline for ePIX detector still occurring after Friday. Phillip S. says it was a different problem and it is fixed.
ITDM:
- Issue (2x) with Influx): still not understood; Data was not lost on last occurrence. Hick-ups and recovered. So far under investigation.
XRO:
- Jitter at SA1 in FXE last week: mostly likely the cooling in M1 and M2 or clean tent.
- No big issues after that.
LAS:
- Degradation in SA1 PP-laser with trigger software; maybe there is damage to optics. Being investigated today and can't guarantee when it will be working again.
- SA3 change of setpoint for SQS taking one-two days. Not sure if ready today.
- SA2 is running well.
UNSYS:
- Phase shifter cell11/S3: a ZZ is ongoing also fix with remotely procedure.
- Issue with quad mover cell18/SA1 is fixed remotely.
- Issue with Quad cell25/SA3: the ZZ is needed.
SPB:
- Issue with Agipd detector: fixed (one module not sending data).
- Agipd online preview devices: fixed;
- Laser timing issue: data was not collected.
FXE:
- Jitter problem already mentioned.
- XGMD issue under investigation.
- Laser problem: stop measuring on Saturday. Not sure if data was taken during the weekend.
MID:
- Difficult week.
- Broker pileup problem on Monday and Friday: Gabriele says it may be related to a memory leak - under investigation.
On Friday there were there sources identified to help getting rid of problems (Jolanta S.D); also GUI was a second source. Not fully understood the main source of Friday. It came back stable.
- Seeding beam had to be tuned on weekend as energy decreased by factor 5 when comparing to the best lasing at the week start. No scientific output could be achieved but feasibility with setup was
demonstrated.
HED:
- Wednesday optics hutch ADC was not working. Now it works fine.
- Full power with RELAX was tested and is being analyzed. Bassler cameras acquiring wrong train IDs. It shall be fixed.
SCS:
- Not present.
SQS:
- Successful week;
- Problem with motor being fixed by SQS, ME, EEE.
- Tool for online analysis was slow
- Heat load in the soft monochromator was seen and it has to be fixed in long term. |
97
|
10 Feb 2020, 10:12 |
Frederik Wolff-Fabris | General | Information | Notes Dispatch meeting Feb 10th, 2020 |
SPB: Nothing to report;
FXE: Everything ongoing; nothing special to be reported;
MID: Finalize motors of split and delay line; MID has to test interlock for vacuum loop update.
HED: Commissioning of laser heat table. It may need assistance from EEE and CTRL during the week.
SCS: Nothing to report - Last week's mounted setup will be disassembled in order to mount the standard setup for users;
EEE: OCD was called from XRO during beamline alignment of SA2: 1 BMPI motor had a problem and is under investigation - EEE reminds on the new homing position for
negative direction motion.
CTRL: Following reset of train-ID and timing system for today.
XPD: Shifted Beam Pointing Studies from A. Koch to Tuesday.
DET: Nothing to report
*machine is currently not running due to filter clean in the cold compressor. Shall be re-started this afternoon and by tomorrow must be lasing.
*Master time reset and train-ID reset this morning. Then EEE (check systems), followed by CTRL (karabo servers re-start) and ITDM (check DAQ operation). LAS and DET are
informed.
*Wednesday: Network stress test with Cameras by CTRL on Wednesday 12:00-14:30. |
111
|
20 Apr 2020, 10:59 |
Frederik Wolff-Fabris | General | Information | Notes Dispatch Meeting 20.04.2020 |
General:
- Desy informed a power glitch occurred on Thursday 16th at 04:55AM. TS has not seen any traces of it in the EuXFEL internal GLT.
- From next week the Dispatch meeting will start at 09:30AM.
- An additional Friday's Integration Meeting will happen at 11:30AM. Proper information and invitation will be send soon.
CTRL:
- The notification service for the reduced operation mode is ready for start-up and an e-mail will be send around with instructions.
- Groups/staff will be requested to subscribe to the lists.
- Training will be conducted on next Wednesday at 15:00 and/or next week. One member of each group is required to attend it.
DA:
- Nothing to report. Working busily from home.
EEE:
- No issues to report
VAC:
- Two pumps located in a gas attenuator were OFF due to the power glitch of last Thursday 16/04 at 04:55AM.
XPD
- No issues related to the power glitch were observed.
- XPD has received devices and they were successfully stored in vacuum / clean rooms. Another devices shall arrive this week.
DET:
- Nothing to report.
ITDM:
- Nothing to report.
XRO:
- Nothing to report.
LAS:
- Not present.
SPB:
- Nothing to report.
FXE:
- Not present.
MID:
- Everything is fine.
HED:
- All is fine, all is running.
SCS:
- Not present.
SQS:
- Not present. |
102
|
16 Mar 2020, 09:36 |
Frederik Wolff-Fabris | General | Information | Notes Dipatch Meeting March 16th, 2020 |
FXE:
- Beamline is in safe state;
- Minor Jungfrau calibration issues over last week. In touch with DET and EEE;
SPB:
- Good exercise: experiment run with only 2 users. Successful beamtime with data taken: to be analysed by users;
MID:
- Successful beamtime with good beam conditions and data has been taken;
- Beamline is in safe state and most of staff is in telecommuting;
EEE:
- Start collecting a list of broad activities to take place in case of a long shutdown;
- No major issues to be fixed;
CTRL:
- Few cameras and detectors hiccups – e.g. DAQ re-start bring system back;
- Most of people will run from home office / telecommuting;
- Tests together with EEE/FXE still to be performed this week - to be scheduled;
DET:
- DET is placing a plan to warmed up detectors and be ready for shutdown;
- AGIPD, DSSC are already in safe mode; |