ID |
Date |
Author |
Location |
Severity |
Subject |
289
|
05 Jan 2022, 09:29 |
Andreas Galler | General | Information | Notes XO Integration Meeting 05.01.2022 |
General Announcement:
CTRL:
DA:
EEE:
- 1 MID plC dead
- cable work planned for next week
VAC:
- In general excellent progress
- closing of M2 XTD2 (SA1) in progress, sealing issues mitigated
XPD:
- XTD10, XTD6
- improvements, commissioning ongoing
- clean room tent water leak reported on 23.12.
DET:
ITDM:
- Jan 19: dCachce maintenance
XRO:
- progress as planned
- changes to existing components will be posted to respective elogs
LAS:
UNSYS:
SPB/SFX:
FXE:
MID:
- PLC outage on Jan 1 st caused VAC issues (reported by EEE)
- no access to MID optics hutch due to interlock test
HED:
- everything on schedule
- leak on a hose to humidifier device in A12. This leaked a few litres on the floor.
SCS:
SQS:
|
571
|
04 Dec 2024, 09:41 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 04.12.2024 |
General Announcement:
- A. Galler informs X-rays for cw49 are currently been tuned today due to the issues with the cryo plant last week. Schedule for delivering the beam to instruments is to start by 15:00 today.
CTRL:
- Nothing to report.
DA:
- Nothing to report.
EEE:
- Nothing to report.
VAC:
- Nothing to report.
XPD:
- Everything is fine; switch to 17keV XGM went fine.
- As PRC, J. Gruenert has nothing to report.
DET:
- Nothing to report.
- Burned power plugs on LPD: no updates, however all modules are working.
ITDM:
- Not present.
XRO:
- Nothing to report.
LAS:
- All quiet with Lasers.
UNSYS:
- Everything fine apart of the PS in cell20/SA3 (to be fixed in the WMP).
SPB:
- Nothing to report.
FXE:
- Regarding the LPD: cable was by-passed.
MID:
- All fine at MID.
- On Monday 09.12 there will be a switch in beam delivery to HED.
HED:
- Not present.
SCS:
- Nothing to report.
SQS:
- Nothing to report.
SXP:
- Preparing for beamtime this week. |
474
|
04 Dec 2023, 09:52 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 04.12.2023 |
General Announcement:
-
CTRL:
- E-mail sent this morning to xo-info for Karabo and CTRLs maintenance starting today.
DA:
- Nothing to report.
EEE:
- Personnel is affected by Covid-19 sickness; task schedules may be affected as well.
VAC:
- Not present.
XPD:
- Tasks ongoing.
DET:
- AGIPD 1-M at SPB/SFX: 16 modules were replaced but 1 is not working and new intervention has to be made to exchange it;
- AGIPD at MID with 2 modules problems: inspected by Desy colleagues and found the problem with wire, that was fitted and now is fixed and working again.
ITDM:
- Starting today with maintenance: CTRL network replacement starting today
- Please expect until 6PM today that connection breaks may happen
XRO:
- Replacing Mono component at SA2 tunnel; needs Karabo to conclude when service is back.
LAS:
- Nothing in terms of unexpected issues.
- Last Thursday it was difficult to find when power went back (lost 4hs)
- SA3 shutdown due to fire alarm: needs feedback from SRP.
UNSYS:
- Two Apple-X undulators are in shaft building and preparing for installation; Today alignment of PS vacuum chambers;
- Affected by sick leave as well as from sickness in Desy transport group.
- Two encoders are damaged in the cam movers below one Apple-X. In contact with Bekhoff; maybe delay can be expected.
SPB:
- Nothing to report.
FXE:
- Not present.
MID:
- Not present.
HED:
- Nothing to report.
SCS:
- Nothing to report.
SQS:
- Nothing to report.
SXP:
- Not present. |
562
|
04 Nov 2024, 09:44 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 04.11.2024 |
General Announcement:
- Last Friday was the deadline to submit the Winter Maintenance task list. We thank the groups who have submitted them. If your group did not make it yet, please get in touch with XO.
CTRL:
- Nothing to report.
DA:
- Nothing to report.
EEE:
- Nothing to report.
VAC:
- Nothing to report.
XPD:
- EPS interlock for MID Pop-in and graphite filter is disabled and will be reset back tomorrow.
DET:
- Nothing major;
- LPD bugs were fixed during the weekend.
ITDM:
- Nothing to report.
XRO:
- Nothing to report.
LAS:
- Not present.
UNSYS:
- Problem with power supply / driver quad mover during the weekend in SA2/cell 17: fixed by ZZ.
- SA3 cell25 driver for two motors need access for Apple-X studies.
- Also need investigation for PS in cell26/SA3.
SPB:
- Nothing to report; data being collected.
FXE:
- Preparing for D3 tests; issues with DET solved.
MID:
- Nothing to report; happy with beam/machine performance
HED:
- Taking some beam tomorrow and Wednesday for high Z detector tests.
SCS:
- Nothing to report.
SQS:
- Nothing to report. In-house with attoseconds next week.
SXP:
- Doing experiment; ongoing. |
175
|
04 Nov 2020, 10:55 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 04.11.2020 |
General Announcement:
- XO reminds on the 4.5MHz operation: MXL tested a 12hs switching mode and this will be used along the week.
The night shift operates at 4.5 MHz and day shift at 2.25MHz to avoid sending unnecessary bunches to the dumps.
CTRL:
- Issues with MC2 motors (bug in moving, mainly in SA3). CTRL has a fix but it is hard to find a proper time slot this week to apply it. The idea is to deploy next Monday
only in SA3 first.
If issues are found beforehand, please contact CTRL.
- SQS mentions a bug in the mirror observed yesterday which relates to the above described issue. SQS has to observe it to verify it moves all the way and then one can
wait until Monday for the fix.
DA:
- Nothing to report.
EEE:
- Crate issue in SA2: it was not needed to exchange the crate. A reboot on Monday afternoon helped to bring system back.
Crate works as normal. During winter shutdown EEE will replace crate and power modules.
- MID and LAS reported issues with train-ID / timing servers. Triggers have not been delivered in 10Hz. This is in discussion with DESY.
One solution is an update of the DOOCS timing serves that do not show errors which does not interrupt timing servers. In MID this may be related to data recording.
For the PP Laser further discuss with Desy colleagues will be made. This affects only MID because the use of old version of Doocs server.
- MCP problems reported by XPD: mismatch on the firmware version and EEE plans to upgrade this week.
- Preparation for the winter maintenance is ongoing and installations can start on 23/11.
VAC:
- VAC would like to thank EEE and CTRL for the SA3 loop vacuum fix.
XPD:
- XPD found another issue with MCP: wrong assigned triggers. A ticket will be created.
DET:
- Update of MID AGIPD is still an issue but this is not critical at the moment.
- CTRL has accessed the LPD detector issue.
ITDM:
- K. Wrona informs ITDM has the reservation of Maxwell for data analysis during next two weeks.
The user groups have to be informed that one has to use Maxwell reservation to quick analyze data.
XRO:
- Nothing to report.
LAS:
- SA1 SPB PP-laser had to increase energy and is on work.
- SA2 PP-laser missing trigger from around 7PM yesterday. Laser went OFF due to this and luckily LAS was watching it and was able to switch ON quickly. LAS is in touch
with EEE and Desy.
A fallback solution could be to generate triggers by hardware but there is no progress from Desy side. LAS will prepare specifications for this module.
UNSYS:
- Small hiccup in one SA2 undulator that was remotely corrected.
SPB:
- Trying to align beam: SPB sees elliptical rings. Andreas G. suggests if this continues please communicate to the PRC.
FXE:
- No further information on issues with the LPD.
MID:
- Tomorrow it takes place the AGIPD train-ID meeting.
HED:
- Vacuum valves in differential pumping system were strangely closed on Friday 2AM. HED discovered this only yesterday. Pressure slowly went up. HED will further
investigate.
SCS:
- Not present.
SQS:
- 4.5MHz operation had gun trips due to the overheating of the dump.
F. Wolff-Fabris comments that was due to the radiation alarms on the dumps that removed beam permission by about one hour around 4AM. |
457
|
04 Oct 2023, 09:52 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 04.10.2023 |
General Announcement:
- A. Galler reminds this is a facility development week and for the next UOM on Friday a report of stability/jitter shall be done by the instruments.
- Martin Doering announces the Winter maintenance period 23/24:
1. The new maintenance task list was sent to the groups last week;
2. Deadline to submitting back the filled list is Oct.20th; release takes place on Nov. 16th and maintenance period starts on Nov.30th.
3. Locations can be chosen with dropdown menu in a 3-step process;
4. Services needed and blocked are condensed in two dropdown fields;
5. Submit task list to xo-maintenance@xfel.eu; for questions please address xo-planning@xfel.eu.
CTRL:
- Nothing to report.
DA:
- Nothing to report.
EEE:
- PLC team working in SQS Elmo motor drive.
VAC:
- Nothing to report.
XPD:
- Nothing to report.
DET:
- Nothing to be reported.
ITDM:
- Nothing to report.
XRO:
- Nothing major to report.
LAS:
- Nothing to report; PP-lasers survived the power glitches.
UNSYS:
- Nothing to report.
SPB:
- Nothing to report.
FXE:
- Nothing to report.
MID:
- Question to EEE on the timing crate: it seems to be fine now.
HED:
- Nothing to report.
SCS:
- Nothing to report.
SQS:
- Issue with 1-bunch digitizer (uTCA in rack room): SQS will contact EEE.
SXP:
- Not present. |
265
|
04 Oct 2021, 09:30 |
Andreas Galler | General | Information | Notes XO Integration Meeting 04.10.2021 |
General Announcements
none
CTRL
- late train IDs at XGM, being sorted
DA
- nothing to report
EEE
DET
ITDM
- nothing to report
XRO
-
LAS
- Failure of Power SUpply on AMPHOS in SA3, had been replaced over the weekend,
- observed jump on ODL in SA2 around midnight --> being investigated
UNSYS
- nothing to report
- PKG status to be discussed
SPB/SFX
- nothing major to report
FXE
MID
- Feedback for M2 stopped working, started calculating wrong values
HED
- nothing to report
SCS
- problems with DAQ: DA1 stuck --> DOC and ITDM are aware
SQS
- nothing to report
AOB
|
545
|
04 Sep 2024, 09:40 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 04.09.2024 |
General Announcement:
- Machine tuning last two days was hindered as a power supply for a camera in injector laser had to be exchanged. As consequence, the camera moved and had to be re-aligned costing time.
So far, they manage to tune satisfactory and beam is delivered to instruments since 7AM.
CTRL:
- Nothing to report.
DA:
- Nothing to report.
EEE:
- Nothing to report.
VAC:
- Nothing to report.
XPD:
- Not present.
DET:
- Nothing new on the AGIPD issue.
ITDM:
- Nothing to report.
XRO:
- No deterioration of M1/SA1 since weekend.
LAS:
- PP-L SA1 AMPHOS service finished and in delivery to instruments.
UNSYS:
- Issue of last Monday is fixed.
SPB:
- Aligned beam with FXE together; beam is found at SPB/SFX and FXE.
FXE:
- Nothing to report.
MID:
- All is fine.
HED:
- Setup of beamtime going smooth; HIREX setup ongoing; tuning for HXRSS from 11AM.
SCS:
- Mechanical problem: vacuum chamber had to be vented and is now pumping down.
- Other work in parallel with samples is progressing.
SQS:
- Nothing to report.
SXP:
- Not present. |
448
|
04 Sep 2023, 09:46 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 04.09.2023 |
General Announcement:
- Last week was a facility development week / blue week. Another cyo issue happened on Friday morning which was recovered quickly.
- As DRC, Steffen H. reminds on the Jour-Fixe today at 13:00 to instruments communicate needed data allocation; also reminds on calling DOC may have a quicker help than sending a ticket.
CTRL:
- DOOCS clone devices disappearing from topics was fixed on Friday and since then works nicely.
DA:
- Nothing to report.
EEE:
- Nothing to report.
VAC:
- Not present.
XPD:
- XPD involved in facility development since Friday. All activities went fine and more studies for Harmonic lasing and Aspect will be continued.
- J. Gruenert mentions for cw38 XPD and XRO colleagues are in Trieste for a conference and only limited staff is available for support. Basic functionality of devices is guaranteed.
- REXX servers were down last week.
DET:
- Nothing to report.
ITDM:
- Nothing to report.
XRO:
- Message to SA2 instruments: last week the Euler calibration was done for M1 and M2 and instruments can make use. The link is on the main mirror scene and the SA2 scene will be updated.
LAS:
- Nothing to report.
UNSYS:
- Issue with cell 25/SA2 terminal: undulator could not be used for harmonic lasing. Needs access for fixing.
SPB:
- Nothing to report.
FXE:
- Nothing to report.
MID:
- During the blue week it repaired the long arm for detector angular motion.
HED:
- Issues with IDC on rear module; EEE is working on it.
SCS:
- Nothing to report.
SQS:
- Nothing to report.
SXP:
- Not present. |
248
|
04 Aug 2021, 10:19 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 04.08.2021 |
General Announcement:
- There was a power glitch last night around 10:30PM at the Desy power distribution. XHQ and XHEXP1 seemed to be not affected - probably devices that gets cooling water from Desy could be affected.
Please inform XO if it is found any affected equipment in the XHEXP1 side.
- Raul V. asks on the fix CTRLs has applied to the vacuum issues last week. Steffen H. will give details offline.
CTRL:
- Bi-directions of clones may not have been working properly and CTRL is investigating and preparing a solution for it.
DA:
- Nothing to report.
EEE:
- Small issue with FXE timing (strange behavior of RTMs). It happens when communication to main timing system is interrupted and it affects mainly the FXE PLCs. Result is that devices may not correct
trigger.
- Cable installation currently ongoing in HED and scheduled at FXE (cw33).
VAC:
- Last night status of critical pumps was checked and seems that there was not water interruptions (very first time for a power glitch). These pumps stay working normally during the night.
XPD:
- No issues to report due to the power glitch.
DET:
- Jungfrau activities at SPB were delayed because of beam delivery issues with the number of bunches.
ITDM:
- Nothing to report, also regarding to the power glitch.
XRO:
- Not present.
LAS:
- Unaffected from the power glitch. PP-Lasers are working.
UNSYS:
- Everything is fine with Undualtors.
- SA3/cell6 quad mover has a problem unrelated to the power glitch. As agreed with BKR, it stays as it is Monday when corrective actions to recover it will be made.
SPB:
- Beam delivery problems yesterday regarding the bunch number: A. Galler says that accordingly to W. Decking, when running in interleaved mode it may cause that problem if the suppressions does not work
correctly.
Further investigations are under way by MXL. If this is an issue for equipment BKR can install an interlock on the Big Brother and probably a detailed discussion with interleaved mode instruments can help
in this direction.
FXE:
- Nothing to add.
MID:
- Looks like the beam today is very unstable. Data were collected and the stability task force will be contacted.
HED:
- Nothing to report.
SCS:
- Not present.
SQS:
- Yesterday a situation happens when 1 PLC went OFF unintentionally, causing a pump went OFF afterwards. SQS asks if this can be followed in a way the pump does not goes OFF in such events.
Raul V. comments that 5Hz turbopumps at the tunnel have a configuration to prevent it by disabling the automatic switch in the component configuration.
Nerea J. says that they can take both tunnels and SQS used configurations to bring them together. |
338
|
04 Jul 2022, 09:30 |
Andreas Galler | General | Information | Notes XO Integration Meeting 04.07.2022 |
General Announcement:
- M. Döring:
- almost all of the activities that should have been done until last Friday had been done
CTRL:
- last week karabo topic updates had finishedexcept for LAS
-
DA:
EEE:
VAC:
- leak search on M6 (SA3) chamber
- leak search in XTD9
- all in all well
XPD:
- almost all tasks have been completed
- XTD1 new crate connected on Friday,
DET:
ITDM:
- all updates are finsihed
- some activities continuing on the offsite --> should be comüpletely transparent
- after the prox change there are some PCs which are using the old host names --> relavant people will be contacted by Janusz Szuba
XRO:
- M6 mirror installation beign finished
- end switch checks shoudl be finished by today
- ramp up procedure being written down
- instruments are asked to submit any additional requests for ramp up
LAS:
- fastADCs should be finished by Wed this wek
UNSYS:
- control system has to be adjusted after removal of APPLE X, i.e. the control system looks for motors and
SPB/SFX:
FXE:
- motor commissioning ongoing
MID:
HED:
- when modifying cables downstairs, make sure modules upstairs are switched off
SCS:
SQS:
DRC
PRC
- SCS incident on Monday, photon energy scanning script was left running --> had to be stopped manually
|
322
|
04 May 2022, 09:59 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 04.05.2022 |
General Announcement:
- Issues with machine on Monday (misaligned photocathode laser). Beam delivery started only Tuesday at 15:00 instead of 07:00AM. Cause is understood and mitigation strategy is put in place by MXL.
CTRL:
- Nothing to report.
- Monday's Karabo deployment went well.
DA:
- Nothing to report.
EEE:
- Nothing to report.
VAC:
- Nothing to report.
XPD:
- Part of PES detectors were repaired on Monday's ZZ (14 out of 16 are now working).
DET:
- Nothing to report.
ITDM:
- SPB metro device causing Telegraph to stop sending data. Solved by DOC and a fix will be deployed today together with DA.
XRO:
- Not present.
LAS:
- Nothing to report.
UNSYS:
- Phase shifter cell 14 / SA3 is now fixed.
SPB:
- Few minor issues were solved.
- Gain were not closing - DOC is informed;
K. Wrona says some runs do not close (1-2 runs per shift): root cause of not understand but solution exist (close the run manually at MyMdc and restart; DOC can help with that).
FXE:
- Thank to SQS for helping with gas valve.
- Continuing with commissioning activities.
- CRLs were in the beam last Monday and were retracted.
MID:
- All fine at MID.
- Looking for a Keithley Pico-Ampere meter to borrow for cw20.
HED:
- Nothing to report.
- A. Galler informs a water pipe is blocking the construction of the pulsed room. It affects the cooling water. TS needs to coordinate with involved groups.
SCS:
- Experiment ongoing.
SQS:
- Nothing to report. |
116
|
04 May 2020, 14:20 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 04.05.2020 |
General Announcement:
- From today on there is no general restrictions in accessing the EuXFEL site: only consent of group leader is needed.
- Control Network activities: there is a sensible approach for this week and currently CTRL and XO do not observe issues needing discussions.
- Activities in tunnels start this week. We encourage the support groups to point any issue during this series of meetings or by sending an e-mail to xo@xfel.eu.
CTRL:
- A third training on the notification service will happen on Wednesday. Proper communication will be send around.
DA:
- Nothing to report.
EEE:
- Bringing up the systems.
VAC:
- Group members are on site to prepare activities. The main one this week is the installation of pre-shutter in XTD10.
- Protective masks have to be picked up with SRP.
XPD:
- No incidents during last week. Two group members are currently working at EuXFEL site.
Later additional staff will work on tunnels (e.g. on Hirex; on scintillator screen on IMG) and in the lab.
- SRP has to provide protective equipment to the staff.
DET:
- Nothing to report.
ITDM:
- We plan to perform tasks on the rack rooms and we are waiting for the SRP assessment.
XRO:
- Nothing to report.
LAS:
- Group has an on-site team who is switching on all lasers this week.
An order for the re-start will be communicated after an evaluation of each system's condition.
SPB:
- Group has staff on site to start systems.
FXE:
- One team is onsite. The planned activities shall not involve other groups: re-starting systems and making tests in the control hutch.
MID:
- Plan is to bring the PLCs and electronics up.
HED:
- Starting lasers and split-delay line. Activities do not mix with other groups.
- Group is coordinating with EEE for checking the rack rooms.
SCS:
- Not present.
SQS:
- Start being on site today and plans to re-start devices together with EEE.
- Also start setting up ion pumps (no need for VAC support). |
495
|
04 Mar 2024, 09:50 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 04.03.2024 |
General Announcement:
- A cold compressor failure happened on Friday and since Sunday early hours machine is running in good performance again.
- Pouneh S. reports that Sunday morning Amphos shutter closed and ad-hoc procedure was put in place to allow beam delivery. Investigation is ongoing.
CTRL:
- Information: minor incident with SA1 macro server which was shutdown by mistake on Friday. Macros that were know to be running were restarted afterwards.
DA:
- Nothing major to report: OCD was quiet before and after downtime.
EEE:
- Nothing to report.
VAC:
- Nothing to report.
XPD:
- Nothing to report.
DET:
- Nothing to report.
ITDM:
- Nothing to report.
XRO:
- Damage on one of the XTD2 solid attenuator is found. A similar action as done in XTD1 to move the plate position is under discussion with instruments.
LAS:
- Not present.
UNSYS:
- Everything is fine and tomorrow SA3 cell 12 PS motor will be replaced.
SPB:
- Issue with changing number of bunches that originated from XTD2 attenuator watchdog, limiting to 24 bunches.
FXE:
- Decoupling phase shifters during scans caused non-stable beam.
MID:
- All fine at MID.
HED:
- Nothing to report.
SCS:
- Nothing to report.
SQS:
- Not present.
SXP:
- Not present. |
274
|
03 Nov 2021, 10:12 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 03.11.2021 |
General Announcement:
-
CTRL:
- Nothing major to report.
DA:
- Nothing to report.
EEE:
- Nothing to report.
VAC:
- Not present.
XPD:
- Nothing to report.
DET:
- Issue concerning AGIPD cooling system at MID being not very effective: there is ice formation which stopped the flow of water. This already happened once but it is not so often.
Fix consists in flushing with dry air. Later today Detector will be running again.
ITDM:
- Fire incident yesterday on the labs (ITDM/EEE) was caused by a broken cooling system; the lab cooling water did not work for hours and let to problems with GPFS system in the lab as well as with servers
(same type of racks as the ones in the rack room).
- ITDM suggests the handling of such alarms have to be improved.
XRO:
- Nothing to report.
LAS:
- Nothing to report.
UNSYS:
- Issues with SA3/cell17: Phase shifter can not move. After rebooting PLC system one had to power cycle leading to lose half the SA3 undulator system.
A ZZ was done to recover downstream cells but finally the encoder of the PS motor is found damaged and need replacement. A request for access is created and is needed 4 persons for 2-3 hours.
SPB:
- Nothing to report.
FXE:
- Nothing to report.
MID:
- All fine apart of the mentioned Detector issue.
HED:
- HED asks if the last Sunday's problem with machine (drop in intensity) is understood or if it may happen again. XO says until yesterday this was not fully understood and will enquire again with BKR
colleagues.
SCS:
- Nothing to report.
SQS:
- Nothing to report. |
346
|
03 Aug 2022, 10:10 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 03.08.2022 |
General Announcement:
- Regarding the cw32 photon energies: it is expected for 8 GeV to have up to 6keV for the Hard X-ray beamlines. A third harmonic attempt at SA2 will be made. Expected photon intensities are in the order of
500uJ.
- DOC shall run OK for operation regarding the number of available staff members. It includes people working remotely.
- SEPS interlock was approved last Monday and Tuesday. For questions please get in touch with Zunaira A.
- Harald Sinn as PRC reports:
1. that yesterday there was a malfunction at SA1 and SA2 hutch search; together with Eric Boyd and Desy colleagues a fast replacement of devices was done;
2. A confusion between change from SQS and SCS: not clear what time the change would have to be made and it was finally decided to do this morning; it requires Theo involvement.
CTRL:
- Follow-up of SA2 VAC loop: EEE changed the timing for the triggering updates and it seems to have improved; no slowness was seen since them. A fine tuning of the parameter will be made.
DA:
- Nothing to report.
EEE:
- Finishing the handover activities;
- PLC team working with CTRL to mitigate VAC loop issues;
- Fast electronics working with updates;
- Timing configurations were updated yesterday.
VAC:
- Apart of the VAC loop, nothing to report.
XPD:
- SXP Imager had a long exposure time but it is now fixed.
DET:
- Nothing to report.
ITDM:
- Nothing to report.
XRO:
- Recommissioned devices after the summer maintenance period. Feedback from instruments would be highly appreciated.
- SQS and SCS found features on M2 mirror in SA3 that needs more investigation (a fresh area of the mirror to be used was found).
LAS:
- SA2 PP-laser is working.
- PP-laser beam for FXE shall be ready for today; For SPB on next Monday.
- SA3 PP-laser for SCS is handled; for SQS will be ready on Monday.
UNSYS:
- Nothing to report.
SPB:
- Yesterday XGM was not instantiated but it may be solved by EEE.
FXE:
- Not present.
MID:
- EPS system triggered limit of 300 pulses; It seems to be related to a foil / diamond detector system. MID was not informed of this change in EPS.
Nerea J. informs that the new entry at EPS was a request from XPD. Harald S. says an option is to the machine to increase the EPS to 360 pulses.
- RF window was allowing only 272 pulses and not the requested 352 pulses.
HED:
- Nothing to report.
SCS:
- Not present.
SQS:
- Alberto Defanis says that the new mirror region found is not fully understood by SQS staff.
- Problem with the digitizer: shows an artefact and a discussion with the manufacturer is ongoing and may require its intervention. EEE is on the loop. |
148
|
03 Aug 2020, 09:23 |
Andreas Galler | General | Information | Notes XO Integration Meeting 03.08.2020 |
General Announcement:
CTRL:
- few issues on SA3 vacuum server, over the weekend.
- twice some devices were not running,
- when restarting Beckhoff loops from the GUI please remember that it takes time until they are back
- device servers with - in their name. restarting with the service manager cannot cope with this --> fix is underway
- scheduling:
- Beckhoff: small movement error fix is underway and it is suggested to update karabo Beckhoff servers later this week.
- influxDB data logging
- current version does not allow easy correlation data from two devices in Grafan (web front-end) an update to the next higher version would cure that
- suggest to update Wednesday morning early
-
DA:
EEE:
- utca OCD calls
- PLC no OCD calls
- some updates are planned for FXE, MID SCS on Beckhoff
VAC:
XPD:
DET:
- comm AGIPD detectors
- detectors are stable, but issues with online processing
ITDM:
- new version of DAQ had been tested
- should be deployed this week
- 1 OCD call for recording data with ADQdigitizer
- requires coord between CTRL and ITDM and EEE
- this operation mode had been tested
- 1 OCD call JUNGFRAU SPB in burst mode --> did not work
- SH: was the receiver crashing?
- KW: not clear, nothing was working in that config
- SH: the problem had been identified at FXE --> fix should be deployed at SPB as well
XRO:
- update:
- follwoing up the issue with the attenuator damage in SAx
-
LAS:
- all three laser are running
- some problems with shutters
- SQS: shutter in ILH, cooling water refilled --> but interlocks could not be set
- XO to coordinate discussion with Pouneh
UNSYS:
SPB:
- karabo sessions lost connections to GUI server on exflcon026
- JUNGFRAU receiver crashing
- DAQ took long time to change state
- even switching to ignore after run take a long time
- this relates to JUNGFRAU
- GOTTHARD specref device crasing multiple times
- restarting had to be done multiple times
- optics interlock hutch was observed to be broken on Thursady night
FXE:
- digitizers at some point stopped
- connection to boards and triggers
- BF: this has to be investigated!
- beam stability
- EXAFS within 700 eV had been measured
- PP Laser was very stable
MID:
- VAC incident in CRL2 --> which closed V0 --> VAC solved the issues
- due to high pulse energies small damage to attenuator and instrument component had been
- DAQ update scheduling
-
HED:
- beam is jittering (when collimated 100 um are observed)
- CRL scene optics hutch is mixed up for one or two motors --> Thomas Preston investigate
SCS:
SQS:
- interlock / shutter issue
|
527
|
03 Jul 2024, 09:54 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 03.07.2024 |
General Announcement:
- Tunnels have been closed and the Interlock Tests required by the legislators are ongoing.
- Eric Boyd informs that next Monday two hutches have to be searched for the Interlock Tests, one at MID and one at FXE. An e-mail will be sent to the instruments.
- J. Sztuk-Dambietz asks on the DAQ for DET to do not close the proposals yet; Steffen H. informs that a fix is on the way and will be fixed and running. Proposals will not be closed until the deployment.
CTRL:
- Deployment of Karabo last week.
- Announcement: re-deploy Karabo Beckhoff devices to rollback have to be done as new feature was causing problems (related to the unit values).
Today 2PM for tunnels and Laser topics; for instruments will be later organized. A brief restart is expected.
DA:
- Nothing to report.
EEE:
- Working with CTRL to re-deploy Karabo devices for digitizers. This is ongoing and will be available later today or tomorrow.
VAC:
- Not present.
XPD:
- Completed tasks on tunnels.
- Yesterday work in Gotthard-II detector at SA2 (Hirex) was found detector does not work. CTRL and DET helped and detector was moved out of tunnel. There is no HIREX available in SA2.
Also power supply for HIREX in SA1 has to be worked.
DET:
- Working on the Gotthard-II with XPD.
ITDM:
- Nothing to report.
XRO:
- Nothing to report.
LAS:
- All good so far.
UNSYS:
- Everything is fine.
SPB:
- Nothing to report.
FXE:
- Nothing to report.
MID:
- All fine at MID.
HED:
- Nothing to report.
SCS:
- Not present.
SQS:
- Not present.
SXP:
- Nothing to report. |
431
|
03 Jul 2023, 09:58 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 03.07.2023 |
General Announcement:
- Power glitch happened on Friday morning: emergency power off was triggered in SA2 so power went down and TS installed a new UPS for SA2 area. Power was switched back few hours later; EEE was busy
bringing up systems.
- In SA3 Lasermet work triggered a down in electricity for SA3 on Thursday end of afternoon: by mistake a wire was grounded and power went OFF for a second. However, Lasermet did not inform on that.
The PP-laser went down and was discovered only on Friday morning. Only laser hutches were affected. Tobias C. says that Oleg E. and Torsten S. checked all cabinets and experimental hutches were not
affected as TS had bridged the emergency OFF.
Jan G. adds that also on Friday morning during the power glitch the network for diagnostic components in SA3 were also lost.
- Tunnels are technically open until tomorrow when interlock will be set. However, interlock tests are ongoing today and access shall not happen.
Please only in urgent cases access today shall be done, as will interrupt tests. This shall be negotiated with D3 group / Wolfgang Clement.
CTRL:
- Bug was reported while writing parameters at MC2 motors. It was fixed by EEE colleagues. However, work around at Karabo side will be applied as not all motors had parameters updated.
DA:
- Nothing to report.
EEE:
- Nothing to report.
VAC:
- Nothing to report.
XPD:
- Finished program with maintenance.
- Only Gotthard2 system was not received therefore not done.
- Calorimeter and laser power meter were recovered from SPB hutch and is now at XPD lab. Jan G. will contact SQS colleagues for being used on the instrument.
DET:
- Gotthard: no news but XPD and DET are in contact.
ITDM:
- SA2 storage was moved; an e-mail will be sent.
XRO:
- Maintenance tasks were completed on Friday. This week remote check will be done.
LAS:
- Nothing to report.
UNSYS:
- Tasks are accomplished. Need to recheck all systems.
SPB:
- Problems on Friday required EEE intervention.
- Nagios notifications on MPS crate is being received.
FXE:
- Nothing to report.
MID:
- Not present.
HED:
- Not present.
SCS:
- Friday afternoon realized some devices were down and another check is to be done today.
- This week there is AC maintenance which requires a move of spectrometer which needs planning. Tobias C. will coordinate with company and Jan Torben D. for precise scheduling.
SQS:
- Nothing to report.
SXP:
- Nothing to report. |
139
|
03 Jul 2020, 14:21 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 03.07.2020 |
General Announcement:
- The Interlock tests are finished in all tunnels and XHEXP1 areas, following information from D3 and SRP.
- From next week we will continue with XO Integration Meeting only on Mondays and Wednesdays at 09:00. The Fridays' XO Int. Meetings will be terminated.
- Next Friday 10.07 the User and Operation Meeting will re-start at 09:00 in the virtual format. Invitation and corresponding Zoom link will be send in a separate e-mail.
CTRL:
- Preparation for operations has started. Three issues have been addressed:
1. XPD issues are currently been worked and will extend over next week;
2. XFEL gateway troubles seems linked to a router configuration;
3. Migration of old data logger: problem with MID LA2 and SA3 (running wrong migration).
- Recovering complex configurations: meeting 12:00 with ITDM - please wait until Monday for update.
DA:
- Not present.
EEE:
- Follow-up of the shutdown activities is ongoing; Modification of PLCs was done.
VAC:
- Vacuum at beamlines are running; Shutters are ready.
- VAC plans to open XTD6 again from next Monday up to Friday, allowing HED access and work.
- Please inform VAC if XTD09 is needed to be accessed. Currently a ZZ is foreseen for this tunnel (EEE request).
- XTD10 can be accessed by ZZ during next week.
XPD:
- Small bugs on the DOOCS side of XGM were observed: bridges were checked and looked fine.
- XPD is planning the re-start of devices and support for machine tuning in coming weeks.
DET:
- Nothing to report.
ITDM:
- Nothing to report.
XRO:
- Not present.
LAS:
- SA2 laser: Train-ID showed issues (Update software failed).
- SA1 laser: went down due a crate failure and is warming.
- SA3 laser is fine.
UNSYS:
- Nothing to report.
SPB:
- AGIPB update needs to be fixed.
FXE:
- LPD new DAQ could not save data.
- Calibration pipeline for LPD is OK.
- Calibration pipeline for JungFrau does not work - also CTRL fixed the crash with DAQ (how the image gets the train ID's). The crash is not observed anymore.
MID:
- Discovered problems with motors in Laser room: EEE is informed and investigates.
HED:
- Will need access to XTD6 for final checks from Monday. Please inform VAC when access is finished.
SCS:
- Not present.
SQS:
- Not present. |