| ID |
Date |
Author |
Location |
Severity |
Subject |
|
288
|
20 Dec 2021, 09:25 |
Andreas Galler | General | Information | Notes XO integration meeting 20.12.2021 |
General Announcement:
CTRL:
DA:
EEE:
VAC:
XPD:
- nothing special, shtudown tasks are in schedule, HXPES / XTED2 cable work ongoing
DET:
ITDM:
XRO:
LAS:
UNSYS:
- APPLEXv inv place, VAC to be closed next year
SPB/SFX:
- working on mirrors
- not clear what is the status with the movement of racks wrt SXP (SPB/SFX optics hutch racks currently powered down)
- electrical installation?
- PG comments: Brad won't allow operation until 230 V power distribution is calrified, once Brad gives the OK, the racks can be switched on
racks are being finalized by EEE, but some checks need electrical power
- RB: SPB/SFX were promised that the move of the racks were finished before X-Mas, but it seems the electrical work is not up to satandards
FXE:
- shutdown task in schedule
MID:
- all fine
- some loop updates planned for Today
HED:
SCS:
SQS:
AOB:
- light OCD over X-Mas for XPD in case of floowings, power outages.lists will be
|
|
289
|
05 Jan 2022, 09:29 |
Andreas Galler | General | Information | Notes XO Integration Meeting 05.01.2022 |
|
General Announcement:
CTRL:
DA:
EEE:
- 1 MID plC dead
- cable work planned for next week
VAC:
- In general excellent progress
- closing of M2 XTD2 (SA1) in progress, sealing issues mitigated
XPD:
- XTD10, XTD6
- improvements, commissioning ongoing
- clean room tent water leak reported on 23.12.
DET:
ITDM:
- Jan 19: dCachce maintenance
XRO:
- progress as planned
- changes to existing components will be posted to respective elogs
LAS:
UNSYS:
SPB/SFX:
FXE:
MID:
- PLC outage on Jan 1 st caused VAC issues (reported by EEE)
- no access to MID optics hutch due to interlock test
HED:
- everything on schedule
- leak on a hose to humidifier device in A12. This leaked a few litres on the floor.
SCS:
SQS:
|
|
297
|
02 Feb 2022, 08:39 |
Andreas Galler | General | Information | Notes XO Integration Meeting 02.02.2022 |
|
General Announcement:
CTRL:
- observation from DOC
- macros some times after the upgrade to Python 3.8 --> please contact CTRL?
DA:
- significant upgrade to Offline Analysis -->
- proc data won't inlcude a copy of raw data any longer
EEE:
VAC:
XPD:
- no incidents
- 2 tunnel accesses on Monday --> succesful
DET:
- DET commissioning at SPB (AGIPD JUNGFRAU 1M), MID (AGIPD), HED (ePIX, JUNGFRAU)
ITDM:
- E0.604 rack room, Wed next week
- fixing power distribution units in every rack --> TS and external company will need a full day
- affected services are: Lab DAQ, LAB control servers (EEE; CTRL, DET), GitLab runners, one machine for data analysis, PLC database, karabo project database (?)
- Yesterday short interruption with influx reading note --> test requested for next Monday causing a 1 hour interruption
XRO:
- SA1 / SA2 M3 PBLMs have been equipped with diamond plates and can be used for beam stability measurements
- Backlash Controls implemented last week --> values
- report of lost positions of vertical slit in SA3
- in case of similar issues please contact DOC prior to self fixing.
LAS:
- SA2 PPL is good
- SA3 PPL planned to be up today
- SA1 PPL being investigated as agreed with SA1 instruments
UNSYS:
- transparency test for APPLE X went successful
SPB/SFX:
- SPB/SFX aligned since yesterday, no issues
FXE:
- blown fuses in crates --> solved with EEE
MID:
HED:
- Com yesterday
- outstanding issue: fastADC not working EEE aware of that
SCS:
SQS:
- GATT always worked but very slowly responding
- OCD contacted
- Raul comments that this is a known issue and should be communicated to CTRL
- SH nesures that Raul creates the ticket
- XTD10_PES
- digitizer display frozen almost all time (connected to 2 DAQs) --> reported to DOC
- SH comments that when connecting to two DAQs (tunnel and SQS), should be connected to only one DAQ.
|
|
314
|
04 Apr 2022, 09:26 |
Andreas Galler | General | Information | Notes XO integration meeting 04.04.2022 |
General Announcement:
CTRL:
- PP LAS restarting device servers for upgrading the device tag --> autoinstantiate some servers all topics
DA:
- Planned maintenance today for Cal and gpfs delayed at least until next Monday
EEE:
VAC:
- 1 ZZ ongoing to XTD4 to shiled an ion pump controller, suspicion of radiation damage.
XPD:
- similar Diamond cracks as in solid attenuator had been observed in the transmissive imagers
- Last weeek FEL imager issue had been clarified (image was rotated by 180 °, occured due to faultly config load)
DET:
- AGIPD1M (SPB/SFX), Friday morning some DAQ issues induced train losses. Didn't happen again after careful checking
ITDM:
- Issue at HED with data migration --> discussion will take place
XRO:
- Tomorrow and after tomorrow late shift some CTRL support might be required
LAS:
- PLL LAS SA1 sync issues (LbSYNC informed and arriving 10:00)
- PPL LAS3 NOPA setup
UNSYS:
SPB/SFX:
- Experiment went well, no major issue
- Run Controller crashd a few times over the weekend. Could be restarted but crashes some time later and has to be restarted
FXE:
- affecetd by LAS Sync issue
- issue with doocs panel for shutters (yifeng)
MID:
- all fine
- SSRY motor issue (ELMO)
- Nerea updated the ticket --> motor is working
HED:
- DA1 got stuck for a while (fixed by restarting)
- lot of short runs (1min) and only one train isneed from that -> requires fast data migration and analysis -> doesn't always work
- discussion with ITDM commencing
- PAM was missing from DAQ
SCS:
- no major issues
- RIXS on liquids went well
SQS:
DOC /DRC
issues with call forwarding |
|
315
|
06 Apr 2022, 09:15 |
Andreas Galler | General | Information | Notes XO integration meeting 06.04.2022 |
|
General Announcement:
CTRL:
- influxDB outage (telegraf issue)
- SA1 and SA3 affected
- currently fixed but linked to a device in SQS
DA:
EEE:
- PLC colleagues are working on CR and support requests
- pulling cables for SQS and SCS
- reported to XO uTCA in XTD1
- remote reboot planned for Friday, reserve ZZ slot for Friday
VAC:
- repair of XTD2 solid attenuator ongoing
XPD:
DET:
ITDM:
- nothing to report
- next Monday GPFS update will take place
XRO:
- mirror calibration started in SA2
- beam path through offset mirros not visible -> no beam on M3 pop in, but visible on M2 pop in MCP in beam?
- JG: no MCP in beam, how about PBLM?
- LS: no PBLM in beam
-
LAS:
- Sync issue from Monday cannot be replicated by Sebastian -->
- tests for SPB happening tomorrow
UNSYS:
- circular polratizaton lasing achievd in APPLE-X in left and right hand polarization, also linear horizontal and vertical and 45° measured at 900 and 700 eV
- thanks to UNSYS and DESY APPLE-X comm team.
SPB/SFX:
FXE:
MID:
HED:
SCS:
- reservation of nodes for jupyter hub.
- requested during drc hour fix to reserve 3 nodes
- is it possible to reserve 3 nodes by default?
- Olivier reports there was a misunderstanding and it got fixed very quickly
- Janusz reports that by standard 4 nodes are reserved for each experiment.
SQS:
|
|
316
|
11 Apr 2022, 09:10 |
Andreas Galler | General | Information | Notes XO integration meeting 11.04.2022 |
|
General Announcement:
CTRL:
- small intervention --> udpate of karabo-gui client exflagteway
DA:
- maxwell gpfs software maintenance --> offline calibration pipeline affected see ITDM
EEE:
- OCD call on rack 2.01 which was powered down. After fuse repaired
VAC:
XPD:
- Rack 2.01 --> Camera of SR imagare is not working
- situation not clear, being investigated --> IP conflict?
- Janusz suggests to powercycle the camera
DET:
ITDM:
- 10:00 maxfell gpfs update
XRO:
LAS:
- remainder change of set point for SCS to 112 kHz
UNSYS:
SPB/SFX:
FXE:
- preparing for user experiments
- concerned about optical sync of PP Laser, probelm of last week was fixed but no reason found
- test last thursday optical sync lost again while moving optical delay stage
- FXE
MID:
- alignment of optical laser alignment in joined hutch.
HED:
SCS:
SQS:
- last week Thursday night
- mono drift investigated --> preliminary analyisis points to the grating as the drifting component
|
|
317
|
13 Apr 2022, 09:28 |
Andreas Galler | General | Information | Notes XO Integration Meeting 13.04.2022 |
|
General Announcement:
- No User operation meeting this Friday, instead cw 16 / cw 17 check will happen in Daily Operations Meeting at 15:30 on Thu Apr 14. Link available on ttfinfo in XFELelog
CTRL:
DA:
EEE:
VAC:
XPD:
DET:
- offline calib with JUNGFRAU --> tickets closed already
ITDM:
XRO:
- request to SA1 instruments
- please check the repaired XTD2 solid attenuators
- attenuators cannot sustain too much power, offline discussion follows
- SA2 mirror recalib
- roll of M1 and M2 was completely misaligned, recalibration successful
- geometrical center of the kinematic system roughly identified
LAS:
UNSYS:
SPB/SFX:
FXE:
MID:
- pump probe looks stable and getting ready for the user
- BAM doocsbridge stopped --> manual restart necessary
HED:
SCS:
SQS:
DRC
- one hour data lost in influxDB in SA2
PRC
|
|
320
|
27 Apr 2022, 09:04 |
Andreas Galler | General | Information | Notes XO Integration Meeting 27.04.2022 |
General Announcement:
CTRL:
- bug noticed in BEckhoof karabo device --> already fixed from some topics, see xo-info comm from yesterday
DA:
EEE:
VAC:
- two devices went into error --> likely because of Beckhoff Karabo bug
XPD:
DET:
- AGIPD 1M at SPB partially vented yesterday --> detector went into interlock, no damage
- who should be called at SPB (or any instrument for that matter)
- Turbo pumps went into error state which triggered the partial vent --> karabo Beckhoff update?
- Wajid comments: karabo beckhoff update does not correlate with this incident, judging from time stamps
ITDM:
XRO:
LAS:
UNSYS:
SPB/SFX:
FXE:
- software limits of phase shifter of PP Laser
MID:
- all fine at MID
- HXRSS very much appreciated
HED:
SCS:
SQS:
DRC
PRC
- SCS incident on Monday, photon energy scanning script was left running --> had to be stopped manually
|
|
338
|
04 Jul 2022, 09:30 |
Andreas Galler | General | Information | Notes XO Integration Meeting 04.07.2022 |
|
General Announcement:
- M. Döring:
- almost all of the activities that should have been done until last Friday had been done
CTRL:
- last week karabo topic updates had finishedexcept for LAS
-
DA:
EEE:
VAC:
- leak search on M6 (SA3) chamber
- leak search in XTD9
- all in all well
XPD:
- almost all tasks have been completed
- XTD1 new crate connected on Friday,
DET:
ITDM:
- all updates are finsihed
- some activities continuing on the offsite --> should be comüpletely transparent
- after the prox change there are some PCs which are using the old host names --> relavant people will be contacted by Janusz Szuba
XRO:
- M6 mirror installation beign finished
- end switch checks shoudl be finished by today
- ramp up procedure being written down
- instruments are asked to submit any additional requests for ramp up
LAS:
- fastADCs should be finished by Wed this wek
UNSYS:
- control system has to be adjusted after removal of APPLE X, i.e. the control system looks for motors and
SPB/SFX:
FXE:
- motor commissioning ongoing
MID:
HED:
- when modifying cables downstairs, make sure modules upstairs are switched off
SCS:
SQS:
DRC
PRC
- SCS incident on Monday, photon energy scanning script was left running --> had to be stopped manually
|
|
342
|
18 Jul 2022, 09:31 |
Andreas Galler | General | Information | Notes XO integration meeting 18.07.2022 |
|
General Announcement:
CTRL:
- fastADC karabo Version updated
-
DA:
EEE:
- PLC and cabling as scheduled
- fastADC update
- MID and SPB issues being solved by lunch time
VAC:
- HED Mono
- SXP tunnel interface
XPD:
- ZZ on Tuesday for XTD1 SR imager camera reset
DET:
- DSSC update
- test not yet conclusive on whether operation is safe or not.
- current suggestion: postpone experiments until repair is done
- AGIPD firmware update went well
ITDM:
XRO:
LAS:
- Timing issues solved, solved by Lars Froehlich
- LAS may suffer from limited available resources
UNSYS:
SPB/SFX:
FXE:
MID:
HED:
SCS:
- mobile compressor will be used this week
SQS:
DRC
PRC
|
|
343
|
20 Jul 2022, 09:30 |
Andreas Galler | General | Information | Notes XO Integration Meeting 20.07.2022 |
|
General Announcement:
CTRL:
DA:
- currently there is a gpfs issue affecting the online cluster
- delays in online analysis have to be expected
- delays in obtaining new constants, can take much longer than normally -->
EEE:
- nothing to report
- a couple of boards are not reachable, maybe connected to the power glitch we've had
VAC:
- ongoing activities
- XTD 6&9
- HED Mono works closing
- SXP beamline ready for beam
- operation at very low photon energies at SA3:
- GATT will use Ar --> System had been tested
- power glitch yesterday was seen in water distribution
XPD:
- ZZ on Tuesday for XTD1 SR imager camera
DET:
ITDM:
XRO:
LAS:
UNSYS:
SPB/SFX:
- issue with Elmo motors had been mitigated
- DA and Detector recovery
FXE:
- acces to air comperssor and support for moving LPD required for July 22nd for BTM tests.
MID:
- after loop update wrong parameters had been put to LDM motors
HED:
SCS:
SQS:
DRC
PRC
|
|
344
|
25 Jul 2022, 09:14 |
Andreas Galler | General | Information | Notes XO Integration Meeting 25.07.2022 |
General Announcement:
CTRL:
- Today "bring up" works at FXE
DA:
- Nothing special to report
EEE:
- PLC team is trying to find solutions for slowness in big loops
VAC:
XPD:
DET:
ITDM:
XRO:
LAS:
UNSYS:
- K- Mono Scan last week
- S. Arbeghyan assisted but new undultaor offsets will only be implemented after Aug 5th
SPB/SFX:
- nothing special to report
- bring up days are very successful
FXE:
MID:
- ITDM please keep MID in the loop with SA2 GPFS updates, as MID plans to save data today
- opening of the beam shutter is an issue
- over the weekend MID was forced to open
HED:
SCS:
SQS:
DRC
PRC
SH
- VAC loops SA1 SA2, don't panic because of slowness
|
|
352
|
24 Aug 2022, 09:28 |
Andreas Galler | General | Information | Notes XO Integration Meeting 24.08.2022 |
|
General Announcement:
CTRL:
DA:
EEE:
- actions from Monday (SA3 PLC master update, PNACT testing) successful
VAC:
XPD:
DET:
ITDM:
XRO:
LAS:
UNSYS:
SPB/SFX:
FXE:
MID:
HED:
- undulator setting off by 100 eV --> HED had means to accurately measure the delivered photon energy and compensate for that.
SCS:
SQS:
DRC
PRC
|
|
365
|
12 Oct 2022, 09:16 |
Andreas Galler | General | Information | Notes XO integration meeting 12.10.2022 |
General Announcement:
CTRL:
DA:
EEE:
VAC:
XPD:
DET:
ITDM:
- SA2 online system (gpfs) one enclosure is bahving strangely, intervention may be required --> to be investigated
XRO:
LAS:
UNSYS:
- cell 19, 20, 21 motors for phase shifters had been replaced. Delivery for lead shields is going to be next year --> installation will have to be done through ZZ access
- radiation damage is high after chicane, delivery time for new motors is 1 years, 7 are left in stock
SPB/SFX:
FXE:
MID:
HED:
SCS:
- hRIXS combined motuion requires PLC to be exchanged
SQS:
DRC
PRC
|
|
366
|
17 Oct 2022, 09:31 |
Andreas Galler | General | Information | Notes XO Integration Meeting 17.10.2022 |
|
General Announcement:
CTRL:
DA:
EEE:
- OCD call on Friday
- ion pump controller broken in XTD1
VAC:
- see EEE --> additionally over the weekend the pump was taken out of the interlock
XPD:
DET:
- JungFrau damagat at SPB/SFX in cw 40
- two powder rings permantnly burned into detector
ITDM:
- SA2 online system (gpfs) one enclosure is bahving strangely, --> fixed no replacement needed
XRO:
LAS:
- crash of PPLaser in SA1 over the weekend
- TRGDly was upgraded recently/ crashed for SPB --> TRGDly device being rolled back and PPLAS1 should be back up today.
UNSYS:
- ccell 25 SA1 fixed --> now only 6 motors are left.
- Lead shields ETA beginning of February --> will have to be done through ZZ
- broken motors and encoders are sent back to Beckhoff
- repair time approx. 2 - 3 months
SPB/SFX:
- Jet control stopped
- PPLAS
- on Friday there was no LAS output --> fixed
- no LAS OCD in blue weeks, and on Friday no LAS group member on site --> earliest service on Saturday through good will.
- shift change not successful due to miscommunication
- SPB let the laser run over night for measurements --> FXE did shift change over night eventually destroying the SPB measurement
- see LAS TRGDLY device
- SPB requests to not upgrade software thorugh run for PPLasers.
- recently there were some upgrades on a Monday which then later fail for operation
- SPB notest that there is only limited OCD by LAS group and then LAS cannot cover critical components
FXE:
- set up built for User Experiment
- HallCrew supported in build up
- LAS use --> see SPB/SFX
MID:
HED:
- user experiment being set up
SCS:
SQS:
DRC
PRC
|
|
367
|
19 Oct 2022, 08:45 |
Andreas Galler | General | Information | Notes XO Integration Meeting 19.10.2022 |
General Announcement:
CTRL:
DA:
EEE:
- Group retreat on Monday, Tuesday next week --> OCD available
- ion pump controller broken in XTD1
VAC:
XPD:
DET:
- 25th of October group retreat
ITDM:
- nothing major
- change of FastX on max-display from FastX2 to FastX3
XRO:
LAS:
- AMPHOS Shutter Laser issue
UNSYS:
- ccell 25 SA1 fixed --> now only 6 motors are left.
- Lead shields ETA beginning of February --> will have to be done through ZZ
- broken motors and encoders are sent back to Beckhoff
- repair time approx. 2 - 3 months
SPB/SFX:
- Laser interlock error
- extra foam 4 center modules from AGIPD
- DOC / DRC to be contacted
- jet motion
- dynamic brake engaged because the cable was loose --> fixed
FXE:
- extra foam issues had been sorted out
- 16 cell mode of Jungfrau not being used
MID:
HED:
- collimated beam showed jitter --> downfocussing reduced the effect
-
SCS:
SQS:
DRC
PRC
|
|
410
|
12 Apr 2023, 09:23 |
Andreas Galler | General | Information | Notes XO Integration meeting 12.04.2023 |
General Announcement:
CTRL:
DA:
EEE:
VAC:
- successful intervention for Turbo Pump intervention of PES in XTD10
XPD:
- Diamond Detector Study in SA2 on Thu
DET:
ITDM:
- last week was super successful with SPB taking 5 PB of data
- however please provede better estimations, here a factor of 5 overshoot was seen.
XRO:
LAS:
UNSYS:
- one terminal SA3 cell 5 issue over the week --> replaced on Tuesday
SPB/SFX:
- EPS issue SPB_XTD9_IMGPI out siwtch not working --> limited to two pulses --> taken out of EPS interlock
FXE:
MID:
HED:
- excellent performance of the self-seeded x-ray beam last week, for the user experiment #3326 (Fri-Sat).
The beam is very stable both in terms of intensity (700-800 uJ constant) and the pointing jitter! Users were very happy with the performance and the experiment was successful.
SCS:
- issues with electronics
- EEE contacted and Bernard going to support today
SQS:
SXP:
DRC
PRC
|
|
411
|
17 Apr 2023, 09:26 |
Andreas Galler | General | Information | Notes XO Integration meeting 17.04.2023 |
General Announcement:
CTRL:
DA:
EEE:
VAC:
XPD:
DET:
ITDM:
XRO:
LAS:
UNSYS:
SPB/SFX:
FXE:
MID:
- XRO did alignment in XTD2 --> successful, euler MDL recommissioned
HED:
SCS:
- issues ar being taken care of
SQS:
- XRO investigated damage threshold mirrors
SXP:
DRC
PRC
|
|
412
|
19 Apr 2023, 09:27 |
Andreas Galler | General | Information | Notes XO Integration meeting 18.04.2023 |
General Announcement:
CTRL:
DA:
EEE:
VAC:
XPD:
DET:
ITDM:
- jhub update went though at 9:00
XRO:
LAS:
- failure of a piazo in the beam stability in SA2, laser is being recovered
UNSYS:
SPB/SFX:
FXE:
MID:
- waiting for laser
- missing data from the JF, and motor
HED:
SCS:
SQS:
SXP:
DRC
PRC
|
|
433
|
10 Jul 2023, 09:30 |
Andreas Galler | General | Information | Notes XO Integration meeting 10.0723 |
General Announcement:
-
CTRL:
- Bring Up Days start next Monday
DA:
- DA and DET sessions are alwys the same days following CTRL and EEE
EEE:
- nothing to report
VAC:
- VAC is ready for beam
XPD:
- Nothing to report.
DET:
- Nothing to report
ITDM:
- Nothing to report.
XRO:
- nothing to report
LAS:
- Nothing to report.
UNSYS:
- nothing to report
SPB:
- Couple of open things with crates --> EEE in discussion
FXE:
- Nothing to report
MID:
- Nothing to report.
HED:
- Not present.
SCS:
- Not present
SQS:
- Not present.
SXP:
- Not present. |