ID |
Date |
Author |
Location |
Severity |
Subject |
570
|
15 Oct 2018, 13:39 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
FXE
- Pulse on demand capability successfully tested
- Issue with the DAQ: crush of data aggregators. ITDM OCD has been notified and the issue is being investigated.
- The users would request the Jungfrau detector working for friday. FXE asked for feedback about the status of the detectors integration to DET, CAS, ITDM. The feedback is needed to inform the users.
SQS
SCS
MID
- Loop 4 is waiting for ion pumps cables to be commisisoned. as soon as the cables are there AV will inform CY and MID.
HED
XPD
VAC
AE
- SQS/SPB interlocks will be propbably deployed tomorrow.
- SASE3 master loop will be updated tomorrow.
ITDM
- ITDM needs to know until when the photon commissioning in SASE2 tunnels is ongoing to update the DAQ servers. The information should come from HSinn or PRCs, who are not at the meeting. JS will try to contact them directly. ==> HW was updated but still with the old configuration. Moving of data services to new aggregators needs discussion.
|
571
|
17 Oct 2018, 10:10 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
-
KB motors issue: the motors do not go to the proper position. This has been communicated to AE. Analysis of the problem and fixing ongoing.
-
The leak of the AGIPD colling pipe has been fixed but the connectors were not cleaned since this requires time. It was decided to operate the detector and postpone the cleaning to the next shutdown.
-
Software update for the AGIPD should now avoid problems with the configuration of the detector.
FXE
- Pulse on demand pump and probe experiment successfully performed.
- The users would request the Jungfrau detector working for friday. Tomorrow there will be a meeting with FXE, DET,AE and the users to manage the expectations and discuss what can be delivered in terms of detector performances.
- Von Hamos spectrometer motors sometimes go out of service. The origin of the problem is not clear. AE will investigate.
SQS
- MPS conditions update: Loops will be restarted next tuesday
- Issues concerning the motors of the newport stages have been fixed.
SCS
- Coordinated motion does not work properly. The bug identification and fixing will be done offline in the lab. TF is preparing the test environment with 2 stages and Elmo controls. AE/CAS involved.
MID
HED
XPD
VAC
AE
ITDM
AoB
- Yesterday a HZDR electrician had an electircal accident working in A23. He only got a burn, but he is fine. The accident report is being filed. After A23 has been checked it was opened again for the laser people.
|
572
|
22 Oct 2018, 13:46 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
FXE
- Pulse on demand pump and probe experiment successfully performed.
- The support groups got the Jungfrau detector working for the users run.
- VAC sample environment working.
SQS
- MPS conditions update: Loops will be restarted tomorrow. Tests to then be done in the afternoon and on Wednesday.
- Loop 4 and 5 motors need to be updated . To be discussed with AE when is the best time.
- Pulse on demand capability needed. SQS will contact the CAS contact person.
- Ph. Science camera can be connected again.
SCS
- First shifts succesfull. Support from the support groups is appreciated.
- DAQ groups that have been overlooked are now needed. ITDM asks SCS to send a ticked with the request and the required excel sheet.
- ITDM also points out, that only DAQ groups that have been already properly commissioned should be used during night shifts.
- Minor problems with gauges. Will be discussed with AE.
- Problems with motors (sometimes they work, sometimes not) has to be discussed in details with AE.
MID
HED
XPD
VAC
AE
ITDM
AoB |
573
|
24 Oct 2018, 11:25 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
FXE
- During the last users run there was a loss of optical laser. This was due to a mistake in CAS. Has been clarified already. It is pointed out by FXE that one should avoid working on e.g. the control system during the users period. This is however, not always possible and a mitigation strategy is needed and requires discussions.
- Successful users shifts.
SQS
- Issues with motors have been fixed.
- Loop 3 will be probably updated today.
- In general several loops need to be updated, will be coordinated with SQS.
- SQS has the night shift today. Eventual tests have to be done today during the day.
- Motor valve can be implemented in the controls next week.
- Would be nice to have the GATT pressure in our DAQ system. CAS is looking into that.
SCS
- KB coordinated motion has been improved
MID
HED
XPD
VAC
AE
ITDM
AoB
Another issue related to the non independency of interlocks between the SASEs: FXE waiting for pulse on demand. In the meanwhile in SASE3 the pressure in the GATT increases and the apertures go in to keep the pressure high. As designed, the interlock stopps the beam for 1 or 2 seconds, but also in SASE1. FXE loses the pulse on demand.
It is clear that this is a complex environment and finding a solution requires time and the experts both on the desy side and XFEL side (e.g.AE, CAS) on the table. |
574
|
29 Oct 2018, 13:25 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
- A smaract stage sensor had issues. The behavior changes whether the chamber is pumped down or not. The Issue is being addressed by AE.
FXE
- Users are acquiring data with the Jungfrau detector. It is a success so far.
- Successful users shifts.
SQS
- Configuration of some motors is incorrect. BB looking into that.
- It is required to change the sampling rate of the digitizers. CAS is on it.
- MPOT issue: control is lost as a power supply channel trips. CAS: a fix exists, needs to be deployed.
- Note from NC(AE): one has to check that the parameters and information written in the CRDs are consistent with what is being used in reality. This would make the time of the OCDs more efficiently used.
SCS
- Interlocks tripping too easily: CAS will show SCS how to change the thresholds.
- KB coordinated motion: bug has been reproduced by cas. Fix ongoing.
- Full control of the scroll pumps still not possible. AE is working on it.
- Loop 13 will be fixed (miswiring problems)
MID
HED
XPD
VAC
AE
ITDM
- Issue with the office netword socket in D.09. Fixing ongoing. In general all the operation critical devices have to go to the control network sockets to avoid such issues.
- Request from HS to add the generic XFEL unix user to the special group of doocs to change the bunch pattern. This has to be first discussed internally to CAS. AS will come back to KW and the others involved players as soon as this has been clarified in CAS.
CAS
- CAS need a time window to deploy and test the fix for the Lima Basler cameras in XTD6. No feedback since last friday. A.Koch tries to find out a possible time window and come back to ASIlenzi.
AoB
Groups are reminded to send GW (PSPO) the activities planned for the winter shutdown. |
575
|
05 Nov 2018, 12:25 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
FXE
SQS
- Crates for Loop12 have been installed. Loop will probably run by today or tomorrow.
- Loop 2 and 3 need to be updated because of interlock definitions.
- Issue with valves behavior in Loop 3 and 5. AE will check.
- Encoder w/o 5 V. BB checks.
- Pfeiffer Motor valve issue will be fixed by next week.
SCS
MID
- AGIPD will move in the hutch this week. Preparation ongoing.
- Loop11 will be ready early next week
HED
XPD
- Several tests planned for the end of the week, including the feedback device by CAS. PRCs will be made aware of the activities in the tunnels.
VAC
AE
- PPL update in SASE1 today.
- Update of the Loop 5 (AGIPD) tomorrow
ITDM
CAS
- Issues in the calibration pipeline will be coordinated with the relevant groups (DET, AE) before and during the next chapter's meeting.
AoB
|
576
|
07 Nov 2018, 10:44 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
- Karabo was updated yesterday. Test is ongoing. So far no issues.
- The macros for cooling down and warming up the detector do not work properly. If the button is pushed twice the setpoint changes continuing e.g. cooling down too much. Marcin will bring the issue up with CAS (HS).
FXE
SQS
SCS
- Issue was found with Elmo controllers crates: due to a problem in the EPLAN macro the ground is not connected to the motor cables. The mitigation strategy will be discussed by PG, LW, MF and MT in a meeting.
MID
- AGIPD will move in the hutch today.
- PCs are being installed. Karabo need to be deployed.
HED
XPD
VAC
AE
TDM
CAS
- Karabo 2.3 is now a release candidate. Testing ongoing.
AoB |
577
|
12 Nov 2018, 09:55 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
- More interlock updated will take place this morning.
FXE
- Supporting the diagnostic and optics group for the testing of the beam feedback mechanism.
- A.Galler was informed by CAS (Vajid) that a Karabo update was requested to CAS last friday late afternoon. The update was stopped by FXE, but to avoid this in the future communication between the cvarious groups has to be improved.
SQS
- Beam during the WE. NO issues.
- Imaging processors are being used for cameras. There are issues with the averaging. CAS is informed.
- Various loops updates needed. Will be agreed offline with AE.
SCS
MID
- Loop 11 could be ready by next week. Today the FW export by EET is going to be available to AE.
HED
XPD
VAC
AE
TDM
CAS
- Karabo 2.3 is now a release candidate. Testing starts today (2.5 wks internal tests). Info about new features of the 2.3. release are available on the white board in front of the mockup control room.
AoB |
578
|
14 Nov 2018, 10:23 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
- Lopp 5 update - will be agreed between SPB and AE
- Smaract limit switches issues - AE will have a look. In the meanwhile also the company of the controlles has been asked by SPB
- KB motor steps have different size with respect to encoders. This issue is known and a workaround / solution has to be discussed with AE offline
- Pulse picker will be used and commissioning finalized.
- Sample chamber encoder drift issue. Hasx to be investighated further. AE can support.
FXE
SQS
SCS
MID
HED
XPD
VAC
AE
- MID Loop 11 - Fw received. Being tested.
- PLCs for optical lasers in SASE3 and 2 control being set up
- SASE3 support for commissioning ongoing
ITDM
CAS
AoB |
579
|
19 Nov 2018, 10:39 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
- Gotthard needs to be tested.
- Pulse picker will be used and commissioning still has to be done.
- Sample chamber encoder drift issue. Has to be investigated further.
FXE
SQS
- Beam during last WE: no major issues
- Interlocks will be updated tomorrow
- Some issues concerning direction of motors need to be fixed with AE.
- AVC300 valve. Firmware will be available this week.
- Digitizers and photonics camera are needed. Work ongoing
SCS
- Motors for the Fast CCD cameras are not working properly and interlock about pressure for the detector is needed ==> Loop 7 needs to be updated, AE will take care of that.
- When the CCD will inject data into the DAQ ITDM will be informed.
- There was a request to CAS to provide values for the Monochromator at a rate faster that 10 Hz. This requires evaluation of the feasibility by the experts (CAS/AE). For the time being the middle layer will not be changed.
MID
- AGIPD commissioning:
- Loop 11 needed. Today tests by AE. Until Tue. evening all the intelock tests should be done. From Wed. on operation.
- uTCA crate needs to be operational too. According to AE can be done.
- Thu. on: DQA tests.
HED
XRO
- Temporary solution concerning Karabo topics management to alllow the reading of the Monochromator values by SCS. The definitive fix will come in the future.
XPD
- XTD10 XGM repaired
- XTD1 ph. science camera was replaced with the one previously installed in SASE1. Repair ongoing.
- the company went bankrupt and was bought by a new company. For info contact A. Koch.
VAC
AE
- OCD: intervention request during the WE to fix a train id issue. Should be ok now but the problem still needs to be reproduced and undertstood.
ITDM
CAS
- Release tests with ITDM ongoing.
AoB |
580
|
21 Nov 2018, 10:13 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
- KB system and AGIPD commissioning ongoing
FXE
SQS
SCS
MID
- TueV Test ongoing.
- Mono commissioning to be done this week.
- Loop 7 is needed for the middle of next week. As of now no fw export and cables for this loop appear to be there. AE/EET will have to check whether this makes sense.
- AGIPD commissioning:
- It seems that some cables needed for the loop 11 were not connected and some other are not yet installed. ILobato and K. Sukharnikov are now dealing with the issue. This delays the foreseen plan. The mitigation strategy for the missing cables issue is to have a list with these specific cables and ask Fa. Schulz to put these hight priority. It already worked with other cables/connectors. Discussion MID/EET/AE needed.
- uTCA crate is now operational.
- It is pointed out by CAS (C.Y.) that component having priority concerning cables and loops operation are AGIPD, DES, PDS, Mirror. It has to be checked whether these are aligned with the actual priority list for loops and cables discussed with MID.
HED
XRO
- in XTD10 horizontal slits were moved to better scan the beam.
XPD
VAC
- in XTD9 the B4C aperture in front of the monochromator grating was changed to a larger one.
- in XTD10 the current amplifiers for the XGM were successfully changed.
AE
- OCD: intervention request during the WE to fix a train id issue. Should be ok now but the problem still needs to be reproduced and undertstood.
ITDM
CAS
- Release tests with ITDM ongoing.
AoB |
581
|
26 Nov 2018, 10:35 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
- KB system commissioning ongoing
- Agipd commissioning stopped
- Radiation tests preparation ongoing.
FXE
SQS
SCS
MID
- TueV Test successful.
- Mono commissioning issue: the pico motors position is not reproducible. This is a show stopper for the Monochromator commissionig. Not clear whether also FXE has the same kind of problem. AE has been informed and will try to support taking into account also the requests by SASE3 for this week (commissionig for the users run)
- AGIPD commissioning is ongoing. Chiller has to be replaced due to a leak.
HED
- TueV Test for the optics hutch successful
- Cabling ongoing.
- Fw export and crates/loops preparation ongoing
- Screen is needed for first beam.
XRO
XPD
VAC
AE
- OCD: intervention request during the WE to fix a train id issue. Should be ok now but the problem still needs to be reproduced and undertstood.
ITDM
- Network intervention needs to be planned for the beginning of January. KW is clarifying the details. Will be included in the shutdown planning.
CAS
- Release tests ongoing. Small issue with the DAQ has been found. Fix already in place. Final tst of the fix is being performed.
AoB |
582
|
28 Nov 2018, 10:18 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
- commissioning ongoing
- Radiation test was not successful since the beam diameter was smaller than expected.
FXE
SQS
SCS
MID
- Loop 7 will run by today evening
- Mono commissioning issue: the pico motors position is not reproducible. ==> the issue solved by itself. Tests ongoing.
- AGIPD commissioning is ongoing.
HED
XRO
XPD
VAC
AE
- In sase3 the y axis of the nano motion system (sample environment) does not work properly uinder vacuum. JTolkien and C Dieter are on the issue.
EET
ITDM
CAS
- Release tests ongoing. Release candidate being tested with AE.
- OCD for SASE3 users experiment has been set up
AoB |
583
|
03 Dec 2018, 11:45 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
- pulse arrival time measurements to be done next week.
- second Gotthard detector small issues being fixed
FXE
SQS
- Successful experiments during the WE
SCS
- Z-motion issue for the fast CCD. Has to be checked again with AE today
MID
- Loop 7 is running
- This week light is expected on the AGIPD
- Mono commissioning issue: the pico motors position is not reproducible. ==> motor is now stuck, needs to be replaced.
- Loop 10 partially needed. To be discussed with AE
HED
XRO
XPD
VAC
AE
- The synch of the Gotthard detectors with 1 trigger does not work for long trains (synch is lost). Multiple triggers are needed. AE is looking into that involving A. Galler since he is an advanced user of the Gotthard. The solution will then be deployed to all the detectors.
EET
ITDM
CAS
- Tests with AE/ITDM ongoing. In the new version of Karabo/DAQ the filtering of slow data for device will be included.
AoB |
584
|
05 Dec 2018, 11:41 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
- pulse arrival time measurements to be done this week.
- second Gotthard detector small issues being fixed (online data viewer fixes - ongoing)
FXE
SQS
SCS
MID
- Loop 10 partially needed. Smaract stages are working withing loop10 since yesterday
HED
XRO
XPD
VAC
AE
- AE agreed to power down the PLCs in SASE1 experiments and optical laser before the power interruption. Dates are being rediscussed since radiation damages tests are foreseen for Monday and Tuesday! (10-11.12). TBC.
- The synch of the Gotthard detectors with 1 trigger does not work for long trains (synch is lost). Multiple triggers are needed and also possible (AGaller is already using them). AE can give support also to the other users.
EET
ITDM
DET
- SCS fast CCD temperature drift issue being addressed.
CAS
- Tests of the 2.3.0. Karabo version are ongoing. Karabo update for SASE1 will be deployed after the PLCs are back again (ca. 2 days after the power is back). Proposed date by CAS is 19.12. but needs to be discussed again once the power is back.
AoB |
585
|
10 Dec 2018, 09:50 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB
FXE
- Timing tool has been tested during the week end.
- PP laser inch modes have been tested with the Gotthard detector.
- Intra/inter train gitter test results being analyzed.
- APG mode of the digitizers had issues. Experts from AE will be contacted.
SQS
SCS
MID
- AGIPD saw light. Support groups, in particular AE and DET were thanked.
- Beam stop saw also light.
- Small issues have been / are being fixed: leak of the silicon oil pipe, timing issues.
HED
XRO
XPD
- CAS will run some test in SASE3 for the diagnostics after the latest time server development.
VAC
AE
- PP laser motors issue reported onm friday has been investigated. It seems that the motor was emchanically stuck and it was possible to implement a workaround (more power fromt he controls) to make it work. It needs to be further investigated in the shutdown.
EET
ITDM
DET
CAS
- 2.3.0. has been released. Hot fix for minor issues (e.g. back compatibility of the GUI) is being prepared. This does not affect the tests made by AE, DET and ITDM
- FOr sase1 PLC data has been recorded in preparation to the power cut.
AoB
Power cut in SASE1
- The plan is to cut the power in SASE1 in the XHEXP1 on Wednesday 12.12. around noon. This will only happen after PSPO will receive feedback from AE, ITDM, FXE, SPB and Optical Lasers that everything is in a safe state.
- The power could come back on Thursday (13.12.) morning if no problems occur.
- The normal light could be affected. In any case the emergency lights and Radiation lights will be working. Working in SASE1 hutches and Rackrooms in this light condition is not safe w/o additional light and the suggestion is to postpone the activities when the light is back.
- If the time plan needs to be changed due to the radiation damages tests being delayed, the relevant parties will be informed by PSPO.
|
586
|
12 Dec 2018, 10:17 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB/SFX
- Radiation damage tests were successful.
- Instrument is set for the power cut.
FXE
- According to the information available to AE the instrument should be set up.
SQS
- Successful users run in the last 2 weeks
- Some interlocks need to be activated. Discussion with AE ongoing
- Loops updates to be discussed/executed plus CR status will be checked
- Triggers requests are being sicussed with BF
SCS
MID
HED
- Loop 1 will be operative probably today. CAS support for creation of scenes has been asked.
- Cabling ongoing.
- Additional Racks in A27 have been installed
OPT Lasers
- As soon as the system is ready for the power cut in SASE1 a mail will be sent to PSPO.
XRO
XPD
VAC
AE
- XTD6 crate 219 has to be rebooted.
EET
ITDM
- Maintenance and updates (e.g. online clusters ) has started as indicated in the shutdown activities planning. Should go on until the end of the week.
DET
CAS
- 2.3.1. will be deployed in SASE3 tunnels today
- Schedule for 2019 has been circulated by HS to the readiness mailing list
AoB
|
587
|
17 Dec 2018, 10:36 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB/SFX
- SFX part1 cabling preparation ongoing (WCBs mounting and labeling)
- waiting for the power to come back
FXE
SQS
- Some interlocks need to be activated. Discussion with AE ongoing. Will be probably done early next year.
- Loops updates are being discussed/executed plus CRs status are being checked.
- pnCCD CRD is being prepared. Information like what electronics can go in the Rackroom and what in the huctch due to cable length restrictions will be collected and spread to the relevant people (e.g. safety)
SCS
- Successful beam time with users - many thanks to all the support groups
- Fixing of crates and additional cabling is being prepared/ongoing.
- DET group asked for a coordination meeting concering users requirements for the fast ccd in the next users run.
MID
- Cabling ongoing
- Support from AE to modify the Racks that will host the electronics for the MID and HED monochromators has been requested. PGessler will check whether support can be granted this week (other activities ongoing). The goal is to commission the two monochromators in the tunnel in the shutdown.
HED
OPT Lasers
XRO
- MCP in XTD 10 has been removed. Also the M2 has been removed. The reference positions will be lost when the components are back (14.01.).
XPD
- Screens in SASE3 are being installed. Venting of the line is being coordinated with the vacuum group. No reference positions lost is expected.
VAC
- CRL in XTD 9 will be removed and stored in a labeled box, waiting to be installed in the SPB hutch. This will happen after the winter shutdown. Procedure to safely handling the berillium lenses is being finalized with Safety.
AE
- Once the power in SASE1 XHEXP1 is back AE needs 1 day to bring the electronics back.
EET
ITDM
DET
CAS
- Hotfix is being prepared. This will solve issues in the config tables related to units.
- Deployment schedule is being updated (inc. deployment of 2.3.1. in SASE2)
AoB
- General interest precutions concerning components should be circulated, if any, by the responsible groups in view of the holyday period.
|
588
|
19 Dec 2018, 13:17 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB/SFX
- SFX part1 cabling preparation ongoing (WCBs mounting and labeling). Good progress.
- CRLs will be brought out of XTD9 tomorrow.
- Scaffolding below D.23 has been removed. An official communication that now the area is completely accessible is still lacking.
FXE
SQS
- For the loops 9-13 the HW is ready. CAS projects have to be prepared.
- Some issues with middle layer devices have been notified to CAS (Cyril)
SCS
MID
- Karabo 2.3.2 has been deployed apart from the AGIPD control (waiting for tests by DET group before update).
- CY is now back working on the Mpots (SASE2 and 3)
HED
OPT Lasers
XRO
XPD
VAC
AE
- SASE1 power was back yesterday. SPB and FXE have been brought up again yesterday afternoon. Today morning because of unplanned and badly communicated MPS works the power was cut again ==> additional, unplanned efforts needed.
- Hazem will be OCD during Christmas, only for PLCs.
- No uTCA OCD during Christmas.
EET
ITDM
DET
CAS
- 2.3.2 Deployed in SASE2
- SPB update postponed to January
- SASE1 planned for today
- No OCD until 09.01.
AoB
- Next Disptach meeting on 07.01.2019 at 9:30
|
589
|
07 Jan 2019, 09:55 |
Adriano Violante | General | Information | Status report after dispatch meeting 09.30 |
SPB/SFX
- CRLs will be brought in the SPB lab in XHQ. The vacuum group is installing the replacement pipe.
- SFX cabling starting today.
FXE
SQS
SCS
MID
HED
OPT Lasers
XRO
- M2 in SASE3 is being replaced and the mechanics need to be re calibrated.
XPD
- FEL imager screen in XTD2 has been replaced.
- FEL imager screen in XTD10 will be replaced today or tomorrow.
VAC
AE
- SASE2 VAC loop has been updated.
- The VAC group requested an update of all the motion loops in the tunnel due to some problems with the encoder readout. In principle this could be done next week, but AE will meet with VAC and OPT to discuss the details before.
- MID/HED monos being commissioned.
EET
ITDM
- There was a network update last week
- This Wed/Thu the Maxwell clusters will be updated. No offline computing possible.
- Most of the activities planned for the WS have been done.
- Installation of new storage for SASE1 will be done in thenext days.
- OS in the PCs in the control rooms need to be updated. This will be coordinated with the intruments.
DET
CAS
- CY is now back working on the Mpots (SASE2 and 3). Changes have been implemented. SQS to perform tests. Documentation has also been updated and will be circulated probably next week.
- Karabo training has been organized. The agenda will be circulated soon.
- SPB Karabo upgrade has to be agreed with SPB/SFX.
AoB
- Fridays OP/Readiness meetying moved to 9.30 from now on.
|