ID |
Date |
Author |
Location |
Severity |
Subject |
142
|
14 Jul 2020, 13:45 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 13.07.2020 |
General Announcement:
- XO will reset the calendar invites for the XO Integration Meetings of Mondays and Wednesdays as well as for the User&Operation Meetings on Fridays. Usual times will be
kept.
- Machine is on startup and the RF window will be 400us instead of 600us in the first 2-3 weeks. Instruments can expect about 160 bunches in this time.
- Instruments must take tunnel components out of beam path, especially in case they are connected to the EPS which could potentially block beam operation.
- XPD and HED report on turbo pumps that failed last week. One has to investigate of it is linked to the Karabo re-start due to the DESY-NOC activities last Tuesday.
FXE also reports motors in tunnel components were OFF.
CTRL:
- Further investigations are ongoing with Basler cameras that did not start after Karabo reboot.
DA:
- Not present.
EEE:
- Waits for feedback on the FXE XGM commissioning.
VAC:
- Nothing to report.
XPD:
- SASE XGMs are started and being operated.
- Lasing in SASE2 was confirmed in the FEL-IMG; SA1 was lasing @2mJ last night.
- Re-alignment of SASE3 was not yet confirmed - no beam visible on the XGM or FEL IMG, only spontaneous radiation.
- XPD did a successful DAQ test.
- ZZ in XTD10 will be required to investigate failed PES pump. This will take place on Tuesday.
DET:
- Poor vacuum SPB/AGIPB last Friday: under investigation (may be a 40 gauge) and will be followed up next days.
ITDM:
- New DAQ version was released to fix detectors and slow data acquisition: tested in SPB and FXE (Agipd and LPD).
- This week ITDM makes upgrades in all instruments but MID takes place next week; SCS still needs to agree on the date for this week.
XRO:
- Plan for the week is the recommissioning of the beam transport. XRO has shift plans for the weekend.
LAS:
- All lasers are running.
UNSYS:
- Nothing to report.
SPB:
- Vacuum issue with the 40 gauge under investigation by DET.
- No big problems for the start of next week.
FXE:
- DAQ test taking place today.
- XGM is going with the plan but for a cable that may need to be exchanged.
- Upgrade of Beckhoff system: motors were not moving. There is a lack of communication between the Beckhoff upgrade, control support and instrument scientists.
MID:
- Not present.
HED:
- HED had to check and/or entry the motor parameters after the reboot of the control systems that place motors in OFF state.
CTRL informs the information must be stored in the PLCs / Karabo. It is solved but it demanded a lot of work during last week.
SCS:
- Not present.
SQS:
- Problems occurring with turbo pumps. There is a particular controller in one rack that had to be replaced 7 times in 2 years.
EEE and SQS will investigate and do inspections on this rack. |
141
|
10 Jul 2020, 13:50 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 08.07.2020 |
General Announcement:
- Machine start-up continues to be ahead of schedule. Beam transmission to T4D and T5D has been done during the night (with open undulators).
- An Invitation for the User&Operation Meeting on next Friday 09:00 was sent to the user&opmeeting mailing list. If you did not receive it, please contact XO.
- XO Integration Meeting takes place only on Mondays and Wednesdays at 09:30AM.
CTRL:
- The synchronized shutdown, f/w update, configuration and restart of both CTRL network routers by DESY-NOC was performed yesterday.
This included the Karabo shutdown and restart in tunnels, instruments, etc.
- Problems linked to the re-start: in LAS a miss-behaving ADC and a faulty host cpu issue; in CTRL some obsolete deployment information.
- This Router update has to be schedule during the shutdown to avoid above mentioned issues.
- CTRL observed two Basler cameras which did not reestablish a network connection after the router updates: Please try power cycling the camera to restore system.
DA:
- No complications due to routers update.
EEE:
- Cabling installation in SCS is in progress.
- Technical staff will commission the FXE's two new brakes for XGM.
VAC:
- Not present.
XPD:
- Re-starting X-ray photon diagnostics devices this week.
- XGMs are ready for recommissioning.
DET:
- Nothing to report.
ITDM:
- Maintenance of ELOG server and update of application has been done last night. System has restarted.
XRO:
- Not present.
LAS:
- All LASERS are back today.
- Due to the router update, SA1 laser was the most affected due to loose of thermalization and was OUT of operation a full day. SA2 was OUT only for the afternoon.
UNSYS:
- Nothing to report.
SPB:
- Getting ready for beam: few DAQ issues still open but being worked out.
FXE:
- All motors in SA1 were OFF due to Karabo re-start linked to router update.
MID:
- Update of Linux computers: ITDM will communicate with MID for the re-installation.
HED:
- Nothing to report.
SCS:
- Nothing to report.
SQS:
- Nothing to report. |
140
|
07 Jul 2020, 13:23 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 06.07.2020 |
General Announcement:
- Since the end of the shutdown last Friday, the current Program is "Access/Tuning/Setup";
- DESY/MXL has started ramping up the Gun, powering and testing the Magnets and phasing the RF stations.
- Currently it has electron beam transmission up to the TLD and is ahead of the planned schedule for these days.
CTRL:
- Data logger issue: Friday CTRL has rolled back to the old data login system. Meeting today at 11:00 with involved groups to define next steps.
Information will follow via readiness mailing list.
DA:
- No issues to report.
EEE:
- Issue with HED PLCs: a fuse has been tripped and it has been replaced. A CPU was broken and is believed to have caused the fuse tripping.
This is the first time this happens in the facility.
- Cabling activities in SCS is scheduled to take place this week.
VAC:
- Nothing to report.
XPD:
- Nothing to report.
DET:
- Nothing to report.
ITDM:
- ITDM has made a request to DESY-IT for a routers restart. This will cause the network to be interrupted and restarted. Also Karabo will restart.
A meeting today will define the proper time for this action, currently schedule for tomorrow morning. Information will be send to the readiness mailing list.
XRO:
- Not present.
LAS:
- All lasers are up and running again.
UNSYS:
- Nothing to report.
SPB:
- Nothing to report.
FXE:
- Nothing to report.
MID:
- Few problems with motors were already solved last Friday by EEE.
HED:
- All going fine.
SCS:
- Not present.
SQS:
- Nothing to report. |
139
|
03 Jul 2020, 14:21 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 03.07.2020 |
General Announcement:
- The Interlock tests are finished in all tunnels and XHEXP1 areas, following information from D3 and SRP.
- From next week we will continue with XO Integration Meeting only on Mondays and Wednesdays at 09:00. The Fridays' XO Int. Meetings will be terminated.
- Next Friday 10.07 the User and Operation Meeting will re-start at 09:00 in the virtual format. Invitation and corresponding Zoom link will be send in a separate e-mail.
CTRL:
- Preparation for operations has started. Three issues have been addressed:
1. XPD issues are currently been worked and will extend over next week;
2. XFEL gateway troubles seems linked to a router configuration;
3. Migration of old data logger: problem with MID LA2 and SA3 (running wrong migration).
- Recovering complex configurations: meeting 12:00 with ITDM - please wait until Monday for update.
DA:
- Not present.
EEE:
- Follow-up of the shutdown activities is ongoing; Modification of PLCs was done.
VAC:
- Vacuum at beamlines are running; Shutters are ready.
- VAC plans to open XTD6 again from next Monday up to Friday, allowing HED access and work.
- Please inform VAC if XTD09 is needed to be accessed. Currently a ZZ is foreseen for this tunnel (EEE request).
- XTD10 can be accessed by ZZ during next week.
XPD:
- Small bugs on the DOOCS side of XGM were observed: bridges were checked and looked fine.
- XPD is planning the re-start of devices and support for machine tuning in coming weeks.
DET:
- Nothing to report.
ITDM:
- Nothing to report.
XRO:
- Not present.
LAS:
- SA2 laser: Train-ID showed issues (Update software failed).
- SA1 laser: went down due a crate failure and is warming.
- SA3 laser is fine.
UNSYS:
- Nothing to report.
SPB:
- AGIPB update needs to be fixed.
FXE:
- LPD new DAQ could not save data.
- Calibration pipeline for LPD is OK.
- Calibration pipeline for JungFrau does not work - also CTRL fixed the crash with DAQ (how the image gets the train ID's). The crash is not observed anymore.
MID:
- Discovered problems with motors in Laser room: EEE is informed and investigates.
HED:
- Will need access to XTD6 for final checks from Monday. Please inform VAC when access is finished.
SCS:
- Not present.
SQS:
- Not present. |
138
|
01 Jul 2020, 13:53 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 01.07.2020 |
General Announcement:
- Interlock tests are starting in SASE3 instruments right now. Zunaira, Eric and Wolfgang Clement are coordinating the TUV tests in the XHEXP1.
- MXL announced a draft for the machine start-up schedule which is published at the BKR e-log. The link to the schedule is:
https://ttfinfo.desy.de/XFELelog/show.jsp?dir=/doc/Schedule&pos=2020-06-29T15:40:57
CTRL:
- Group has a plan to switch the data loggers today; MID was already done in the past; Migration of old data was already done in advance.
- There was a report of issues with the GUI server. Currently it is under investigation. A workaround is to disconnect and reconnect again or move to a second GUI.
More information will follow.
DA:
- DA has two major plans for the upcoming days/weeks:
1. Implement auto triggering in pipelines for the instruments (used for data analysis); 2. Stablish a plan to have spread knowledge on development tasks.
EEE:
- Installation of a SCS component is arranged for July 8th.
- Cabling in HED is scheduled to be performed in cw31; EEE will contact FXE to fix a cabling installation date.
- More than 50% of Beckhoff modules are changed.
- Working on PLCs business as usual.
VAC:
- All fine: nothing to report.
XPD:
- Nothing to report.
DET:
- Nothing to report.
ITDM:
- DESY/NOC needs to perform software update of the control network routers for all SASEs.
This will take place next Tuesday, the 7th of July, between 6AM and 8AM in the morning. An e-mail will be sent to the Readiness list.
XRO:
- Not present.
LAS:
- All lasers are running.
UNSYS:
- Nothing to report.
SPB:
- Nothing to report.
FXE:
- Nothing to add.
MID:
- All running fine.
HED:
- Nothing to report.
SCS:
- Nothing to report.
SQS:
- Nothing to report. |
137
|
30 Jun 2020, 08:50 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 29.06.2020 |
General Announcement:
- The Photon Run Coordinator will re-start next Friday July 3rd. Please also feel free to contact him/her (9-4800) for daily coordination and communication with the
machine/BKR.
- Interlock / TUV tests are ongoing in tunnels. Next Wednesday it starts in the experimental Hall / SASE instruments.
CTRL:
- CTRL has a plan to switch the Data Loggers on Wednesday. This will cause a downtime on this service for about 5 minutes. A follow up will be announced afterwards.
DA:
- Not present.
EEE:
- EEE has made an agreement with HED on the cabling issues.
VAC:
- Tunnels are closed: maybe next week after Interlock tests the XTD6 and XTD9 tunnels will be open for a couple of days.
- If access in tunnels are needed (not only XTD6 and XTD9), please make a request by filling the table at the Desy/BKR elogbook
(https://ttfinfo.desy.de/XFELelog/index.jsp), located under "Access Requests".
XPD:
- Nothing to report.
DET:
- Nothing to report.
ITDM:
- Nothing to report.
XRO:
- Not present.
LAS:
- All lasers are fine.
UNSYS:
- Nothing to report.
SPB:
- It has tested the new Karabo for the Jungfrau detector and result is OK.
- This week SPB plans to test cameras.
FXE:
- Nothing to add.
MID:
- All fine.
HED:
- All fine.
SCS:
- Not present.
SQS:
- Nothing to report. |
136
|
25 Jun 2020, 10:27 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 24.06.2020 |
General Announcement:
- Exceptionally next Friday the XO Intergration Meeting will not take place. The meeting will resume next Monday.
Please send us an e-mail to xo@xfel.eu in case of any issue.
- Details on the Interlock Tests:
1. D3/SRP has the responsibility to carry on the tests;
2. TS and XO (communication) are supporting groups;
3. There is no rehearsal date;
4. Tests on the Instruments/SASE wll take place on July 1st, 2nd and 3rd (reserve date);
5. Access to the instruments and optics hutches is forbidden;
6. Access to the laser rooms are not restricted, apart from the HED laser which needs clarification;
7. Emergency off will be disabled on July 1st at 08:00AM. As soon as the emergency offs are tested, they can be enabled again;
8. The participating EuXFEL Radiation Protection Officer can inform the instruments as soon as tests are ready with the respective SASEs for resuming access and work.
- Maurizio V. and Nerea J. mention that an EPS check must be scheduled prior beam delivery. XO will check with Zunaira/SRP on its status.
- Suren K. points the PKG in SA3 undulators is still switched off. TS shall switch it on prior tunnel closure.
- Suren K. asks on tunnel access for next weekend. XO states tunnels will be put in Interlock tomorrow (June 25th) and shall remain interlocked until the next shutdown.
Access to XTD6, XTD9 and (maybe) XTD10 can be done for few days after the interlock tests. Access to all other tunnels must be via ZZ.
Tunnels will not be open for the weekend. (after the meeting DESY/MXL confirms this procedure).
CTRL:
- Nothing to report.
DA:
- Working on small requirements with the instruments.
EEE:
- SA1 VAC signal's issue from last Monday: it has been fixed. There was problems related to filter in the train-ID communication: the addresses were not properly set.
- Cabling is ongoing on SCS; HED cabling waits for time/schedule for installation (to be discussed between EEE and HED);
Cabling works ongoing with DESY-MPS which connect MID to PPS.
VAC:
- Closing the activities - SA1 VAC signals are OK.
XPD:
- Nothing to report.
DET:
- XO asks for an status on the MID/AGIPD train-ID issue from last Monday. S. Aplin and K. Wrona say it has to be further investigated as is not clear where the problem
lays.
The DAQ gets data from AGIPB, DOOCS, Karabo, labelled with train-ID and the labeling have to be checked for consistence. This is not a new issue and has to be addressed
in the frame of data reduction.
- A clear independent signal has to be also checked. P. Gessler says it is needed to get various patterns for a complete understanding. A clear strategy to develop and
address has to be made.
- S. Aplin will overlook the efforts among different groups.
ITDM:
- DAQ installations: this morning a fix for big detectors is done; after leaving DAQ for longtime there are some issues that will be fixed next week.
- Majority of acceptance tests are done - slow data is fixed.
XRO:
- Everything is done. The last check on tunnels was performed.
LAS:
- Nothing to report.
SPB:
- Nothing to report.
FXE:
- Nothing to report.
MID:
- Nothing to report.
HED:
- Finished with the tunnel components check.
SCS:
- Nothing to report.
SQS:
- Nothing o report. |
135
|
23 Jun 2020, 14:12 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 22.06.2020 |
General Announcement:
- The User & Operation Meeting that took place at beginning of this year on Fridays will re-start on July 10th.
Proper announcement and Zoom link will be sent. In this context, the XO Integration Meeting will continue only on Mondays and Wednesdays.
CTRL:
- Some of XFEL Elogs were not working during the weekend. ITDM is taking a look into the problem.
- SA1 Vacuum devices show some errors (not running). It seems the problems comes from the PLC and is under investigation.
The controllers in the tunnel were OK and pumps were placed in safe state.
This has affected all SA1 loop, at XTD2 and XTD9. Also the devices were not properly communicating.
DA:
- No issues to report.
EEE:
- Issues with the SA1 VAC loop.
- Updates of timing systems affecting LAS were successfully done on Friday. EEE encourages people to report in case of problems.
VAC:
- Reporting on the SA1 VAC loop issue.
XPD:
- Last Karabo update done on Thursday.
DET:
- No issues to report.
- MID observe a train mismatch between AGIPB and data sources such as SA2 XGM. The AGIPD has a shift of 1 train-ID.
This issue involves several groups and coordination and solution still miss.
- LPD/FXE also takes the train info from clock control but shows no mismatch.
ITDM:
- Investigating the Elog access issue.
XRO:
- Not present.
LAS:
- Maintenance in SA3 and SA2 are done. All lasers are running.
UNSYS:
- Nothing to report.
SPB:
- Nothing to report.
FXE:
- Nothing to report - checking the vacuum.
MID:
- Report on the AGIPD train-ID.
HED:
- Working with big lasers.
SCS:
- Nothing to report.
SQS:
- Nothing to report. |
134
|
19 Jun 2020, 14:28 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 19.06.2020 |
General Announcement:
- Next Monday it is planned the NOT-AUS experiment in the frame of Interlock tests and the emergency off will be disabled.
Only groups with EQP persons can continue working in the hutches. An e-mail was sent by TS.
- There will be test on smoke extraction in Tunnels on next Monday and Tuesday. Information was sent to Readiness mailing list.
- An e-mail to Readiness list was sent this morning regarding TUV/Interlock tests in SASE areas on July 1-3:
No access or work on the experimental and optics hutches is allowed in these days. More specific details will follow in the coming week.
If you have questions, please contact XO.
CTRL:
- Finished 2.9 deployment - control rooms also have the updates;
- CTRL is working on the XGM together with Theo (XGM does not update some properties). This came after an update done at the Desy side.
DA:
- Nothing to report.
EEE:
- Shutdown activities are ongoing.
- Migration to mc2motors was ongoing. EEE encourage groups to check motors after start running again.
- For next week: cabling work in SCS and PLC modifications with the help of two external colleagues.
- Timing system update: SA1 and SA3 timing system laser and instruments are done; EEE will do the SA2 this afternoon; Still to be arranged a date for the balcony rooms.
If problems occur, please contact Bruno Fernandez.
VAC:
- Finished all shutdown activities.
- The recovery of HED pulse picker branch needs help of HED staff. HED points Konstantin is around today.
XPD:
- Finished all XPD tunnel works.
- Testing ongoing: SA2 motors after mc2 migration.
- Checking the trigger on uTCA crates after upgrade.
- DAQ test was successful with ITDM.
DET:
- New DAQ system has some issues with AGIPD in SPB (did not store data) - to be followed next week.
- Deployment of new calibrations is ongoing.
ITDM:
- Nothing to report.
XRO:
- Not present.
LAS:
- Warming up SA3 laser.
- SA1: LAS maintenance is not finished. So we ramp up later. Bruno reminds SA1 must be back and switched on again.
UNSYS:
- Enclosure of panels in SASE3 has been installed and all tunnel activities are done.
SPB:
- Nothing to report.
FXE:
- Works on Detectors are ongoing.
MID:
- Nothing special.
HED:
- Activity with lasers alignment.
SCS:
- Not present.
SQS:
- Nothing to report. Working in different things/parts.
- SQS has planned activities for July 1st-3rd. It suggests that more specific communication on TUV tests and access restrictions must be done differently
than the e-mail distributed on June 8th and today. XO will look for improvements. |
133
|
18 Jun 2020, 13:40 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 17.06.2020 |
General Announcement:
- Today and tomorrow it takes place the tunnel ventilation maintenance between 6:30 and 8:00AM;
- An e-mail was sent to readiness list with tunnel access restrictions for next Friday morning at the Osdorf Born site in and XTD4 work between 10-11AM.
- Today there the maintenance of the SA3 hutch crane is scheduled.
CTRL:
- CTRL will follow up the uTCA updates.
- Mc2 migration in SA2 is almost done - only XPD needs to test some componenents.
- CTRL is working in some layout problems in scenes of the latest GUI update (new Karabo). Groups are encouraged to write tickets to CTRL if they require changes.
DA:
- Nothing to report.
EEE:
- Shutdown activities are ongoing with, e.g, VAC loop updates and PLC updates;
- The firmware updates affecting the PP-laser timing will take place on next Friday (19.06) in all SASEs.
- EEE is following the delay on the MID cabling related to personal interlock.
VAC:
- Shutdown activities in XTD6 and XTD10 are ongoing.
XPD:
- Currently finishing own summer shutdown tasks in tunnels.
- First DAQ test together with ITDM: had to wait the timing server re-start. To be continued today also after full mc2 migration.
DET:
- Calibrations of detectors at instruments are ongoing.
ITDM:
- Nothing to report.
XRO:
- Not present.
LAS:
- So far all in good state.
UNSYS:
- Nothing to report.
SPB:
- DAQ update was not an entire success - but it has been taken care. DAQ is needed for the calibration test of detectors.
FXE:
- Nothing to report.
MID:
- Nothing to report.
HED:
- Nothing special.
SCS:
- Nothing to report.
SQS:
- PC updates are ongoing.
- SQS raises the question on hutch access during the disabled emergency off planned for next Monday. It is possible that SQS EQP will be in sick leave on that day.
XO will contact Torsten Schoen to get more details on the time schedule and possible access for that day. |
132
|
16 Jun 2020, 13:32 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 15.06.2020 |
General Announcement:
- There will be additional ventilation maintenance on all tunnels, scheduled for next WED/17th and THU/18th between 06:30AM and 08:00AM.
We request staff to do not enter in tunnels during this period.
- TS has sent information on the hutch crane maintenance starting today up to Wednesday 16th. Please make sure one instrument colleague is present.
- XTD4 will be closed on next FRI/19th as part of Interlock Tests (§88 - TUV Prufung).
CTRL:
- Few minor things were solved on Friday.
- Notification service worked as expected in SPB; VAC also got notification.
- CTRL will follow the uTCA updated after EEE is done today.
- CTRL is working on the PMO projects.
DA:
- Nothing to report.
EEE:
- Activities running well.
- Today afternoon migration plan for tunnel crates and tomorrow SA2.
VAC:
- Nothing to report.
XPD:
- Nothing to report.
- XPD will check the uTCA crates after its update/restart.
DET:
- Data has been taken at SCS; also performing online tests.
ITDM:
- Nothing major - Continuing updates with SQS, MID and HED instruments.
XRO:
- Nothing to report.
LAS:
- Scheduled SA2 maintenance on Tuesday. EEE firmware update also takes place.
- Timing related updates on SA1 and SA3 are under discussion between the groups.
UNSYS:
- Everything is OK - All work in tunnels are done.
SPB:
- Nothing to report.
FXE:
- Nothing to report.
MID:
- Nothing to report.
HED:
- Water leak from last week: TS has contacted the external company and a faulty air humidifier was the cause. It will be changed/fixed.
SCS:
- Not present.
SQS:
- Nothing to report. |
131
|
12 Jun 2020, 13:48 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 12.06.2020 |
General Announcement:
- There will be tunnel ventilation additional maintenance on two mornings next week from 6:30 to 8:00AM. An e-mail to Readiness list will be send when dates are known.
- There was again a situation that the interlock door between XTD4 and XTD10 was blocked open. SRP reminds all that please do not leave this door opened.
Further investigation with Desy side will be done if this was a mistake done by an external company.
- EuP training: Tobias Haas has extended trainings until end of August. There will be refreshers and first time trainings starting on week 26 as in-person EuP training.
CTRL:
- CTRL is done with 2.9.0 deployment - now DAQ and calibrations checks are ongoing.
- No major issues during deployment: still few devices need to be updated again; CTRL is working on it.
DA:
- DA has released new version of extract data. Documentation will be send around and people are invited to give feedback.
EEE:
- Activities are running fine.
- PLCs side: this week there is migration for mc2 in SA2 - EEE ask people to crosscheck systems.
- Two cables in MID will be finished late next week (regarding personal interlock).
- EEE is conducting migration microTCA systems/crates: SA1 and balcony rooms.
- Timing for the Lasers updates has to be arranged with LAS. CTRL and EEE recommend making it during the shutdown. It needs green flag from LAS and Instruments.
- Upgrade of firmware of timing system: this will not be done to avoid stop timing system for lasers. Tunnels are done.
- Puppetization work is ongoing. SA2 and SA1 tunnel remains to be completed at beginning of next week.
VAC:
- No issues to report.
XPD:
- Follow up of SA2 mc2 migration: we recheck motors in tunnel; update scenes with CTRL.
- XPD is almost finished with large interventions.
DET:
- Test of Agipd with new Karabo is successful. The DSSC is also working.
ITDM:
- DAQ updates: to be started today or next week.
- Hardware updates in SASEs that ITDM will be performing.
XRO:
- Nothing to report: XRO is finished with big installations. Only small tasks to be done next week.
LAS:
- The broker update caused the timing in SA3 to be lost. It took several hours to bring up the system.
- Updates in SA2 (affecting timing) will be performed next Tuesday.
- SA1 and SA3 have to be scheduled and it depends also on instrument's plans.
SPB:
- It has planned tests on the calibration of pipeline / DAQs for next week.
FXE:
- It has upgraded to new Karabo and some controls will be updated today.
MID:
- Work ongoing as planned.
- CTRL test the influx data logger today and Monday and this causes loosing of information for few minutes.
HED:
- Water incident in SA2: Water spills caused a flooded experimental hutch. TS have repaired and will check with the external company if systems have been exchanged.
Such events must be avoided in future.
- In many hutches there are water sensors in the floor which are not connected: TS and SRP shall take a look.
- Summer shutdown: there was scheduled task (presumably from Desy groups) on June 8-10th that nobody showed up. By the other side, suddenly someone was working inside the
laser room.
Ulf would like to see Desy people working with better planning and coordination. As positive, EEE tasks on microTCA are an example of good practice in communication and
coordination.
SCS:
- Not present.
SQS:
- No issue to report. |
130
|
10 Jun 2020, 11:12 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 10.06.2020 |
General Announcement:
- Maintenance in the Tunnel Air Conditioning is completed. No more work restrictions are in place besides the regular COVID-19 rules.
CTRL:
- Deployment of Karabo 2.9.0 started yesterday accordingly to the information sent to readiness mailing list. So far the work goes with the plans.
- CTRL mentions Broker servers need update and will bring down Karabo again. Possible intervention date (early morning) will be discussed with LAS and Instruments.
A warning e-mail will be send 1-2 days in advance.
DA:
- Related to new Karabo: in case the upgrade is not covered, please contact DA.
EEE:
- Migration of mc2 done in SA2.
- Preparing call for tender of HED cabling; other instruments follow up next.
- There will be maintenance in SA1 and SA3 balcony rooms. A discussion with LAS is in place (risk of possible shutdown can be accepted).
VAC:
- Not present.
XPD:
- Nothing special to report - resuming tunnel activities after AC tunnel maintenance.
DET:
- Nothing to report.
ITDM:
- The updates on the online cluster side are almost finished. Only a check has to be done.
- Access to online cluster is labelled.
- DAQ has to be re-started.
- Updates are planned for tomorrow: reboot exflgateway at 10:00AM - an e-mail will be send to readiness mailing list.
XRO:
- Not present.
LAS:
- SA1 and SA3 lasers are in operation.
SPB:
- SPB asks for sending warning notice a day or two prior the Karabo restart intervention.
FXE:
- Nothing to add.
MID:
- MID will inform ITDM today on the dates for the updating the linux PCs in the hutches.
HED:
- Nothing to report.
SCS:
- Nothing to report.
SQS:
- SQS will also inform ITDM on possible dates for updating PCS.
- Some macros are not running (they were not able to start). |
129
|
09 Jun 2020, 15:47 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 08.06.2020 |
General Announcement:
- SA2 lasing: up to 2mJ@9keV was achieved with strong linear and quadratic tapering with 250pC bunch charge.
Lasing with 500pC achieved 0.45mJ@9keV and with 100pC achieved 0.75mJ@9keV.
- From today we start the summer shutdown phase.
- Please note the last minute information on air conditioning maintenance in tunnels between Tuesday 15:00 up to Wednesday 08:00.
We ask groups to shift planned works to outside this time slot. In case you need to be in tunnel, it is mandatory to use FFP2 masks.
CTRL:
- Karabo 2.9.0 deployment will start tomorrow and follow over the week. Typical activity time is from 8AM-16:00 each day.
DA:
- No problems.
EEE:
- EEE plans for tomorrow the mc2 migration.
VAC:
- HED mono has adjusted gap between crystals. All other tunnel activities ongoing.
XPD:
- Major task for the coming week is related to the PES maintenances. All other tasks are also organized.
DET:
- Will carry tests after the Karabo installation.
ITDM:
- Group will be busy with updates to be done this week.
XRO:
- Completed big shutdown activities: M3 cooling mirror - leak tested OK and pumping during the weekend.
LAS:
- All lasers are in operation.
SPB:
- Progressing with regular planned tasks.
FXE:
- Nothing to report.
MID:
- Nothing to add.
HED:
- Working with EEE activities.
- HED requests suitable dates for testing the THz laser. This date has to avoid infra-structure, interlock and other works.
SCS:
- Nothing to report.
SQS:
- Nothing to report. |
128
|
05 Jun 2020, 13:44 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 05.06.2020 |
General Announcement:
- Many summer shutdown tasks have been scheduled already and information has been sent to the groups with tunnel tasks.
- XO will not fully engage with tasks in the instrument Hall carried by the Instruments. Please contact XO if there are difficulties in organizing these works.
- Be aware of date for potential power off: 22 June (MPS group runs upgrades that may trigger the emergency power off);
- Be aware of date for hutch access restrictions: July 1st and 2nd (D3 will test interlock system in experiment hutches);
3rd of July is a reserve date - please expect only limited access to the hutches due to this tests.
- Safety information: Desy is now recommending each person to take a FFP-2 mask for tunnel works to be used in case of close proximity work.
EuXFEL will follow this rule: SRP has available masks and groups with tunnel activities can collect these masks with SRP
- A schedule for summer shutdown activities will be send soon to the readiness mailing list.
CTRL:
- CTRL has distributed schedule for updates. For example, the BKR machines will be performed on Tuesday;
- The update of exflgateway will take place on Wednesday next week.
DA:
- Nothing to report.
EEE:
- It is planned to perform the loop update for the MC2 library on Tuesday.
- Changes requests on cabling are being finalized.
VAC:
- Currently carrying on the SA2 work on HED mono together with XRO on alignment; SA3 re-alignment activity is done;
SXP installation is ongoing and preparing the exit slit installation.
XPD:
- The DPS remaining problem in XTD2 is solved. Pressure is going down (<10e-8).
- Work on motor calibrations on HIREX: one (XTD6) to be done next week after migration library.
- For next week there will be activities of maintenance in the XTD10-PES.
- SA2 is operating until Sunday and machine is currently using 100pC bunch charge.
- Works on the clean rooms/labs are ongoing. Acceptance test on the new PES prototype may be finished today.
DET:
- Nothing to report - small issues have been worked and solved.
ITDM:
- Preparing shutdown activities that start on Monday: update of control servers together with CTRL; updating PC layer servers, computer clusters, etc...
There shall be interruptions in the DAQs systems;
- Updating Karabo 2.9 and exflgateway: at the same time ITDM will update also Maxwell and reboot gateways to be taken place on Wednesday (joint effort CTRL, ITDM).
XRO:
- Proceeding well: Mono in XTD6; vacuum in XTD9.
- Possible summer activities are on hold and XRO will inform XO accordingly.
LAS:
- Laser down due to maintenance/updates: SA1 PP-laser on Tuesday 9/6; SA2 on Wednesday 10/6; and SA3 on Thursday 11/06.
SPB:
- Works are going well.
FXE:
- Nothing special to report.
MID:
- Nothing special to report.
HED:
- Activities on the Split and delay line (cleaning), on PP-laser, among others. No faced issues.
SCS:
- Not present.
SQS:
- No answer from external company on the active fiber. |
127
|
04 Jun 2020, 13:31 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 03.06.2020 |
General Announcement:
- Summer shutdown is nearing. Few dates on crane maintenance at XHEXP1 were sent to the readiness mailing list. Please be aware on the dates when planning activities.
- MPS software updates are planned for the summer shutdown - an update on potential emergency off situations will be informed.
- Groups and instruments are encouraged to make questions/comments.
CTRL:
- Continuing with shutdown tasks: CTRL will deploy Karabo 2.9 next week: an e-mail with information on dates for the installation in instruments will be sent.
- For SASEs areas: SA2 deploy takes place on the 9th June; SA1 an SA3 will follow on the 10th. Dates will be sent to the readiness mailing list.
- Please contact CTRL for any comment/question.
DA:
- Nothing to report.
EEE:
- There are planned tasks on migration of Mc2 and Vacuum eps updates.
- EEE is working with regular tasks together with the instruments.
VAC:
- Working as planned in the tunnels: MID pre-shutter is installed; SA3 re-alignment is done; Continuing with SSP shutter in SA3; Loop updates.
- Desy-MXL will contact VAC on the SXP slits installation.
XPD:
- Finishing the tasks in tunnels.
- XPD has been supporting the tuning efforts on SA2 lasing during this week.
DET:
- DET will communicate with CTRL on dates for tests and potential conflicts.
ITDM:
- Maxwell related issues: System does not work well, probably due to a bug. ITDM and DA will check. Desy service shall be contacted in case of troubles.
- Instrument control room PCs: FXE is already equipped with new computers, as well as SCS and SPB. An Update of control PCs in experimental hutches of SQS, MID and HED
has to be done.
- Each of those three instruments has to inform ITDM when this can be take place - a complete new installation will be made - please backup the PCs!
- CTRL also remarks Karabo installation has to be done in some instruments.
XRO:
- Not present.
LAS:
- Synchronization issue is fixed (due to broke delay line). This week Desy colleagues will work on improvements of communication to lasers.
SPB:
- Working together with LAS, CTRL and EEE to solve small issues.
FXE:
- Update on the Jungfrau status has to be clarified.
MID:
- Progressing with the works on the split and delay line.
HED:
- Group is busy with PP laser and other regular business.
SCS:
- Not present.
SQS:
- No news from the external company on the laser active fiber issue. |
126
|
29 May 2020, 14:22 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 29.05.2020 |
General Announcement:
- Due to the public holiday this meeting do not take place on Monday.
- Safety related questions:
1. DACHS issue that XPD staff could not enter the lab in E0.505: there was a false entry in the DARF-DACHS system that was corrected. It shall be working now;
2. It seems DARF-DACHS system shows incorrect dates for training expirations. SRP will check on possible corrupted dates;
3. EuP trainings validity will be extended until end of June.
- Safety masks: A warning was issued by Hamburg authorities. EuXFEL has some masks that belong to the batch mentioned in the warning but with different production dates.
Currently SRP has no info if these masks are not suitable for use but will keep staff updated.
CTRL:
- Nothing to report.
DA:
- Not present.
EEE:
- SQS cable installation: some issues related to the over lengths will be fixed by the external company during next week.
VAC:
- Nothing to report.
XPD:
- Planned tunnel work is ongoing.
- For next week: 1. A differential pumping station in XTD2 will need to be locally checked next Wednesday. 2. Additional housings on XGM will be done.
- SA2 K-mono measurements were performed in BKR. Evaluation of results need to be made with a new software tool (ticket has been sent).
DET:
- Ongoing work on various detectors (located in different instruments) will continue next week.
- CTRL has to be informed on the plans for the next week: the calibration pipeline must be followed and time for deployment. DET will check what the plans are.
ITDM:
- Nothing to report.
XRO:
- XRO installed InGa in M3 mirror in XTD9. Group had good experience while working with masks and face shields inside clean tent.
It was found a small damage in the mirror that will be further investigated and reported next week. Next week there is a plan to close the chamber and pump down.
LAS:
- SA1 and SA3 lasers are in operation.
- There are ongoing work in SA2 laser synchronization; Laser operation will be back after today.
SPB:
- Nothing to report.
FXE:
- XGM cabling going on;
- FXE contacts CTRL on the Jungfrau crashing issue that happens when 2 Detectors operate simultaneously. CTRL states this issue is being investigated while in operation
and is not reproducible. In addition, it seems to happen only at FXE and not in SPB. Further fix needs to take place prior start of operation.
MID:
- Nothing to report.
HED:
- Nothing to report.
SCS:
- Not present.
SQS:
- No news on the active fiber were received. |
125
|
28 May 2020, 13:58 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 27.05.2020 |
General Announcement:
- It seems EuXFEL was not affected due to the power glitch at the Desy site last Tuesday (no device was found in off state or damaged).
- TS informed no indications of power failure at EuXFEL. Groups are encouraged to inform XO if they find components that have been affected.
CTRL:
- CTRL has deployed a new cross-hair in images for all instruments; XPD is fully using it. This cross-hair will be also used in the Doocs panels
allowing BKR to use it as tuning tool. CTRL reminds that if operator does not disable it then it ends in the DAQ.
- CTRL is in contact with instruments to arrange New Karabo2.9 installation.
DA:
- Working with contact persons for the Detector Advisor committee.
EEE:
- EEE raises a question on the Shutdown planning procedure for the task scheduling.
XO plans to use a summer shutdown process that coordinates with individual groups the tunnel scheduling.
Starting in the next few days XO will contact the groups for individual scheduling.
Tunnel activities will be initially scheduled and try to schedule without resources conflicts.
- EEE plans planned to make a SA3 loop update tomorrow.
- A MPS board in SA2 is not properly working and has to be replaced. Contact with DESY was done
and this shall not affect operation or risk triggering the emergency power off.
- Today the remaining cable work at FXE will be concluded.
VAC:
- Not present due to tunnel activities.
XPD:
- There was an incomplete update of SA1 Vacuum loop. EEE informs there are issues with some gauges and by tomorrow EEE
must have it fixed and will conclude the final update.
- Yesterday re-cabling SA3 (SS3 brunch) was done; exit slits are being reconnected. The main Karabo shows the two exit slits not connected.
For the IMG it is needed support from CTRL and XO.
DET:
- Nothing to report.
ITDM:
- Nothing to report.
XRO:
- Installing the cooling in XTD9 (M3) during next days and then VAC will take over by next week.
- Actions in XTD6 are needed in order to receive beam for possible operation during June 6th-7th (for the self-seeding activities). XRO will send a summary to XO.
LAS:
- SA1 laser is back: SPB and FXE shall measure energy to confirm all is fine. It is still unclear the cause of water leak in the SA1 laser last week.
SPB:
- Nothing to report.
FXE:
- Nothing to report.
MID:
- Nothing to add.
HED:
- Nothing to report.
SCS:
- Not present.
SQS:
- Everything is going as planned.
- Regarding the active fiber laser, SQS is waiting for the company reply. |
124
|
25 May 2020, 15:29 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 25.05.2020 |
General Announcement:
- Machine started SA2 lasing last weekend. Currently photon energy is 0.5mJ at 9keV.
- CTRL OCD was called Friday on the SR slits position and movement. It was quickly solved.
- XO ask people who carries work in tunnels to use this meeting to raise questions and concerns.
- XO also ask people to discuss during this series of meetings possible resource conflicts among the support groups for the upcoming week(s).
CTRL:
- New Karabo version installed at MID is working nicely. Instrument staff is creating new panels with Karabo9 and CTRL hopes to integrate
this Karabo version in the whole facility during summer shutdown.
DA:
- Not present.
EEE:
- Working in normal duties.
- Cabling installation in SQS is done. The FXE installation has a mismatch with a rack planning (XGMD) and responsible company for installation
may come back on Wednesday to solve it.
VAC:
- Tunnel works are nicely ongoing.
XPD:
- Working on tunnels and looking at lasing in SA2.
DET:
- Nothing to report.
ITDM:
- Nothing to report.
XRO:
- Nothing to report.
LAS:
- A water leakage in an amplifier box in SA1 laser occurred last Thursday. It is repaired but LAS will have to investigate on possible damages on optics
(due to water inside). Laser operation will be possible only tomorrow or at the end of the week. LAS will provide further details on Wednesday.
SPB:
- Nothing to report.
FXE:
- Nothing to add besides the cabling installation issue mentioned by EEE.
MID:
- New Karabo is working nicely up to now.
- Tunnels work is also finished; MID staff continues with work on the hutch/optics.
HED:
- No issues to report.
SCS:
- SCS will be busy with an external company and needs assistance of SRP on hot work permit. Sandra Plett will communicate with Michael Prollius.
- SCS has informed DET that there is data in the computer to be saved. DET is aware and has taken needed actions.
SQS:
- Nothing to report: activities are progressing normally. |
123
|
22 May 2020, 08:57 |
Frederik Wolff-Fabris | General | Information | Notes XO Integration Meeting 20.05.2020 |
General Announcement:
- XO Integration Meeting will not take place next Friday 22.05 due to the bridge holiday.
- MPS group shared some info on the SA1 emergency power off event that happened last week. Further investigations are ongoing.
- No conflicts have been reported for the activities on control network systems.
- Today 20.05 is the deadline for the groups to send via e-mail the updated summer shutdown tasks.
- MXL/Desy has planned to start on next Saturday and Sunday the SA2 photon search and operation.
CTRL:
- CTRL works together with XPD in the Doocs images for the IMG devices. A new control update will be deployed. The data is no longer corrupted.
- Today CTRL is deploying Karabo9 at MID. This serves as a small scale test prior the deployment on the other parts/groups of EuXFEL.
During the summer shutdown it will be deployed at the BKR photon computers.
DA:
- Working with the Karabo deployment.
- Group is available for data analysis and troubleshooting in devices, e.g. the Detectors.
EEE:
- EEE reminds the cables in the MPS room still remain to be connected (linked to the emergency off event of last Friday).
MPS group do not know yet when this will be done. As soon as XO know it will be informed.
- SQS cabling installation is done. FXE cabling work has started: it has an open issue with HV cables but it will be solved today.
Over lengths of cables are currently stored in the instruments but will be moved later.
VAC:
- Working in tunnel activities: MID pre-shutter; SA3 re-alignment ongoing.
- SA3 re-alignment: today we end at the PES - work ongoing accordingly to the plan. Upstream side of the gas attenuator will start on next Monday.
- No issues to report.
XPD:
- XPD is finishing XTD2 and XTD9 tunnels works: water cooling, pumps, boxing electronics; XPD will try to do activities in XTD10 in parallel with the re-alignment.
- All working fine - an updated file for the summer shutdown list will be send later today.
DET:
- The AGIPB detector at MID was re-started yesterday.
- SPB detector will be tested today or Friday (complete test after the emergency off event).
ITDM:
- Nothing to report.
XRO:
- Nothing to report.
LAS:
- Nothing to report.
SPB:
- Nothing to report. No damages due to the emergency off event but still has to test the detectors.
FXE:
- Nothing to report - no damage associated to the emergency off event.
MID:
- It is planned to check the power modes.
- MID gets confirmation it can access XTD6 today.
HED:
- Not present.
SCS:
- Not present.
SQS:
- Just protective rules on the OFF buttons were changed - nothing has been done on the functionality side. |