We will run again an update in the Vacuum loop, just to fix small bug detected.

Thank you

Dear all, we will run another update in the Motion loop.

Thank you

Dear all,

We have detected with Karabo guys that there was a problem in the IonPumps in SASE1. The IonPumps are working, Raúl went to the Tunnel to check the controllers in XTD9 to confirm that.

According with Raúl and CAS people, we have arranged to do the next Vacuum update tomorrow early in the morning. I will post a new entry to let you know and I will contact now WP74 people in order to be quickly with the loop update tomorrow.

Thank you and sorry for the disturbing.

Dear all, we will proceed with the update of the Vacuum loop.

Thank you!

 General

• Photon tunnels will be searched starting at 1500 today and then closed. Machine will go back into regular operation this afternoon
• XTD9 stays open until further notice
• Flooding damaged several connectors in SPB Optics and FXE Instrument. 
• Jovo will replace connectors that show optical damage and test all cables that were in the water. A list is being compiled by Adriano. Meeting held for this purpose today at 1330 in XTOB.

XTDs

• Work continues on stability problem of SR imager 
• 2 updates were done on motion loop since a bug was still found for the MC2 lib after the first update
• 1 update was done for vacuum loop but another one needs to be done since there is still an issue with the NAGIOS system
• Test with the PBLM is still outstanding and will be done today
• The systems should be in a fully functional state again this afternoon!

FXE

• Vacuum gate valves can be controlled now after some work by J. Tolkiehn. Ion pumps are not controlled yet
• Next update of firmware should resolve the problem with ion pumps 
• Cables for loops 4&5 were in the water and hence work on these components has to wait

SPB

• Full E2E test was done for the PSLIT.
• Further tests will have to wait for fixes to cables

PLC

• AE works on AGIPD today and will go back to instruments tomorrow
• An update to the EPS needs to be done at some point in the near future to implement the end switches of the screens
• When cables are fixed and tested, all modules in the respective loop have to be pulled out as they are daisy-chained

KARABO

• New system implemented for deploying new versions that allows quick switch and possible roll-back
• Script system implemented that performs schema evolution for scenes. Hence, old scenes will be adapted to changes automatically. This is important for the many scenes developed by the PCT.
• Deployment of next Karabo version with bug fixes to be done before machine restart this afternoon

General

• Due to the water incident in the hall commissioning activities are somewhat delayed
• Next week 2 technicians from Actemium/Jovo arrive and shall fix damaged connectors, disassemble a subset of connectors and test all cables
• Detailed planning for the repair and testing will be made once Jovo is on site. But the work should go in this order: SPB Optics, FXE Instrument, SPB Instrument
• A few cables are also affected in the tunnels but the Vacuum group can shorten the cables and reconfection them
• Update of the motion loop in the tunnels should happen early on Tuesday
• SRP should present the detailed plans for the radiation safety tests asap so a respective road map can be worked out
• It was noted that the newly installed laser chicanes appear not to be radiation tight

XTDs

• The bug that leads to the GUI not updating is annoying and has led to a loss of at least 2 h of beam time
• One arm of the MCP got stuck since the end switch was not handled properly. For the moment this arm cannot be moved safely. The problem is understood but requires an update of the motion loop.
• The update on Tuesday also contains code for HIREX, updates for PBLMs and imagers

FXE

• Gate valves can be operated
• Problems persist with ion pumps and pressure gauges
• For radiation safety tests also the Fast Valve and the interlocks need to be working. This is not yet the case
• JJ XRay is coming again next week. It is not currently clear how much they can do in view of the cable problems

SPB

• The list of cables affected by the water were given to A. Violante
• Testing activities should progress in parallel with cable testing if possible. This requires the respective module to remain in the crates. It needs to be clarified whether this is possible

Laser

• The humidity in the hutch is still too high (>75%)
• Humidity regulation is not ok and oscillates by +- 5%
• The optical glue was found to be very sensitive to humidity and needs to be exchanged
• A few connectors were damaged in the flood. They will be exchanged by AE

Detectors

• AGIPD is currently open to fix problems with readout of temperature sensors and other controls
• Next week the detector will be closed again and then PLC tests will be carried out
• The modifications of the electronics took 1.5 weeks. Only 2 days were estimated
• The LPD detector is currently already controlled with KARABO
• DAQ is working and calibration runs with the internal source are being carried out
• Next week the detector will be moved into the X-Ray chamber and calibrations with X-Rays will be done
• 2-3 weeks from now LPD could move to FXE
• Readiness of FXE needs to be checked as KARABO versions are currently not compatible

Electronics

• FXE Loop 7 firmware is ready

Software

• Working on a more systematic approach to upgrades and support. In this scheme a candidate version can be fully set up and switch from old and new and back can be done quickly
• Working on a definitive list of supported devices in order to organise proper support

Dear all,

We will start with the Motion loop update. Will take us a little bit, around 3 hours, but I will let you know when it has finished.

Thank you,

Dear all,

The Motion loop is running again. We have included today the Mc2motor devices that were already before configured (FXE PBLMs and MCP), tomorrow we will include the rest of the PBLMs.

Right now is also into the loop the Hirex hardware in Rack 1.8 and the new crate of the Rack 1.18 for the temperature measurements.

Thank you,

 General

• Technicians from Actemium/JOWO arrived and found that a lot more connectors than originally estimated need to be replaced
• Tests are finished in SPB Optics (40 connectors to be replaced) and continue now in FXE 
• Replacing connectors starts tomorrow with 3 technicians and should take 45 minutes per connector 
• There is an interference of connector replacement and tests of the interlock. This needs to be resolved.
• Starting this week, new messages in the elog appear not to be sent to all registered users. (Info from J. Szuba: Some users intentionally or unintentionally un-subscribed)
• WLAN access at the end of XTD9 is not very good and not sufficient for testing cameras, e. g. in PBLMs

XTDs

• On the weekend the broker queue filled up. This was fixed using "extreme measures". This led to V0 closing and  BKR crew was not aware of the state of V0. It is the opinion of the experts that the BKR crew could have known but were not fully informed where to look
• The motion loop was updated yesterday for PBLM tests. But the update was not complete and will be redone today before 12:00
• PBLM tests with Mahadi and Natalia shall start after motion loop update
• XTD9 will be closed on Thursday (not confirmed)
• There has been a modification of the interlock conditions by RAUL for the gas section. This needs to be carefully checked.

FXE

• Communication is now possible with the ion pump controllers but there is still an error message from the controller that cannot be interpreted. The manufacturer of the ion pumps (AGILENT) has been contacted
• JJ XRay is here this week. They work on the patch boxes for the CRLs and the von Hamos Spectrometer
• The LPD 2-tile system will be brought into the hutch today to test the controls
• Commissioning on motors continues

SPB

• Currently there is no working version of Karabo for SPB (Fixes were implemented that broke base functionality)
• Loops 7 & 12 have not connectors affected by water and could be commissioned. AE was informed to provide firmware

Laser

• The humidity in the hutch is down to 50%, but still oscillates
• AE is fixing connectors with water problems
• After PLC cycling the Beckhoff terminals loose the proper parameter set. This issue needs attention.

Software

• Deployment of next KARABO version is postponed until the new version switching method is sufficiently tests. H. Sinn points out that this version (2.1.12) contains many urgent fixes and is needed asap.
• The incident on the weekend showed again the need for the consolidated list of mandatory devices. This is being worked on 
• The bug where the gui server looses track of the state of the system is still not fixed! If it occurs inform CAS immediately

Dear all,

Due to some hardware changes needed in Motion loop, we will last a little bit more in the Motion update. You will loose communication but I will come back when it is running again.

Thank you and sorry for inconvenience.

Dear all,

Motion loop is up and running again, now with all the PBLMs configured.

Thank you,

Dear all, 

according to the DESY logbook XTD10 will be opened today again: See DESY logbook entry:

'due to the cryogenic failure we will open XTD10 from 9am for working.
at XTL and XTD2/4 ZZ is possible for repairs/work.'

I don't know hoe severe the cryo failure is, but otherwise the agreement is that XTD9 will be closed Friday morning around 9am.

(I assume that they may close Friday morning also XTD10 again).

Best regards

Harald  

General

• E. Boyd presents a summary of the next tasks for the radiation measurements for hutch commissioning. There are some dates (13th and 20th June) that safety needs exclusively access to the hutches. Safety will be in close contact with Instruments to agree the dates.
• Tests are finished in SPB Optics (40 connectors to be replaced) and continue now in FXE.
• There is an interference of connector replacement and tests of the interlock. If Instruments grant exclusively access for the Interlock works, this has to communicate to PSPO to inform company JOWO that is working in the cable reparations.
  
• Starting this week, new messages in the elog appear not to be sent to all registered user. The system unsuscribed automatically from one elog when you suscribe to a new one. IT has already fixed this problem.
  
• WLAN access at the end of XTD9 is not very good and not sufficient for testing cameras, e. g. in PBLMs

XTDs

• Motion loop updated twice during this week, but there is still an issue with Elmo limits. AE will first test a solution and decide if a new update is necessary.
  
• PBLM tests with Mahadi and Natalia shall start after motion loop update.
  
• There has been a modification of the interlock conditions by RAUL for the gas section. This needs to be carefully checked.
• There is a request to improve the information when the tunnels are open/close, now it takes too much time to find the information in the elog. Suggested to have a unique place with the information up-to-date.

FXE

• There is a mistake in the channel assignment of the Ion pump controllers, modules BKF00074 and BKF00096 will be modified today. Moreover firmware for loops 1 and 2 have to be updated.
• JJ XRay is here this week, acceptance test for CRL is done. Work will continue with von Hamos Spectrometer
• The LPD 2-tile system brought into the hutch to test the controls.
• Loop 8 already deployed.
  
• Interlock defintion for FXE is done.

SPB

• Currently there is no working version of Karabo for SPB (Fixes were implemented that broke base functionality)
• EET is working to generate the exports for loops 7 and 12.
• There are still some mismatches in the connectors of 11 cables, A. Legrand working with Actemium to fix the problems.
  
• In loop2 one module is being reworked by AE.
• SPB is also affected by the problem with the Ion pumps, AE to figure out which modules have to be reworked.

Laser

• The humidity in the hutch is down to 50%, but still oscillates
• AE is fixing connectors with water problems
• After PLC cycling the Beckhoff terminals loose the proper parameter set. AE working on that issue but need soe additional information.
  
• There is a mismatch beween the motors and trthe control, AE will check if it a firmware or hardware problem.

Detector

• LPD test working succesfully, waiting when FXE hutch will be ready to move the LPD. Radiation protection has to be finished before to move the detector.

Software

• Deployment of KARABO version 2.1.12 will be deployed today to FXE. D. Goeries shows a presentation with a description of improvements in the new version.

 AE/PLC on call service:

     Contact Person:

              Nicola Coppolla

    Phone:

   9 - 8040

Tunnel's schedule:

• Monday 12th June:  XTD10 closed, XTD9 open
  
• Tuesday 13th June: from 7:00 to 15:00 all open.
• There is a request to have a unique place with updated information when the tunnels are open/closed, PSPO is working to set a place in the intranet and will inform as soon as this will be agreed.
  

General

• Cable reparations on OPT hutch on going, FXE will follow.
• WLAN access at the end of XTD9 is not very good and not sufficient for testing cameras, e. g. in PBLMs. ITDM re-cabled some ports and provided office network port in rack 1.17 that could be used to commission the cameras. According to Liuba it worked well.
• From 08/06/2017 the ITDM group provides the OCD service. The general principle is that the 1st level support is provided by CAS group and in case they cannot solve the ITDM related issue they call us. The phone number for ITDM OCD is: 98070 or directly +49 175 9814494. There is a single number for 3 mobile phones so the number is valid independent on the person providing OCD.

XTDs

• Motion loop updated twice during last week, but there is still a feature to be fixed.
• There has been a modification of the interlock conditions by RAUL for the gas section. Already implemented and working.

FXE

• There is a mistake in the channel assignment of the Ion pump controllers, modules BKF00074 and BKF00096 modified. Bug with the ion pump controllers still not corrected, AE and CAS are working on that.
• Acceptance test for CRL is done, final parameters settled down, next step is to test CRL with PLC.
• Loop 8 already deployed but still not working. This loop is low priority.
• Radiation safety measurements are the first priority for this wwek in FXE.
  

SPB

• Currently there is no working version of Karabo for SPB (Fixes were implemented that broke base functionality)
• EET is working to generate the exports for loops 7 and 12. Export for loop 7 will take longer than expected acc. to last info from EET.
• All motors in loop 1 are working.
• In loop2 one module is being reworked by AE, still on going.
• Firmware for Loop 3 is available.
• SPB is also affected by the problem with the Ion pumps, modules BKF00056, 00057 affected. AE working to solve this issue.

Laser

• After PLC cycling the Beckhoff terminals loose the proper parameter set. AE working on that issue but need some additional information from Laser group.
• There is a mismatch beween the motors and the control, AE will check if it ia a firmware or hardware problem.

Software

• Deployment of KARABO version 2.1.12 was deployed to FXE on Friday. The new version is deployed but not activated since there are some issues to fix.
  

Tunnel's schedule clarification:

• Monday 12th June:  XTD10 closed, XTD9 open
• Tuesday 13th June: from 7:00 to 15:00 all XTD9 and XTD10 open (all is incorrect, I mean XTD9 and XTD10).

Someone pointed out that XTD2 maintenance for tomorrow is cancelled and XTD2 wil be closed.

Last information is that tomorrow Fire brigade will come to inspect the tunnels, therefore all tunnels will be open from 7:00 to 15:00.

H. Sinn inform that XTD9 will not be searched until Wednesday morning.

Tunnel's schedule:

• Monday 12th June:  XTD10 closed, XTD9 open
• Tuesday 13th June: from 7:00 to 15:00 all open

General:

• G. Wellenreuther has created a link to the first version of a central schedule of "our" tunnels: https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules
• Any changes of schedules should be put in there first, and THEN a short message can be sent using the e-log pinpointing people always to this page. Please check correctnesss, and feel free to provide Gerd with any feedback.

XTDs

• Minor problem with Ion pump controllers, AE working on it. 
• Vacuum loop needs an update but it is not urgent.

FXE

• Ion pumps controller issue already fixed.
  
• Test of CRL with PLC is on going. There are some issues with encoders, could be a cable mismatch problem in PP, JJ to check. The cables for CRL have been already measured and are correct. 
• Radiation safety measurements being doing today.

SPB

• EET is working to generate the exports for loops 7 and 12. Export for loop7 will be ready this week and EET will continue with loop 12.
• Tests with loop2 on going.
• Firmware for Loop 3 is available, but cables have to be repaired.
• Modules BKF00056, 00057 affected by Ion pumps issue already modified.To double check with N. Coppola if more modules are also affected by this problem.
• Cameras are not in Karabo, this is a requirement before cameras can be connected. A. Silenzi to work on that.

Laser

• After PLC cycling the Beckhoff terminals loose the proper parameter set. AE working on that issue but need some additional information from Laser group.
• There is a mismatch beween the motors and the control, AE will check if it ia a firmware or hardware problem.

Diagnostics

• External trigger not always working, CAS working to find the cause and provide a solution.

Software

• Karabo version installed in a different domain, this will permit to fix errors. When this version will be ready, CAS will need 2 hours of downtime to implement.

XTD9 will be open until Friday this week 13:30. Check https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules