Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Joint Operation and Readiness Logbook, Contact: T.Haas, A. Violante, G. Wellenreuther, Page 17 of 30  Not logged in ELOG logo
ID Date Author Location Severity Subject
  277   06 Jun 2017, 13:46 NEREA JARDONGeneralInformationMotion loop update

Dear all,

We will start with the Motion loop update. Will take us a little bit, around 3 hours, but I will let you know when it has finished.

Thank you,

  276   03 Jun 2017, 22:39 Alessandro SilenziGeneralProblemSOLVED BROKER Problem

A pile up in the BrokerQueue was detected by CAS monitoring system and

a response action from the On-Call personnel was triggered.

Regrettably, the following device servers have been shutdown and will be re-instantiated.

- Dataloggers
- alarm server
- camera servers
- Motion Loop and Vacuum Loop beckhoff servers

Sorry for the inconvenience

  275   02 Jun 2017, 13:01 Tobias HaasGeneralInformationStatus and plans after SASE1 Readiness Meeting

General

  • Due to the water incident in the hall commissioning activities are somewhat delayed
  • Next week 2 technicians from Actemium/Jovo arrive and shall fix damaged connectors, disassemble a subset of connectors and test all cables
  • Detailed planning for the repair and testing will be made once Jovo is on site. But the work should go in this order: SPB Optics, FXE Instrument, SPB Instrument
  • A few cables are also affected in the tunnels but the Vacuum group can shorten the cables and reconfection them
  • Update of the motion loop in the tunnels should happen early on Tuesday
  • SRP should present the detailed plans for the radiation safety tests asap so a respective road map can be worked out
  • It was noted that the newly installed laser chicanes appear not to be radiation tight

XTDs

  • The bug that leads to the GUI not updating is annoying and has led to a loss of at least 2 h of beam time
  • One arm of the MCP got stuck since the end switch was not handled properly. For the moment this arm cannot be moved safely. The problem is understood but requires an update of the motion loop.
  • The update on Tuesday also contains code for HIREX, updates for PBLMs and imagers

FXE

  • Gate valves can be operated
  • Problems persist with ion pumps and pressure gauges
  • For radiation safety tests also the Fast Valve and the interlocks need to be working. This is not yet the case
  • JJ XRay is coming again next week. It is not currently clear how much they can do in view of the cable problems

SPB

  • The list of cables affected by the water were given to A. Violante
  • Testing activities should progress in parallel with cable testing if possible. This requires the respective module to remain in the crates. It needs to be clarified whether this is possible

Laser

  • The humidity in the hutch is still too high (>75%)
  • Humidity regulation is not ok and oscillates by +- 5%
  • The optical glue was found to be very sensitive to humidity and needs to be exchanged
  • A few connectors were damaged in the flood. They will be exchanged by AE

Detectors

  • AGIPD is currently open to fix problems with readout of temperature sensors and other controls
  • Next week the detector will be closed again and then PLC tests will be carried out
  • The modifications of the electronics took 1.5 weeks. Only 2 days were estimated
  • The LPD detector is currently already controlled with KARABO
  • DAQ is working and calibration runs with the internal source are being carried out
  • Next week the detector will be moved into the X-Ray chamber and calibrations with X-Rays will be done
  • 2-3 weeks from now LPD could move to FXE
  • Readiness of FXE needs to be checked as KARABO versions are currently not compatible

Electronics

  • FXE Loop 7 firmware is ready

Software

  • Working on a more systematic approach to upgrades and support. In this scheme a candidate version can be fully set up and switch from old and new and back can be done quickly
  • Working on a definitive list of supported devices in order to organise proper support

 

  274   31 May 2017, 11:05 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

 General

  • Photon tunnels will be searched starting at 1500 today and then closed. Machine will go back into regular operation this afternoon
  • XTD9 stays open until further notice
  • Flooding damaged several connectors in SPB Optics and FXE Instrument. 
  • Jovo will replace connectors that show optical damage and test all cables that were in the water. A list is being compiled by Adriano. Meeting held for this purpose today at 1330 in XTOB.

XTDs

  • Work continues on stability problem of SR imager 
  • 2 updates were done on motion loop since a bug was still found for the MC2 lib after the first update
  • 1 update was done for vacuum loop but another one needs to be done since there is still an issue with the NAGIOS system
  • Test with the PBLM is still outstanding and will be done today
  • The systems should be in a fully functional state again this afternoon!

FXE

  • Vacuum gate valves can be controlled now after some work by J. Tolkiehn. Ion pumps are not controlled yet
  • Next update of firmware should resolve the problem with ion pumps 
  • Cables for loops 4&5 were in the water and hence work on these components has to wait

SPB

  • Full E2E test was done for the PSLIT.
  • Further tests will have to wait for fixes to cables

PLC

  • AE works on AGIPD today and will go back to instruments tomorrow
  • An update to the EPS needs to be done at some point in the near future to implement the end switches of the screens
  • When cables are fixed and tested, all modules in the respective loop have to be pulled out as they are daisy-chained

KARABO

  • New system implemented for deploying new versions that allows quick switch and possible roll-back
  • Script system implemented that performs schema evolution for scenes. Hence, old scenes will be adapted to changes automatically. This is important for the many scenes developed by the PCT.
  • Deployment of next Karabo version with bug fixes to be done before machine restart this afternoon

 

 

  273   31 May 2017, 10:45 NEREA JARDONGeneralInformationVacuum Loop

Dear all, we will proceed with the update of the Vacuum loop.

Thank you!

  272   30 May 2017, 20:42 NEREA JARDONGeneralInformationVacuum Loop

Dear all,

We have detected with Karabo guys that there was a problem in the IonPumps in SASE1. The IonPumps are working, Raúl went to the Tunnel to check the controllers in XTD9 to confirm that.

According with Raúl and CAS people, we have arranged to do the next Vacuum update tomorrow early in the morning. I will post a new entry to let you know and I will contact now WP74 people in order to be quickly with the loop update tomorrow.

Thank you and sorry for the disturbing.

  271   30 May 2017, 19:43 NEREA JARDONGeneralInformationMotion loop

Dear all, we will run another update in the Motion loop.

Thank you

  270   30 May 2017, 18:32 NEREA JARDONGeneralInformationVacuum Loop

We will run again an update in the Vacuum loop, just to fix small bug detected.

Thank you

  269   30 May 2017, 18:14 NEREA JARDONGeneralInformationMotion loop

Dear all,

I will make an update of the Motion loop in the next minutes, all the systems are in safe state.

Thank you

  268   30 May 2017, 15:52 NEREA JARDONGeneralInformationVacuum Loop

Dear all,

We will run the update of the Vacuum loop in the next half hour.

Thank you!

  267   30 May 2017, 11:08 NEREA JARDONGeneralInformationVacuum Loop

Dear all,

Sorry, my last message was not correct. We will do the hardware changes when we have prepared the Vacuum update also.

Thank you

  266   30 May 2017, 10:56 NEREA JARDONGeneralInformationVacuum Loop

Dear all,

It is needed to add two digital input terminals in Rack 1.17 and 1.18 in XTD9 for the vacuum loop, and Denis will do it in the next minutes. Therefore you will loose communication for those motion racks.

Thank you

 

  265   29 May 2017, 16:30 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

 General

  • Photon tunnels are open until Wednesday afternoon due to the flooding on the weekend. 
  • The down time should be used to do important fixes/upgrades
  • XTD9 can stay open all week depending on the decision of the PCT
  • Photon commissioning successfully brought beam to the end of both the SPB and FXE beam lines

XTDs

  • Stability problem of SR imager is still being worked on by A. Parenti (CAS)
  • A new version of Karabo with many fixes is currently being tested and will be deployed once the test results appear satisfactory
  • Test of the PBLM motors still need to be done in XTD9. This requires an update of the motion loop that should be done today or tomorrow
  • There is also the need of an update of the vacuum loop. This should also be done during the down time

FXE

  • Problem still exist with vacuum controls. The problem appears to be understood and seems to be on the PLC side. FXE uses ion pumps with an analog output that does not interface with the alarm level settings.J. Tolkiehn is working on it
  • Work progresses on motor testing
  • FXE requests firmware for loop 7. But this work interferes with the priority on the vacuum.

SPB

  • Loop 1 is now fully available with all modules
  • Loop 2 is available with only the first module. The other modules are away for modification
  • Due to the flooding the connectors cannot be attached until cables have dried and have been re-tested

PLC

  • AE will work again on AGIPD this week. This limits resources for the instruments

KARABO

  • Problem with X2 timer interface is solved. But PCT apparently still uses the DOOCS interface.
  • Waiting for the go ahead to release the next KARABO version
  • Work progresses in parallel to intergrate DAQ into KARABO. This will be the next version after the bug-fix version

ITDM

  • The announced update of the network switches will be  done on Tuesday morning and will result in a 5 minute network interrupt

 

  264   27 May 2017, 16:31 Harald SinnGeneralInformationStatus of beam commissioning

We got the beam to the end of XTD9 onto the SPB screen and FXE Pop-in (the SPB pop-in does not work).

Everything looks quite good and the beam is quite stable.

Lasing photon engery is around 6.2 keV and 200-300 mJ per pulse.

Harald

 

  263   26 May 2017, 18:01 Gabriele GiovanettiGeneralInformationCAS OCD phone numbers for the weekend
  • Friday 7 PM - Saturday 8.00 AM    : 98060
  • Saturday 8.00 AM - Sunday 8.00 AM : 98054
  • Sunday 8.00 AM - Monday 8.00 AM   : 98055


  262   24 May 2017, 10:39 Tobias HaasGeneralInformationStatus after 0930 meeting

 General:

  • DESY will try to lase again at higher energies during the next days
  • XTD9 will searched an interlocked this afternoon at 1400 as PCT will try to transport photons as far as possible
  • Company Wille has started to work on the radiation interlocks in SASE1. New TÜV date on 20 June and rehearsal on 14 June
  • Instruments should be prepared that on these days

 

XTDs:

  • CAS (A. Parenti) is still working on the instability problem of the SR imager. For the moment the workaround with reduced resolution (mono-8) seems to acceptable
  • One (non-existing) pump needs to be removed from interlock conditions in XTD9. Otherwise interlock blocks one gate valve
  • Filter was taken off the pop-in in XTD2
  • Tests for PBLMs still need to be done in XTD9 when it re-opens next week

FXE:

  • Problems exist with vacuum controls. J. Tolkiehn is currently working on it
  • Firmware of commissioning crate was upgraded
  • Test of Johan Spectrometer was done with test crate
  • CRL test are next

SPB:

  • Still waiting for firmware for loops 1&2. AE is almost ready and will deploy today
  • All cables are ready for Optics hutch
  • AE is currently pushing in the crates

PLC:

  • DESY MPS claims that a cable from the interlock to an AE crate is still missing. 
  • AE got vital information from MPS just a few days ago and is still waiting for info from the laser interlocks

KARABO:

  • CAS is working on a version with bug fixes for stability. Will be deployed when appropriately test and when a break is available
  • X2 timer interface still has issues. A. Sienzi is working on it

ITDM:

  • An update of network switches is needed. This will be scheduled for next week. Details to be discussed during Monday 1500 BKR meeting

 

  261   24 May 2017, 09:06 Tobias HaasGeneralInformationReminder: SASE1 Readiness Dispatch @ 0930 today

see you there 

  260   22 May 2017, 13:31 Tobias HaasGeneralInformationStatus and Plans after 09:30 Meeting
General:
  • No break this week on Wednesday. (Wednesday breaks for XTD10 should start next week)
  • Possibility of ZZ access to XTDs on Tuesday from 0700 - 1500. Harald organises the access for vacuum and
    diagnostics. No ZZ without previous experience
  • Expect XTD9 to close next week.

XTDs:
- SR imager crashed several times on the weekend. D. Görries spent a lot of time investigating and found that
when the configuration of the camera is set to mono-8 it runs stably. This indicates that there is a network
bandwidth issue
- D. Görries also had to restart the KARABO server for the MCP. One motor was working but the other one had
hardware problem and requires an access to the tunnel
- Tests for ELMO motor on PBLMs this week by Mahadi and A. Silenzi. N. Gerassimova is on holidays but agreed to
the test
- A. Parenti would like to deploy SW with added debugging functionality for imagers

FXE
- A. Galler and W. Gawelda are not available this week
- D. Görries reports that there are still problems with controlling the vacuum, I. e. gauges, pumps, valves,
fast valve. Some are related to cabling problems that are currently being fixed
- A firmware upgrade is requested for the commissioning crate. Will be discussed in detail with AE

SPB
- Work by AE on AGIPD for this week was called off as detector consortium wants to work on the hardware
- AE will concentrate on commissioning loops 1&2 for the optics hutch
- Firmware for loops 1&2 needs to be first regenerated
- All cabling problems should be solved by tonight
- All crates can then be pushed in
- All cables should be done except for 4 or 5 in the instrument hutch

KARABO

- The bug that results in devices not updating in the GUI server still persists
- Users are requested to inform A. Silenzi as soon as they discover this behaviour

Plan for the next days
- Start with SPB optics hutch
- Update firmware of FXE commissioning crate
- Test ELmo motor in XTD9
  259   22 May 2017, 11:06 Tobias FreyermuthGeneralInformationAE PLC OCD

From now on the PLC OCD contact person will have always the phone number:

  9 8040

  258   21 May 2017, 17:10 Dennis GoeriesXTD2ProblemSASE1 Imager FR

Dear all,

we are experiencing constantly crashes with the photonic science camera in the SA1 imager FR. We found now out

- If the pixel format is set to Mono16 the camera will most likely crash, go in error.

- Before instantiation the camera may show Mono16. During connection Karabo but gets a fresh update and the field in the scene switches to Mono8.

 

Please don't apply Mono16 again.

Best wishes, Dennis

ELOG V3.1.4-7c3fd00