Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Joint Operation and Readiness Logbook, Contact: T.Haas, A. Violante, G. Wellenreuther, Page 14 of 29  Not logged in ELOG logo
New entries since:Thu Jan 1 01:00:00 1970
Entry   EPS loop, posted by NEREA JARDON on 07 Jul 2017, 13:24 

Dear all,

We need to update EPS SASE1 loop in order to finish the interlock communication for the experiments. I will do the update around 14h.

Thank you!

Entry   Karabo K-Mono-scenes, posted by Wolfgang Freund on 07 Jul 2017, 08:24 

I am working this morning on following projects:

SA1_KMONO_SYSTEM
SA1_XTD2_KMONO
SA1_XTD2_IMGSR
SA1_XTD2_FLT

Please don't save these projects !

Entry   Vacuum Loop, posted by NEREA JARDON on 06 Jul 2017, 12:49 

Dear all,

Sorry for the short notice, but we have to do an update of the Vacuum loop in order to get the neecssary interlock for the experiments done. I will contact know WP74 and Vacuum group so they can be awared about their equipments.

Thank you,

    Reply   Vacuum Loop, posted by NEREA JARDON on 06 Jul 2017, 15:03 

Vacuum Loop is running again.

Thank you!

NEREA JARDON wrote:

Dear all,

Sorry for the short notice, but we have to do an update of the Vacuum loop in order to get the neecssary interlock for the experiments done. I will contact know WP74 and Vacuum group so they can be awared about their equipments.

Thank you,

 

Entry   Tunnel access schedule updated, posted by Gerd Wellenreuther on 06 Jul 2017, 08:51 

Dear all,

access to XTD9 has been extended until the Friday the 14.7. 14:00. Tunnel access schedule has been updated:

TAS

Cheers, Gerd

Entry   Motion loop update, posted by NEREA JARDON on 05 Jul 2017, 17:48 

Dear all,

In order to finish the configuration of part of Hirex devices, we need to make an update of the Motion loop tomorrow morning at 10am. Please drive your devices to safe position before this hour.

Thank you

Entry   Motion loop, posted by NEREA JARDON on 04 Jul 2017, 10:12 

Dear all,

I have received a request from Konstantin Sukharnikov to break the Motion loop in XTD2 from Rack 1.5 in order to do checks in the CRLs. So you will loose communication with almost the whole Motion loop in SASE1. I will let you know when they are finished.

Thank you,

    Reply   Motion loop, posted by NEREA JARDON on 04 Jul 2017, 11:23 

We are finished. One encoder terminal has failed and needs replacing: rack 1.5 EC14

NEREA JARDON wrote:

Dear all,

I have received a request from Konstantin Sukharnikov to break the Motion loop in XTD2 from Rack 1.5 in order to do checks in the CRLs. So you will loose communication with almost the whole Motion loop in SASE1. I will let you know when they are finished.

Thank you,

 

       Reply   Motion loop, posted by NEREA JARDON on 04 Jul 2017, 11:47 

It will be replaced today around 1pm.Therefore Motion loop will be broken from this rack position.

NEREA JARDON wrote:

We are finished. One encoder terminal has failed and needs replacing: rack 1.5 EC14

NEREA JARDON wrote:

Dear all,

I have received a request from Konstantin Sukharnikov to break the Motion loop in XTD2 from Rack 1.5 in order to do checks in the CRLs. So you will loose communication with almost the whole Motion loop in SASE1. I will let you know when they are finished.

Thank you,

 

 

          Reply   Motion loop, posted by NEREA JARDON on 04 Jul 2017, 14:07 

The encoder terminal in rack 1.5 has been replaced.

NEREA JARDON wrote:

It will be replaced today around 1pm.Therefore Motion loop will be broken from this rack position.

NEREA JARDON wrote:

We are finished. One encoder terminal has failed and needs replacing: rack 1.5 EC14

NEREA JARDON wrote:

Dear all,

I have received a request from Konstantin Sukharnikov to break the Motion loop in XTD2 from Rack 1.5 in order to do checks in the CRLs. So you will loose communication with almost the whole Motion loop in SASE1. I will let you know when they are finished.

Thank you,

 

 

 

Entry   Motion loop, posted by NEREA JARDON on 04 Jul 2017, 09:41 

Dear all,

Today we are planning to integrate part of Hirex motors into the Motion loop of SASE1. Therefore, the loop will be break, so you will loose communication with whole XTD9 Motion part. I will back again to you when we are done,

Thank you

Entry   Karabo for SASE1 topic restarted, posted by Alessandro Silenzi on 03 Jul 2017, 20:53 07.png

Here attached the main SASE1 panel

Entry   control servers maintenance, posted by Janusz Szuba on 03 Jul 2017, 18:22 

All control servers, brokers, dl and finally gateway were updated and restarted.

Entry   Tunnel access schedule updated, posted by Gerd Wellenreuther on 03 Jul 2017, 16:03 

Dear all,

based on the information from todays BKR-meeting and communication with Harald Sinn, I updated the TAS: https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules

Basically, Harald is trying to keep XTD9 open until middle of next week, he still has to talk to DESY...

Cheers, Gerd

Entry   Motion loop update, posted by NEREA JARDON on 03 Jul 2017, 11:01 

Dear all,

We will be working in the Motion loop till this afternoon. So as I said in the morning meeting, I will let you know when we have finished.

Thank you

Entry   Status and Plans after 09:30 meeting, posted by Tobias Haas on 03 Jul 2017, 10:26 

General

  • Accelerator was down all weekend due to cold compressors that were damaged in conjunction with the power outage on Friday
  • Since 0700 all interlocks are broken and tunnels are open.
  • Tunnels except XTD9 stay open until Thurday.
  • XTD9 can remain open longer

Availability of Networks

  • Network mainentenance that was requested last Friday for Tuesday has to happen today together with the rest of the facility. It was scheduled for 0700 - 0900 and is already almost done
  • Following the network maintenance, N. Jardon will bring down the motion loop for KMONO integration. This only affects the tunnels and instruments can work during this time
  • After the work by N. Jardon, IT needs to replace kernels on server machines. This will result in KARABO being down until early afternoon
  • Afterwards CAS needs to bring back KARABO
  • All measures will be announced on this log book

Instruments

  • Implementation of vacuum interlock should be implemented this week. 
  • SPB requires several adjacent loops to be included. Some of them are not up or complete. Maybe a simplified version should be installed first
  • SPB requests loop 12 from AE. However this will take until mid July as it contains new motors (SMARAGD) that have not been tested so far

AE

  • Work is currently ongoing on preparing to connect instrument interlocks to the DESY MPS system
  • Work is also required to fix problems for the laser group that are most likely due to faulty wiring or a broken terminal

IT

  • The dual power supply for switches saved a lot of work for IT after the power cut on Friday
  • Unfortunately, the PLC CPUs in SASE1 are not on dual power. This should be upgraded as it is now also planned for SASE2/3.
  • Dual power should also be put for the uTCA systems
Entry   Network upgrade /information and problem, posted by Krzysztof Wrona on 03 Jul 2017, 10:13 

The upgrade of the switches is finished to the extend that it allows Advanced Electronic group to work on KMono (Nerea is informed)

However, during the upgrade of the network one switch got stuck and this is the switch in XTD2 tunnel. The IP network in the XTD2 tunnel is not reachable at the moment (Beckhoff loops are fine) and we are going top the tunnel soon.

 

 

Entry   Network and servers maintenance, posted by Janusz Szuba on 30 Jun 2017, 15:33 

As discussed offline with NOC, Monday schedule was already fixed and not movable to Tuesday. Therefore, the network maintenance will take place on Monday 7:00 - 9:00.

During that time, no stable network is guaranteed.

After the network maintenance, the foreseen update and restart of all control server will take place, which take approx. ~2 hours. The exceptions are sase1 control servers and plc gateways as well as data logger and brokers and probably most importantly, exflgateway. These will be done after the work in sase1 (KMONO integration) is finished.  

Entry   Status and plans after SASE1 Readiness Meeting, posted by Tobias Haas on 30 Jun 2017, 11:33 

Data Acquisition and Data Archiving

  • K. Wrona summarised the basic ingredients of the system.
  • All components are ready and tested individually
  • Integration in the instrument environment is needed and will be done first in the context of commissioning LPD in FXE starting from 5 July
  • DAQ and archiving for the tunnels was originally not foreseen but is being worked on now
  • The split up of the KARABO environment into several "Topics"  was done on purpose to allow development with minimal interference
  • The separate topics have to be re-integrated now
  • The sildes from Krzysztof can be found here

XTDs

  • KMONO integration should happen next week starting on Monday
  • The planned work on the network switches should only start on Tuesday as it interferes with KMONO integration

FXE

  • Topics to be worked on next:
    • Vacuum interlock integration
    • LPD integration
    • uTCA digitizer (was already working in Karabo 1.4.7)
    • Great Eyes Detector has a rate limitation that was not there before
  • Longer term topics
    • Gotthard detector

SPB

  • Loops 12 and 5 are prepared and uploaded but need to be commissioned now
  • Firware for loop 13 is needed next
  • Many motors seem to be getting 24V, but should be ruuning with 48V. What is wrong? This needs to be checked in the EPLAN and CRDs
  • Loops appear to be missing components

Detectors

  • LPD goes to FXE on 5 July. Integration work in the hutch starts immediately after
  • AGIPD then goes into the X-Ray test stand in HERA-S
  • Note that the DAQ infrastructure can only support one detector at full rate at a time. 
  • In principle this should not be an issue at 30 bunches but it requires the veto system to work which needs testing

Electronics

  • Work this week concentrated on preparing everying for deploying the instrument vacuum interlocks next week
  • The problem with wrong names in the PP laser was identified as a wiring issue in one crate 
  • Work also concentrates on timing and train builder to support detector integration from next week

 

 

Entry   Tunnel access schedule updated, posted by Gerd Wellenreuther on 27 Jun 2017, 10:26 

Dear all,

according to Dirk Nölle access to XTD4 during the shutdown will be extended until Thursday.

Link to Tunnel Access Schedule

Cheers, Gerd

Entry   Tunnel access schedule updated, posted by Gerd Wellenreuther on 26 Jun 2017, 15:52 

Dear all,

I tried to update the TAS to include the times for each XTD during the shutdown-week at the beginning of July. It is currently not entirely clear when XTD9 and XTD10 will be searched, and as always this is subject to change...

Link to Tunnel Access Schedule

Cheers, Gerd

Entry   Status and Plans after 09:30 meeting, posted by Tobias Haas on 26 Jun 2017, 10:57 

General:

  • ​Beam was brought to all SASE1 hutches on Friday. Beam was available to both instruments splitting it with M3 until Sunday morning. Afterwards SASE tuning was done and the beam should be back in the hutches some time today. Beam operation will continue this week with very low intensity. Split beam operation to both instruments.
  • Rules as follows:
    • Only one bunch and very low intensity (< 100uJ)
    • Mechanical manipulation on vacuum parts only when shutter and all-metal gate valve are closed
    • Shutter and gate valve closed when instrument people are not in attendance
  • CAS appears to be in a 2 day workshop from 9 - 5. This is a problem as some urgent work is needed. 

XTDs

  • No access for KMONO commissioning this week
  • All preparations that can be done for KMONO operation should be done however
  • M. Messerschmitt prepares interface for the FEL imager to DOOCS so that KMONO can be used for tuning

SPB

  • A list with essential components has been prepared
  • It appears that some of the previously brought up loops contain only vacuum components. This should be fixed
  • Loops 5 and 12 are needed most urgently now. 
  • 5 additional servers are needed from CAS

FXE

  • No remarks from FXE
Entry   Status and plans after SASE1 Readiness Meeting, posted by Tobias Haas on 23 Jun 2017, 11:11 

General

  • A low intensity beam is being put into the SASE1 intrument hutches in this order: SPB Optics, FXE Instrument, SPB Instrument
  • No special precautions outside the hutches are needed due to the low intensity. 
  • The work will most likely not finish today. If necessary ti will continue next week Monday
  • From now on, access to the SPB Optics, SPB Instrument and FXE Instrument hutches requires these three safety trainings
    • General Safety (AllgSi)
    • XFEL Safety (SiXfel)
    • General Radiation Safety (StraSchu)
  • Check with SRP if you are not sure about yout status

XTDs

  • W. Freund and the AE colleagues successfully tested their firmware on the the KMONO in HERA-s. This will be integrated in the motion loop and a controlled access will be requested on Tuesday to try this out in XTD2

FXE, SPB:

  • Working in the hall to bring the beam into the hutches

Laser:

  • 90% of the hardware is installed on the tables
  • Humidity in the laser hutch still varies wildly, even after the humidity in XHEXP1 is below 60%
  • Humidity variations translate into a pointing instability of the seed laser which cannot go into the amplifier
  • There is a discrepancy between KARABO names and motor terminal names that needs to be cleaned up

Detectors

  • Interlock tests on AGIPD were successfull
  • The train builder is integrated
  • LPD is about to finish the tests in the X-ray chamber
  • Afterward the KARABO version needs to be updated 
  • Transport ot FXE is scheduled for week 27

Electronics:

  • Getting SPB and FXE ready for today's beam exercise required quite some short term effort
    • Mahadi had to get the cameras ready
    • Bruno had to set up the trigger timing
  • Implementation of the interlock conditions were delayed for the exercise of bringing the beam in. This should happen immediately afterwards together with the connection to the MPS system which is currently not present
  • The remaining problems with vacuum in SPB and FXE were solved (Some had to do with hw problems and wrongly wired controllers)
  • Work continues on bringing up more SPB loops. Most recently loop 4 was brought up and the firmware for loop 7 is prepared for tests
  • Implementation of the interlock conditions were delayed for the exercise of bringing the beam in. This should happen immediately afterwards
  • The work on KMONO delays some of the instrument work

Software:

  • CAS is currently working with high priority together with ITDM to get the DAQ system and archiving up 
  • There was a dedicated SQUAD for this purpose
  • The functionality has already been tested successfully on the LPD detector.
  • The interface needs work to become usable
  • Tests of full scalabiity are still outstanding
  • The system needs to be deployed in the real environment
  • It is estimated that the remaining work should take ca 3 - 4 weeks

 

Entry   Schedule for first beam SASE1 hutches, posted by Tobias Haas on 22 Jun 2017, 15:15 

It was just decided to put a very low intensity beam into the SASE1 hutches starting tomorrow morning at 8 AM. Both instruments declared that they are ready to accept it. Due to the very low intensity no special measures need to be taken outside the hutches. SRP and D3 shall be in the experiment hall. Harald Sinn shall coordinate beam activities from the BKR. Please note that the TC and S1R meetings take place as announced.

ELOG V3.1.4-7c3fd00