Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Joint Operation and Readiness Logbook, Contact: T.Haas, A. Violante, G. Wellenreuther, Page 19 of 30  Not logged in ELOG logo
ID Date Author Location Severity Subject
  237   16 May 2017, 14:55 Hugo Silva SantosGeneralInformationCAS On-Call Duty Planning (Until 11/06)

 Dear All,

I would like to share the CAS OCD Planning until 11/06: https://goo.gl/LL6vO1

 

In this planning, we show the numbers that can be called in case of incidents. Unfortunately, we are still trying to have a single number for all phones.
 
PS: I am sorry for the google.docs document, but once we are keeping it in a collaborative way in CAS, share the link with all of you will guarantee that you can see the updated version.
 
Best,
Hugo
  236   16 May 2017, 13:50 NEREA JARDONXTD9InformationMotion loop

Dear all,

Due to local test needed in Rack 1.18 for the Motion loop, it will be interrupted only in Rack 1.18 XTD9 from now till tests finish. It will not affect any other part of the Motion loop.

Thank you.

  235   15 May 2017, 22:17 Thomas MichelatGeneralInformationOCD CAS

 Dear all,

The OCD number for tonight (15/05) for the CAS group is 98053.

thanks

  234   15 May 2017, 11:32 NEREA JARDONGeneralInformationOCD AE Group

Dear all,

The OCD AE numbers for the following days will be:

PLC support: 9-8040 / 0151-68822383

DAQ Electronics (incl. timing, MicroTCA) Support:  9-6941

 

If there are any change in the numbers, we will let you know.

Thank you.

  233   15 May 2017, 11:02 Tobias HaasGeneralInformationStatus and plans after 09:00 meeting in BKR

 Issues observed by PCT over the weekend (from H. Sinn entry in the PCT log)

- The interlock of the vacuum valves worked as expected. However, we had two times the gas section around the XGM tripping the beam, because the gate valves around the XGM were closing. The reason for these trips will be investigated (probably noise on one of the involved pressure gauges). In the future it would be good to change the Vacuum-to-MPS interlock such that V0 always closes, if any of the other gate vales closes. Then the accelerator permission would come automatically come back after the trip. However re-booting of the vacuum loop needs to be planned (trips the DESY beam permission and potentially shuts down the turbo pumps). 

- The SR Imager may loose steps when moving larger distances (speed too high?)

- Several general problems of Karabo were observed, which make live difficult: For example, the 'V0 closed' and 'B4C in' indication on our main screen may just lock, even when the state of the device is changing (was observed mostly on GUI server1). It means that the status displayed on a scene can be in general not be trusted. In many cases we observed that connecting freshly opened scenes to devices take unacceptably long times (many minutes or never).  The policy of saving projects and sub-projects leads to overwriting changes, if more people work on projects and projects stay open for longer time.  

- The fact that the PLC does actually not store values through a reboot causes many problems. It basically means that motor positions are lost (set to zero) at every reboot and can be only recovered, if homing or absolute encoders exist. Also that positions of motors cannot be reset to their theoretical values means that in practice the state before the PLC reboot cannot be recovered by resetting the values.

- The imagers, in particular the SR-imager, caused a lot of problems because they were often crashing and require advanced and complicated procedures to make them run again (e.g. setting after re-instantiating the imagers are lost and come up with wrong pre-sets). The SR-imager does auto-scaling on the intensity, also when this is disabled in the software. This make the imager only useful for qualitative studies (e.g. not for gain curve or flux measurements).

General

  • Parameters of motors get lost after reboot of the PLC
  • Setting trigger delays can currently only be done with special authorisation from DOOCS. 
  • Suggested solution from AE: Hardwire the correct defaults in the firmware
  • A better procedure is needed to communicate the parameters between hardware experts and AE
  • L. Samoylova suggests that CAS person on call contacts BKR once per day to establish contact and get an overall impression
  • The support of CAS during the weekend was greatly appreciated

Vacuum

  • No calls to experts over the weekend
  • Issue with the XGM vacuum (spurious triggers of the interlock) needs to be fixed 
  • Interlock logic should be changed so that V0 always closes if one of the gate valves closes

Imagers

  • SR Imager crashed frequently and was hard to bring back
  • Auto-scaling of SR-imager cannot be switched off. This needs fixing with high priority

XGM

  • Commissioning starts today
  • See above about vacuum issues

PLC

  • No calls over the weekend to the experts
  • Firmware for MC2 lib (TECHNOSOFT motors) is prepared and waiting for tests

Karabo

  • CAS was called a few times on the weekend
  • Running more than one camera at the same time appears  to cause crashes. Possibly network bandwidth is insufficient
  • A procedure can be set up to read out the motor parameters at a well defined point in time for storing them in the firmware 
  • Setting trigger delays should be made to work from Karabo

Work for next days

  • Karabo test with MC2 Lib in the lab. As soon as this is successful it will continue in XTD9. Will be done on the SPB attenuator as N. Gerassimova is not available for PBLM tests due to a beam time
  • Fix the Photonics camera driver so that auto-scaling can be turned off

 

 
  232   12 May 2017, 15:58 Valerii BondarGeneralInformationCAS OCD from today to Monday

Dear all,

CAS phone numbers for OCD:

Friday: Alessandro (98054),

Saturday: Valerii (98053),

Sunday: Gabriele (98060),

thank you.

  231   12 May 2017, 15:37 NEREA JARDONGeneralInformationOCD AE Group

Dear all,

The OCD numbers for this weekend and today will be:

PLC Support: 9-8040 / 0151-68822383

DAQ Electronics (incl. timing, MicroTCA) Support: 9-8041 / 0151-68822386

Thank you.

  230   12 May 2017, 13:59 Harald SinnGeneralInformationV0 open!

V0 is open now!

Janni opened this morning at 11:00 the V0 valve towards the accelerator vacuum.

We removed the B4C absorber in front of the valve and now the spontaneous radiation can enter the Schenefeld vacuum. 

The interlock conditions for Vacuum loop and EPS loops towards the DESY MPS were tested and they are now enabled. 

This means that rebooting SA1 VACUUM  or EPS loop will stop the beam during the reboot (therefore call 4500 before you do it).

 

IMG_4609.jpg 

  229   12 May 2017, 13:33 Tobias HaasGeneralInformationStatus and plans after SASE1 Readiness Meeting

Focus of meeting is on SASE1 Instruments, Laser and Detectors

SPB (B. Weinhausen)

  • All motors in the SPB tunnel loop have been commissioned except for one TECHNOSOFT motor where the updated driver was not yet available
  • Comment by P. Gessler:
    • The updated MC2 lib was deployed yesterday evening. Testing should be possible now
  • The second camera of the screen broke. Concern exists over possible overvoltage in the power that comes directly from the PLC
  • All encoders are working
  • The vacuum in the Optics hutch is closed
  • Info by A. Violante:
    • All cabling in D02/D03 is done
    • There are a few damaged connectors that prevent pushing in the modules. This should be fixed on Monday
    • Pins are swapped in one connector. Will be fixed locally
  • Comment by P. Gessler:
    • This week AE was busy with AGIPD and tunnels
    • Next week resources should be available to support start of commissioning loop 1 

FXE (A. Galler)

  • E2E tests are progressing 
  • A recent update of the Beckhoff firmware generated new problems with encoders
  • Info from T. Korsch:
    • The vacuum in the hutch is closed and has reached 5e-7 mb
    • There is a minor leak in one of the bellows
    • Compressed air is working to operate the gate valves
    • Vacuum gauges can be read out remotely
  • Attention should be paid to being able to read out detectors, e. g. diodes

Laser (D. Kane/M. Lederer)

  • Slides were provided in INDICO with a detailed account of the status. Only Key points are summarised here:
    • Hutch infrastructure is working in general and temperature stability is ok but laser group is lacking access to controlling the parameters, humidity is oscillating and smoke detectors are not connected
    • Pre-assembly of PP laser is 75% done
    • Beam delivery to instruments is on the list now
    • Synchronisation with optical system might not be available before October
    • Control are generally working and software has improved a lot but some stages cannot be controlled and Karabo appears still to have some resource leaks

Detectors (M. Kuster)

  • LPD is in E2E tests and AGIPD is still being integrated into the XFEL environment
  • This week it was possible to run the DAQ chain on LPD for the first time
  • All tests on LPD including data taking in the X-Ray chamber in HERA-S should be done by end June
  • Situation with AGIPD is more difficult as basic integration is still not complete

Discussion

  • Follow up on progress with instruments, laser and detectors will continue in S1R meeting from now on
  • The S1R dispatch meeting takes place on Mondays 09:00 in BKR and on Wednesday 09:30 in XHQ 
  • Groups that require help from AE and CAS and that need to coordinate with other activities should attend
Attachment 1: AttendanceS1R120517.pdf
AttendanceS1R120517.pdf AttendanceS1R120517.pdf AttendanceS1R120517.pdf AttendanceS1R120517.pdf
  228   12 May 2017, 13:19 Alessandro SilenziGeneralInformationNew Deployment of Karabo for the SASE1 control machines.

Alessandro Silenzi wrote:

Alessandro Silenzi wrote:

I will ramp down the system and bring it back up during the lunch break after installing the
tag 2.1.10.

To install a new version of Karabo use the script attached on your terminal

move your the karabo directory to a backup or remove it.

to backup:
$ mv ~/karabo ~/karabo.bkp
 

to remove:
$ rm -fr ~/karabo

then execute:
$ bash PATHTO/download.sh

 The system is up.

The users using virtual machines will encounter problems installing karabo 2.1.10 in the way that was described.
Further instructions will come later in the day

 for Users with a VM:
- use the download script
- Remove the karabo directory:
   $ rm -fr ~/karabo 
- then execute:
   $ bash PATHTO/download.sh

Sorry for the delayed instructions

 

  227   12 May 2017, 12:26 Monica ArestéGeneralInformationUpdate of Instrument component priority list

Find attached the Instrument Component priority list discussed this morning.

Regards,

Monica

Attachment 1: 170512_Instrument_Components-Priority-list.xlsx
  226   12 May 2017, 09:23 NEREA JARDONXTD9InformationMotion loop

Dear all,

Due to local test needed in Rack 1.18 for the Motion loop, the loop will be interrupted only in Rack 1.18 XTD9 from now till the people in the Tunnel finish the tests. It will not affect any other part of the Motion loop.

Thank you.

  225   12 May 2017, 08:21 Harald SinnGeneralInformationRestart vacuum loop now

 We are in the BRK and corrected the vacuum interlock condition.

We will restart the SA1 vacuum loop in a few minutes

 

  224   11 May 2017, 19:12 Jan GrünertGeneralInformationWP74 OCD contacts

Plan of WP74 OCD contacts for May.
Assignments are subject to change.

Initially availability is 10h-18h on the given days.
This might be adapted as well for later weeks.

Attachment 1: WP74-OCD-5-2017.xlsx
  223   11 May 2017, 18:26 Harald SinnXTD10InformationXTD10 not open on Monday

 Dear all, 

contrary to the rumor that I spread last Tuesday in the PBS meeting, the magnet tests in XTD2/4 will be NOT done coming Monday and therefore the XTD10 will be be NOT open. It is still the plan to have one access day in XTD10 per week in the future (Monday or Wednesday to be clarified with the magnet group), but this will start only later this month.

Best regards

Harald 

 

  222   11 May 2017, 16:41 NEREA JARDONGeneralInformationMotion loop

Dear all,

I will update the Motion loop to include the mc2 motors, it will be running again in few minutes.

Thank you!

  221   11 May 2017, 15:08 Alessandro SilenziGeneralInformationNew Deployment of Karabo for the SASE1 control machines.

Alessandro Silenzi wrote:

I will ramp down the system and bring it back up during the lunch break after installing the
tag 2.1.10.

To install a new version of Karabo use the script attached on your terminal

move your the karabo directory to a backup or remove it.

to backup:
$ mv ~/karabo ~/karabo.bkp
 

to remove:
$ rm -fr ~/karabo

then execute:
$ bash PATHTO/download.sh

 The system is up.

The users using virtual machines will encounter problems installing karabo 2.1.10 in the way that was described.
Further instructions will come later in the day

  220   11 May 2017, 12:43 Alessandro SilenziGeneralInformationNew Deployment of Karabo for the SASE1 control machines.

I will ramp down the system and bring it back up during the lunch break after installing the
tag 2.1.10.

To install a new version of Karabo use the script attached on your terminal

move your the karabo directory to a backup or remove it.

to backup:
$ mv ~/karabo ~/karabo.bkp
 

to remove:
$ rm -fr ~/karabo

then execute:
$ bash PATHTO/download.sh

Attachment 1: download.sh
#!/bin/bash

if [ -z ${outfilename} ]
then
    outfilename=.karabo.sh
fi
echo $outfilename
git clone https://xfel.redmine:K9Sss5CmWtQ_nbx3gyt2@git.xfel.eu/gitlab/Karabo/commissioning-guidelines .temp-commissioning --depth=1
cp -f .temp-commissioning/project_generation/install.sh .install.sh
rm -fr .temp-commissioning
. .install.sh
rm ${outfilename}
rm .install.sh
  219   10 May 2017, 18:52 Gero FluckeGeneralInformationCAS OCD

CAS on call service for the night:

Gero Flucke: 9-8053

 

 

 

  218   10 May 2017, 13:07 Jan GrünertXTD2Problemkarabo Beckhoff link not reestablished for SASE1 tunnel VAC loop

Jan Grünert wrote:

Could somebody please re-establish the karabo controls of the SASE1 tunnel VAC loop (connection with Beckhoff server) ?

The karabo devices for XGM vacuum XTD2 and XTD9 are still all in UNKNOWN STATE.

We urgently would like to check the XGM vacuum status and restart the pumps before they are vented.

Thanks,

Jan

 Jan,

We are working on it. 

ELOG V3.1.4-7c3fd00