Dear all,

the fast valves in XTD9 were causing some trouble. From time to time they collect some electrical noise what triggers the valve. The pressure reading on the valve controller then shows oscillations of up to 10^-5 mbar, while the pressure around the fast valve gauges in the beamline is in the 10^-9 mbar range.
To operate the beamline in the meantime I have opened and disabled both fast valves. 

This needs further investigation on the service day next wednesday.

Best regards,
Martin

 The Fast Valve test has been positively tested. 

It has been consider that the signal on the EPS to open again, should be also available in the vacuum loop. Still this need to be further discussed.

Hi everyone,

after talking with the responsabile people, here's the timetable for the Timing firmware/server update:

In the meantime, all of SASE1 and SASE3 machines have been updated (with exception of the MicroTCA in the SASE1 Balcony room) with no problems.

Dear all,
apparently the Emergency Power-Off at FXE was triggered at around 10:00 - 10:30 (my estimate). As far as I know power has been switched on again. BKR / PRC have been informed. More information will be provided by TS / Torsten Schön soon.

Edit: T. Schoen is on site and can be contacted under 0160 977 287 97

Regard, Gerd

Hi,

the FXE Mono's won't be available via Karabo from 15.30 onwards due to an update from CAS (karabo) and ITDM (server).

Best, Dennis

The LENS_3X limit switch (switched when driving towards the chamber center) is broken and must be replaced, hence further work is required on the next JJ visit 9/10 Jan (TBC)

The in vacuum components also need further work during the above visit. The lens that lost alignment during commissioning was also found to be more severley damaged than anticipated - the B4C guard is cracked and this deposited some fragments under the lens. All lens cassettes will be exchanged, rebuilt and realigned in Jan.

The patch panel has been removed for rework (to switch motor direction)

The Be lenses seem to be in exactly the same condition as 'new'

The FXE beamshutter key has been installed into the interlock system after satisfactory completion of the FXE Chicane and Radiation Protection Sticker Checklist. The FXE Experiment hutch is now ready to receive xfel beam as required by the FXE instrument group.

However, the bunch mode MUST be limited to 1 or 2 bunches until the new user chicane is tested with thirty bunches using the copper target. This can be done whenever the parameters can be practically put into place. The test will be similar to the hutch commissioning where once it has been confirmed that the beam is on target. I will take radiation measurements at the chicane. This is the only place where radiation measurements will be required. Please provide me as much notice as possible prior to the date and time that 30 bunches will be brought into the FXE Experiment hutch.

I have also place 3 additional area monitoring dosimeters in the FXE Experiment. One on the robot arm where the D3 pandora place holder is. One above the old user chicane on the D.05 side and one inside the new user chicane on the control room side.

 Due to problems and lack of support of CAS for accessing the devices in XTD9 tunnel through KARABO we couldn´t run the test. The system has been returned to manual operation and will remain like that until next notice.

As soon we received the request we worked on that one.  After analysing the issue proper response was sent.

​​​----- Forwarded Message -----

​​​​From: "Wajid Ehsan" <wajid.ehsan@xfel.eu>

To: "Raul Villanueva" <raul.villanueva@xfel.eu>

Cc: "Alessandro Silenzi" <alessandro.silenzi@xfel.eu>, "Nerea Jardon" <nerea.jardon@xfel.eu>

Sent: Friday, 21 April, 2017 12:56:14

Subject: Re: Karabo problems in XTD9 - Urgent!

​​​​​Hi Rahul,

we checked all the devices that are in error. The issue is realted with hardware.

Error description is mentioned below:

0x1001 FlagCtrl Error flag from controller

Regards,

Wajid Ehsan 

Here is the list of devices that are in error:
 

SA1_XTD9_VAC/VALVE/V11090A  Error 3 -> valve stayed between open and closed for too long time (3s set on the valve) (the reset command is sent to the PLC and it cannot clear the error)
SA1_XTD9_VAC/VALVE/V11100A  Error 3 -> valve stayed between open and closed for too long time (3s set on the valve)
SA1_XTD9_VAC/VALVE/V11110A  Error 3 -> valve stayed between open and closed for too long time (3s set on the valve)
SA1_XTD9_VAC/TPUMP/P11220T Error 0x1001 -> err_FlagCtrl -> Error flag from controller (need manual reset on the controller) after reset error is now cleared.
SA1_XTD9_VAC/TPUMP/P11280T Error 0x1001 -> err_FlagCtrl -> Error flag from controller (need manual reset on the controller) after reset error is now cleared.
SA1_XTD9_VAC/VALVE/V11210G Error 0x10001 ->  _err_InterlockDevNotFound  -> Interlock device not found. (the valves depends from a SA1_XTD9_VAC/SWITCH/DP_XGM_DP_ERROR which does not exist. a SA1_XTD9_VAC/SWITCH/DP_XGM_DP_OK is present in the list though, likely a PLC configuration error).
SA1_XTD9_VAC/VALVE/V11220G Error 0x10001 -> _err_InterlockDevNotFound -> Interlock device not found.
 

For the last 2 errors, which are the only one that have a clear PLC problem, I created a bug report in the redmine project of AE.
https://in.xfel.eu/redmine/issues/16510

Cheers

Alessandro Silenzi

Dear all,

I communicated today on the 13h meeting that the Trigger #16 was back to 10Hz; this is no longer the case, the trigger signal is back to 1Hz.

Event trigger #16 is now back to 10Hz and it will still that way.

The EtherCAT loop for the vacuum PLC is interrupted at crate 1.6 (XTD2).

This triggered all Beckhoff Terminals  default behaviour from this point on (i.e. Valves Closed, Digital Outputs low, etc.).

Due to some delay in the installation of some necessary cables, the emergency power off test foreseen for today 06.04. in the SPB experiment will not take place.

The details will be reported by Ulf Brueggmann today in the dispatch meeting at 13:00. The needed cabling should be done this week, so that the test in FXE planned for Monday, 16.04 CAN take place.

TS will confirm the FXE date and propose the nex date for SPB this Friday in the Readiness meeting.

Emergency power test will be performed at the following dates:

FXE - Mon. 16.04.

SPB - Tue. 17.04. 

Schedule

• 10:00 Power will go off in SASE1 - Only redundant power line will stay ON
• Reprogramming of the PLC of the Emergency power off system - Estimated 1.5 Hrs.
• Power ON again ==> Emergency OFF test will be carried out. (info from AE: AE PLCs will not go off. uTCA crates will be shut down before)
• About at 15:00 everything should be back to normal.

For technical questions contact T. Schoen and U. Brueggmann.

Dear all,

I was just informed by Ulf Brueggmann that the emergency power off test was successfully performed in FXE.

The  reality is now reflecting the planned logic, exeption being the power plugs in the experiment hutch. They do not go off. This is due to some missing cables. These will be installed in the next weeks and a new test will be planned for next shutdown.

The tests will continue tomorrow in SPB/SFX.

 Dear All,

Still in time, I would like to correct out schedule.

The scheduled previous agreed for this weekend/holiday was from 10:00 to 17:00. Therefore,

• Saturday 10:00 to 17:00 - Valerii - Phone: 95471
• Sunday 10:00 to 17:00 - Gabriele - Phone: 96894
• Monday 10:00 to 17:00 - Wajid - Phone: 95630

Best,

Hugo

Dear all, I will update EPS loop in order to integrate new hardware changes. I will post a new entry when the work is done.

Thank you!

Dear all, EPS loop is again up and running.

Thank you!

Dear all,

The EPS loop would be stopped, in order to correct some issues with the hardware in Rack 1.1 and Rack 1.5 in XTD2. We will upload it as soon as possible and I will post a new entry here when it is running again.

Thank you,