Table updated with status of SPB/SFX devices at end of XTD9 in preparation for SASE1 readiness meeting on 03.02.17

Dear all,

on Monday, 27th in the morning we will start with preparation work for the mirror installation in XTD9.

The mirror chamber (VS10130) will be vented and opened. This will affect:

V10270G and V10280G: they will be closed and disconnected

P10410I and P10420I: C10902I will be switched to "local" mode and the HV of the pumps will be switched off.

The work will take at least until Friday, March 3rd.

Dear all,

on Monday, 27th in the morning we will start with preparation work for the mirror installation in XTD9.

The mirror chamber (VS10130) will be vented and opened. This will affect:

V10270G and V10280G: they will be closed and disconnected

P10410I and P10420I: C10902I will be switched to "local" mode and the HV of the pumps will be switched off.

The work will take at least until Friday, March 3rd.

Dear all,

Tomorrow morning, 08th of March at 09.30h. I will be in the tunnel doing interlock tests in the DPS-XTD9 with Raúl.

Therefore I will need the connection of the TCP_Client in the Vacuum loop (just to let know Karaboo people).

I will post again when the PLC is available for Karaboo.

Thank you!

The interlock test in XTD9-DPS has been done. The Vacuum PLC is again available for Karaboo.

The rack 1.18 in XTD9 is not operational at the moment because Nicola is working on it. Nerea, Tobias or others let me know when it is fully operational again. This avoids checking it in the tunnel. Alternatively, let me know if I can check remotely.

test finshed.

both stages were moved.

voltage value and position read out from encoder opposite in directionality

some strange limitation on the postiion range seen.

both stages are now at around the 0 position with few mm error.

XD to ask alio/nanoomotion on the matter

XD will provide few lines of comment

Dear all,

Today from 13:30h  Mahadi and Natalia will be doing local tests in the PBLM in Rack 1.14 of XTD9, therefore, if someone will be working in the following racks of XTD9, will loose connection to the Motion loop.

Thank you and best regards,

 Due to problems and lack of support of CAS for accessing the devices in XTD9 tunnel through KARABO we couldn´t run the test. The system has been returned to manual operation and will remain like that until next notice.

As soon we received the request we worked on that one.  After analysing the issue proper response was sent.

​​​----- Forwarded Message -----

​​​​From: "Wajid Ehsan" <wajid.ehsan@xfel.eu>

To: "Raul Villanueva" <raul.villanueva@xfel.eu>

Cc: "Alessandro Silenzi" <alessandro.silenzi@xfel.eu>, "Nerea Jardon" <nerea.jardon@xfel.eu>

Sent: Friday, 21 April, 2017 12:56:14

Subject: Re: Karabo problems in XTD9 - Urgent!

​​​​​Hi Rahul,

we checked all the devices that are in error. The issue is realted with hardware.

Error description is mentioned below:

0x1001 FlagCtrl Error flag from controller

Regards,

Wajid Ehsan 

Here is the list of devices that are in error:
 

SA1_XTD9_VAC/VALVE/V11090A  Error 3 -> valve stayed between open and closed for too long time (3s set on the valve) (the reset command is sent to the PLC and it cannot clear the error)
SA1_XTD9_VAC/VALVE/V11100A  Error 3 -> valve stayed between open and closed for too long time (3s set on the valve)
SA1_XTD9_VAC/VALVE/V11110A  Error 3 -> valve stayed between open and closed for too long time (3s set on the valve)
SA1_XTD9_VAC/TPUMP/P11220T Error 0x1001 -> err_FlagCtrl -> Error flag from controller (need manual reset on the controller) after reset error is now cleared.
SA1_XTD9_VAC/TPUMP/P11280T Error 0x1001 -> err_FlagCtrl -> Error flag from controller (need manual reset on the controller) after reset error is now cleared.
SA1_XTD9_VAC/VALVE/V11210G Error 0x10001 ->  _err_InterlockDevNotFound  -> Interlock device not found. (the valves depends from a SA1_XTD9_VAC/SWITCH/DP_XGM_DP_ERROR which does not exist. a SA1_XTD9_VAC/SWITCH/DP_XGM_DP_OK is present in the list though, likely a PLC configuration error).
SA1_XTD9_VAC/VALVE/V11220G Error 0x10001 -> _err_InterlockDevNotFound -> Interlock device not found.
 

For the last 2 errors, which are the only one that have a clear PLC problem, I created a bug report in the redmine project of AE.
https://in.xfel.eu/redmine/issues/16510

Cheers

Alessandro Silenzi

We have to disconnect the EPS crate in RACK 1.14 in order to check the interface to the MPS.

I will keep you updated

The EPS-loop is now complete again.

The interface from EPS to MPS is working now. One broken wire in the cable between EPS and MPS was found. We are using now other pairs for the signals "SA1_SYS_EPS2MPS/DCTRL/MODE1", "SA1_SYS_EPS2MPS/DCTRL/MODES" and "SA1_SYS_EPS2MPS/DCTRL/MODEM".

Cheers,

    Tobias

 After some minor issues, the first test has been done today and the interlock wasn´t triggered despite the conditions were met (also visible in Karabo).

This requires intervention and revision from AE

The next try-out should be done as soon as possible during this week.

Regards.

Raúl, Benoit and Valerii

Since around 17h30 all XTD9 VAC loop is in error. It came back in karabo around 17h50. XTD2 not affected.

At that point, we had to reset every single karabo device of the XGM, then restart pumps etc.

Did the same also for the DPS upstream and downstream of XGM@XTD9.

XGM vatterfly valves will be opened by me only when I see that no further errors occur.

Currently, all but one pumps were restarted, also in Rauls DPS, only one of these not

 Dear all,

Finally the tests were run with the expected results: Pressure thresholds for the 3 involved gauges were forced on the system and the interlock on the two gate valves that limit the whole gas section were automatically closed in every case. Also the release switch was tested and the valves were able to be normally operated again.

However the interlock definition also involves the closing of the so-called "shut-off" valve in the gas injection line at the XGM. Unfortunately its behaviour couldn´t be completely observed since the Karabo device is not fully implemented. On the other hand, J. Grünert reported that after the interlock was triggered the valve was shown as also "interlocked" (despite the actual status, open or closed was not clear). This situation may require a second test, combined for instance with the gas injection test to be run by WP74 in the upcoming date). 

In any case the final results were rather positive. (despite there still some permanent uncertainty about devices being reachable or not through Karabo, as it has been previously reported).

Thanks to everyone involved.

Raúl Villanueva on behalf of B. Rio, N. Jardon and V. Bondar.

Hi all,

due to ongoing tests with the PBLM motor drivers I have to set the Elmo drivers in PreOp mode.

That should not affect any other terminal in the loop.

Cheers,

    Tobias

XTD2: All gate valves are now OK (not interlocked) after re-instantiating and re-setting the XGM_DP_OK. 

The interlock errors of some valves in XTD9 are shown in the screen shots below (Janni and Valerii starting now in XTD9 to debug some more controllers)

 Dear all,

it seems that this morning was somehow a misunderstanding. The XTD9 Gas Section Interlock test was succesfully finished the last 26th of April (see e-log message nr. 179).

There´s no further activity planned for this system.

Regards.

r.

 Dear all,

during the test run today by our colleagues of WP74, the interlock condition inside the XGM module was met (small volume pressure burst up to 10-2 mbar range). Now we can see also the expected cut-off event of the gas injection (see attached pictured). It seems that the reason why there was any feedback from the respective shut-off valve was the solenoid actuator on the respective shut-off valve was set in manual mode.

This means that XTD9 Interlock for the whole gas section has been up and running as expected the whole time.

Best Regards.