Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Joint Operation and Readiness Logbook, Contact: T.Haas, A. Violante, G. Wellenreuther, Page 1 of 30  Not logged in ELOG logo
Entry   XGM at XTD2 / issue with in-vacuum-resistor, posted by Tobias Haas on 26 Jan 2017, 17:02 
Post on behalf of Jan Grünert:

 
Entry   XGM resistor issue - analysis progress, posted by Jan Grünert on 01 Feb 2017, 17:42 
This is the current (w5) progress at DESY concerning the analysis of the serious XGM resistor issue (summary; a detailed report by DESY is available):

    The new “pulser test”  was verified at an operational XGMD at FLASH. The test method is (unfortuately) OK. This means that
the test results with issues from last week on all our XGMs are REAL.
    25% of all resistors in XBPMs affected, 0% of resistors in HAMPs affected,
Entry   Current Status, posted by Alessandro Silenzi on 12 Feb 2017, 14:02 Motors_Parameters.xlsx
 Vacuum loop:
- Interface between PLC and Karabo is not functioning.
The fault currently resides in the PLC behaviour, the self-description sent out is badly formatted (due to a buffer overrun)
Entry   Beckhoff loop status, posted by Alessandro Silenzi on 14 Feb 2017, 09:59 
2017.02.13 19:30 Status:
- Self-Description back in shape.
- Bad SelfDescription reproduced in BeckhoffSim (Karabo implemented PLC communication) and solved in BeckhoffCom (Karabo "PLC Client").
Entry   Karabo testing, posted by Andreas Koch on 08 Mar 2017, 16:08 
End switch testing: the in-position end switch stopped devices working, also stopped gateway connection. Stroke of motor is not correct, parameter list
to be checked. More details in "Improvements / bug list".
Entry   Big issue with XGM vacuum in both XTD2 and XTD9 !, posted by Jan Grünert on 11 Apr 2017, 15:24 

Both XGMs were and are on manual control (but the remote cables into the turbo pump controllers remained plugged in as usual) = both XGMs are "out
of the VAC loop". 

In XTD2, I saw around 13h that both turbos were off (0 Hz) and the pressure was at 10E-4 mbar !

The
green light above the ON-button was flickering. 
I switched parameter 023 (Motor TMP) to ON and restarted both pumps. The green light above the ON-button 
Entry   EtherCAT loop broken for Vacuum loop, posted by Alessandro Silenzi on 13 Apr 2017, 10:15 
The EtherCAT loop for the vacuum PLC is interrupted at crate 1.6 (XTD2).
This triggered all Beckhoff Terminals  default behaviour from this point on (i.e. Valves Closed, Digital Outputs low, etc.).
 
Entry   FAILED - Interlock test of the whole gas section in XTD9 - NOT SUCCESSFUL, posted by Raúl Villanueva-Guerrero on 21 Apr 2017, 12:28 
 Due to problems and lack of support of CAS for accessing the devices in XTD9 tunnel through KARABO we couldn´t run the test. The system has
been returned to manual operation and will remain like that until next notice.
 
    Reply   FAILED - Interlock test of the whole gas section in XTD9 - NOT SUCCESSFUL, posted by Raúl Villanueva-Guerrero on 21 Apr 2017, 13:23 


    
        
            Raúl Villanueva-Guerrero wrote:
        
        
           

             Due to problems and lack of support of CAS for accessing the devices in
    Reply   FAILED - Interlock test of the whole gas section in XTD9 - NOT SUCCESSFUL, posted by Raúl Villanueva-Guerrero on 21 Apr 2017, 13:35 


    
        
            Raúl Villanueva-Guerrero wrote:
        
        
           

            
            
Entry   Access to control PC, posted by Jan Tolkiehn on 21 Apr 2017, 13:54 
exflplcgwSA1 seems not reachable. This inhibits support for the PLC systems.
Entry   karaboGUI issues - during cycling of PLC loop (shutdown and restart) - effects on XGM XTD2 and XTD9, posted by Jan Grünert on 26 Apr 2017, 10:51 45.png49.png10.png

Problems described in detail below (this entire procedure takes way too much of our time, effectively still nearly 2 hours!):

Nerea/AE requested
yesterday afternoon to shutdown and restart the SASE1 VAC PLC loop once again. We start today morning (wednesday) at 8h30. 
8h30
karabo is not showing
status of all devices, see three screenshots (attached). karabo-GUI issue.
These devices have to be shutdown and reinstantiated to show a status and to
Entry   SA1-VAC loop down (only XTD9) and later restarted, posted by Jan Grünert on 26 Apr 2017, 18:34 
Since around 17h30 all XTD9 VAC loop is in error. It came back in karabo around 17h50. XTD2 not affected.
At that point, we had to reset every single karabo device of the XGM, then restart pumps etc.
Did the same also for the DPS upstream and downstream of XGM@XTD9.
Entry   XTD2 Differential Pumping completely OUT OF OPERATION!, posted by Raúl Villanueva-Guerrero on 27 Apr 2017, 07:04 
 Dear all,
 
I just checked the Karabo Scene for both XTD9 and XTD9, finding out the not-so-nice situation where all the valves and pumps were respectively
    Reply   XTD2 Differential Pumping completely OUT OF OPERATION!, posted by Raúl Villanueva-Guerrero on 27 Apr 2017, 07:11 


    
        
            Raúl Villanueva-Guerrero wrote:
        
        
           

             Dear all,
Entry   XGM scenes/devices offline - UHV pressures increasing - Please respond now !!, posted by Jan Grünert on 02 May 2017, 20:11 
All devices went into unknown state in the karabo XGM scenes in XTD2 and XTD9 at 19h52.
Pressures INCREASE since then (as measured/shown in DOOCS): 
XTD2:  2,5E-7mbar and rising
Entry   XTD9 vacuum now ok, but not in XTD2: turbos on XGM@XTD2 still in ERROR, posted by Jan Grünert on 02 May 2017, 22:27 
Wajid and Leonce from CAS have managed to get us the karabo controls back.
We have now put the XGM@XTD9 back into normal vacuum operation, and opened finally the vatterfly valves, this one is ok, and we checked also the
entire XTD9 gas section to be ok.
Entry   Slow loading in karabo GUI, posted by Jan Grünert on 04 May 2017, 19:40 
The current slow response times in the karabo GUI are the following (some measured times for reference):

- opening a project from the project manager : 45sec (just loading, not yet touching any device or scene)
Entry   karabo Beckhoff link not reestablished for SASE1 tunnel VAC loop, posted by Jan Grünert on 10 May 2017, 13:03 
Could somebody please re-establish the karabo controls of the SASE1 tunnel VAC loop (connection with Beckhoff server) ?
The karabo devices for XGM vacuum XTD2 and XTD9 are still all in UNKNOWN STATE.
We urgently would like to check the XGM vacuum status and restart the pumps before they are vented.
    Reply   karabo Beckhoff link not reestablished for SASE1 tunnel VAC loop, posted by Jan Grünert on 10 May 2017, 13:07 


    
        
            Jan Grünert wrote:
        
        
            
            Could somebody please re-establish the karabo controls of the SASE1 tunnel VAC loop (connection with
ELOG V3.1.4-7c3fd00