The Interlock conditions for these two components has been positively tested but not exhaustively done:

The triggering of both via the actuation on the Fast Valve----------------->DONE and OK

Their triggering via HV down of each of the 6 ion pumps------------------>Partially DONE and OK: Partially means that only one of the pumps randomly chosen has been deactivated. The agreement is that the other remaining 5 can be done later, also from the office since the correspondence between the devices and the physical components has been confirmed. 

Also, the individual actuation of both, Beam Stopper and V0 valve has been proof showing a consistent behaviour regarding the interlock definition.

Finally the XFEL Vacuum OK signal is available but AE is currently improving it. By the moment is not automatically sent to DESY, but instead it needs to be activated manually. According to AE feedback this should be corrected in the following days.

 The Fast Valve test has been positively tested. 

It has been consider that the signal on the EPS to open again, should be also available in the vacuum loop. Still this need to be further discussed.

 The interlock definition for complete isolation of the whole section based on high pressure signal has been successfully tested. 

DPS (Upstream and Downstream) are now fully "controlled" by Karabo.

XGM has been reported by J. Grünert that it will be re-integrated during the evening.

Still some problems to call the remote operation of the turbopumps from Karabo, but it doesn´t compromise any of the interlock definitions (only is troublesome if the one needs to work with the pump, for instance after the interlock has been triggered).

Dear all,

The EPS loop would be stopped, in order to correct some issues with the hardware in Rack 1.1 and Rack 1.5 in XTD2. We will upload it as soon as possible and I will post a new entry here when it is running again.

Thank you,

Both XGMs were and are on manual control (but the remote cables into the turbo pump controllers remained plugged in as usual) = both XGMs are "out of the VAC loop". 

In XTD2, I saw around 13h that both turbos were off (0 Hz) and the pressure was at 10E-4 mbar !

The green light above the ON-button was flickering. 
I switched parameter 023 (Motor TMP) to ON and restarted both pumps. The green light above the ON-button 
 stops flickering and goes steady green. 
 
---going to XTD9 
 
In XTD9, I saw that the upstream turbo was off (0 Hz) and the pressure was in the lower 10E-6mbar. 
The downstream turbo in XTD9 was still operating. 
Parameter 023 to ON, and restart pump. 
 
---going to XTD2 
 
Error codes 6, 6, 98, 2, 37 on one pump, error codes 6,6,6 on the other (XTD2).
I unplugged the REMOTE cables in XTD2 and XTD9 to avoid further trouble as long as we are on "manual". 
This info was also sent by email to the involved experts.

Please find in attachment the dowload bash script for the latest Karabo.

if your system has a "karabo" directory, this script will not overwrite it, but the update will fail.
In this case, remove or rename the karabo directory.

To use it:
1. download the script in a directory of your choice.

2. open a terminal and execute it with
   $ bash PATH_TO/download.sh

Where PATH_TO is the path where the download script was saved.

Dear all,

Sorry for disturbing again, I will do a small update to put one missing coupler in the hardware configuration in rack 1.18, the loop would be running again in few minutes.

Thank you!

Dear all,

Motion loop is running again with the last update (names for PSLIT and LVDT have been changed).

Thank you,

Tunnel Open.

Mirrors:

Status:

• Vacuum on M2 should be good enough to switch on ion pumps
• Surveying work going on 

Vacuum Loop:

Status:

• Several vacuum sections successfully tested in XTD9 yesterday
• Tests need to proceed in XTD2 today
• The protection switch on the ion pumps cannot be actuated remotely 
• Loop needs an update for the XGM
• XGM was in the vacuum interlock overnight. Will be taken out during the day but should be put back at the end of the day
• Interlock of High Voltage with vacuum in XGM not working yet
• V0 valve needs to be exercised in collaboration with DESY 

EPS Loop:

Status:

• The terminal exchanged for the FEL imager was not the broken one. Another terminal needs to be exchanged today
• The MCP needs to be moved out of the beam manually. This will be checked using the EPS switch. For this the EPS loop is needed

Motion Loop:

Status:

• An improved fix for the motors not stopping was deployed yesterday
• The loop needs to be reconfigured to replace the SRA motors 
• One broken motor was exchanged on the mirror chambers and needs to be tested

Imagers

Status:

• All motion tests in XTD2 done. Now continue in XTD9
• Photonics camera driver still not working but not critical for tunnel closure (there is also a workaround by the name of ebus player)
• EPS switch on FEL imager needs testing  after terminal replacement

Karabo:

Status:

• New version with TCP was deployed. Experience overnight is good

Tasks for today:

Note: Loop reconfiguration and updates of Karabo to be done in the morning. Testing can resume after lunch. Status updates should please be recorded in the log

• Reconfigure vacuum, motion loop (updates for XGM interlock, SRA motors)
• Replace broken terminal in EPS loop for FEL imager 
• Move MCP out of the beam manually and check using EPS
• Continue systematic test of the vacuum components (J. Eidam, V. Bondar)
• Test EPS switch on FEL imager after terminal exchange (A. Koch and W. Ehsan)
• Monitor stability and responsiveness of GUI Server and Log Servers (A. Silenzi)
• Set up monitoring of temperatures and pressures overnight (A. Silenzi)
• Test V0 and absorber

Tasks for tomorrow:

• Tunnels closed
• All loops should run stable
• No or only minimal interference with Karabo
• Continue tests from remote and check stability and robustness of systems

Other topics

• Tunnels open over the Easter weekend and also during the day on Tuesday 18 April
• There will be one more standup 09:30 meeting tomorrow (Wednesday)
• There will be a SASE Readiness Meeting at 09:00 on Thursday

Dear all,

Vacuum loop is up and running, we would wait till Raul check the interlock of the "OK" signal for the Vacuum and then, if everything is correct, we would put again the XGM controlled by the Vacuum PLC.

Thank you!

Dear all,

EPS and Motion loop have been updated to the last framework version with the last hotfixed. Vacuum loop would be done tomorrow in order to let the XGM work the hole night and part of the morning tomorrow.

Best Regards,

Dear cllougues,

we will run an update of the EPS-loop, in order to have a proper solution for the latest hotfix, as it was announced this morning in the standup meeting.

Cheers,

    Tobias

Dear all,

Right now both XGMs are into the loop and would be running. The loop must run continuously, in case you should do any work, just let me know in advanced.

Thank you,

The karabo services will be down for an upgrade for an hour.

The access will resume at 13:30.

Tunnel Open.

Mirrors:

Status:

• Both mirrors M1 & M2 installed
• Vacuum being closed in M2 today should be ready for ion pumps tomorrow
• Surveying work going on (see email by M. Schlösser below)

Vacuum Loop:

Status:

• Needs reconfig for XGM in XTD9
• Interlock tests on XGM in XTD2 should go on. 
• 2 Turbopumps still have a communication problem (J. Tolkiehn is working on this)
• 6 Ion pumps in XTD9 still have communication problems (list was given by AS to JE)
• Systematic testing according to the list by J. Eidam with V. Bondar starting this afternoon

EPS Loop:

Status:

• One terminal needs to be exchanged for FEL Imager 
• Description of EPS interlock still missing. It is planned to start with just one imager in for first beam commissioning
• One fiber connection from Balcony room to DESY still to be done by DESY. AFter this testing of communication should start

Motion Loop:

Status:

• Quick fix for motors not stopping was deployed on Friday. Now TF is working on a better fix to be deployed this evening

Imagers

Status:

• EPS switch on FEL imager should be checked after exchange of terminal
• Photonics camera driver still not working but not critical for tunnel closure
• Work should now concentrate on SR imager

Karabo:

Status:

• New version with TCP fix needs to be deployed. This should also be done to the local software run by users.

Tasks for today:

Note: Loop reconfiguration and updates of Karabo to be done in the morning. Testing can resume after lunch. Status updates should please be recorded in the log

• Reconfigure vacuum and motion loops (updates for XGM interlock, motors not stopping)
• Replace broken terminal in EPS loop for FEL imager 
• Continue test XGM interlocks (N. Jardon, M. Planas, T. Matsopoulos)
• Go through systematic test of the vacuum components (J. Eidam, V. Bondar)
• Continue tests with PBLM in the tunnels (M. Jidda)
• Test motion system of the imagers in the tunnels (A. Koch and W. Ehsan)
• Monitor stability and responsiveness of GUI Server and Log Servers (A. Silenzi)
• Set up monitoring of temperatures and pressures overnight (A. Silenzi)
• Test communication between XFEL and DESY MPS once fiber connection from Balcony rooms to MPS is available (B. Fernandes)

Tasks for tomorrow:

• Put XGM into the vacuum interlock
• Continues testing of all interlock conditions for the vacuum

Other topics

• Surveying is going on for mirror chambers M1 and M2 in XTD2
• We need a well defined startup configuration of PLC, Karabo, Parameters, List of devices (A. Silenzi)

Email by M. Schlösser re alignment

Hi Tobias, hi Markus, Hi Winni,

Tobias, we discussed briefly the schedule for the T9 and T10 beamlines for the next few days, when we met in the tunnel yesterday.

From what i understand it is impossible to finish T10 until April 11th from the alignment and vacuum side. And probably more important, this also holds true for T9. There is at least one major problem with the alignment of the mirror chambers of T9 in XTD2, which will need some additional days to solve.
From my understanding at least the T9 beamline should be closed and aligned before putting SASE1 in operation. While it will of course be possible to send electrons down to the XSDU2 dump, it will not be possible to send photons to the experimental hall with the current state of the beamline.

Since it is not possible to work in XTD10 while the SASE1 electron beamline is in operation, i would propose to also finish this beamline before SASE1 electron startup. Since there is major work to do in XTD10 to finish the beamline, there is no hope to  do the remaining work during maintenance days. Finishing the beamline would require a major shutdown of the SASE1 branch later.

Since there will be no alternative to send the beam to (e.g. SASE2) for the next year (?), it does not make sense to stop work in XTD10 now, just to continue later then, without any overall benefit for the machine.

Of course i don't have a complete overview of all the machine schedule, but from my point of view it would make more sense to finish work in the northern branch, at least to align all components and to close the vacuum system, even if that means some more weeks before the SASE1 startup.

cu
Markus

Dear all,

The Vacuum loop is running again, now with XGM XTD9 included. We will be testing interlocks in XGM XTD2, so could be needed another upload.

Thank you,

Dear all,

I will update the Vacuum loop in order to add the XGM XTD9 into it. It will be running in few minutes again.

Thank you.

 Confirmed from Karabo side.

Dear collogues,

all loops are up and running after deploying the hotfix.

Have a nice weekend,

    Tobias