Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Joint Operation and Readiness Logbook, Contact: T.Haas, A. Violante, G. Wellenreuther, Page 2 of 30  Not logged in ELOG logo
ID Date Author Location Severity Subjectdown
  181   27 Apr 2017, 07:11 Raúl Villanueva-GuerreroXTD2ProblemXTD2 Differential Pumping completely OUT OF OPERATION!

Raúl Villanueva-Guerrero wrote:

 Dear all,

 

I just checked the Karabo Scene for both XTD9 and XTD9, finding out the not-so-nice situation where all the valves and pumps were respectively closed and stopped. What really worries me is again the fact that these situations are happening without aparent reason. I´m right now trying to start the system remotely but obviously one needs again to access the tunnel for that is the only reason to actually be sure that everything is up an running normally again.

 

 

 UPDATE:

XTD2

The Upstream sector is back into operation.

The Downstream one is still out of order since the turbopumps are whether in error or in an unknown/un-instantiated status.

 

 

XTD9

Upstream sector is back to full operation

Downstream sector: only one of the turbos is running. The other one P11280T cannot be reset

 

Right now that is the only thing I can do.

 

  135   11 Apr 2017, 17:44 Raúl Villanueva-GuerreroXTD2FeedbackXTD2 Complete Gas Section (DPS-XGM-DPS) Isolation Interlock tested - SUCCESSFUL

 The interlock definition for complete isolation of the whole section based on high pressure signal has been successfully tested. 

DPS (Upstream and Downstream) are now fully "controlled" by Karabo.

XGM has been reported by J. Grünert that it will be re-integrated during the evening.

 

Still some problems to call the remote operation of the turbopumps from Karabo, but it doesn´t compromise any of the interlock definitions (only is troublesome if the one needs to work with the pump, for instance after the interlock has been triggered).

  282   08 Jun 2017, 08:24 Tobias HaasGeneralInformationXTD10 open
 Author: limberg, tischhauser
due to the cryogenic failure we will open XTD10 from 9am for working.
at XTL and XTD2/4 ZZ is possible for repairs/work.
  223   11 May 2017, 18:26 Harald SinnXTD10InformationXTD10 not open on Monday

 Dear all, 

contrary to the rumor that I spread last Tuesday in the PBS meeting, the magnet tests in XTD2/4 will be NOT done coming Monday and therefore the XTD10 will be be NOT open. It is still the plan to have one access day in XTD10 per week in the future (Monday or Wednesday to be clarified with the magnet group), but this will start only later this month.

Best regards

Harald 

 

  408   26 Oct 2017, 17:34 Tobias HaasXTD10InformationXTD10 closed and interlocked

The SASE3 tunnel XTD10 was searched by Janni and her team and interlocked about one hour ago.

It is now almost ready for first lasing in SASE3:

  • The vacuum is completely connected and closed from V0 all the way to the end
  • All valves, pumps and gauges are included in the PLC loop and can be controlled from Karabo
  • The gas attenuator section was completely tested and is also under PLC control. The turbos are isolated from the rest of the vacuum and put into a safe state
  • All three DPS's are operational, tested and included
  • All imagers are operational
  • The XGM vacuum is part of the general vacuum and controlled and monitored from KARABO
  • The interlocks of the DPSs were succesfully tested

In order to allow beam, it is estimated that one access with approximately 8h would be needed to sort out some remaining smaller issues

I would like to thank the entire team from Vacuum, Optics, Diagnostics, AE and CAS for the big effort and in particular C. Youngman for coordinating.

  283   08 Jun 2017, 08:24 Harald SinnGeneralInformationXTD10 and XTD9 tunnel opening and closings

Dear all, 

according to the DESY logbook XTD10 will be opened today again: See DESY logbook entry:

'due to the cryogenic failure we will open XTD10 from 9am for working.
at XTL and XTD2/4 ZZ is possible for repairs/work.'

I don't know hoe severe the cryo failure is, but otherwise the agreement is that XTD9 will be closed Friday morning around 9am.

(I assume that they may close Friday morning also XTD10 again).

Best regards

Harald  

 

  494   27 Mar 2018, 14:18 Jan GruenertGeneralInformationXTD1 open

Info from BKR:  the southern tunnels were opened, thus XTD1 can be accessed now.

  175   26 Apr 2017, 12:58 Adriano ViolanteGeneralInformationXSDU2 access

 The XSDU2  area will be open (as XTD2) tomorrow between 9 ans 12. To register the access, please send also in this case a mail to T.Haas.

  138   11 Apr 2017, 22:36 Jan GrünertXTD2InformationXGMs in loop

Both SASE1 XGMs (in XTD2 and XTD9) are now again in the Vacuum Control Loop, their vacuum being controlled by Beckhoff/karabo. This works fine.

Therefore: DO NOT FOOL AROUND WITH THE VACUUM LOOP !

Since we all cannot enter the tunnel XTD2 in the next two days, it's agreed that the Vacuum Loop is NOT going to be touched at all, since  we cannot intervene in the tunnel if something goes wrong.

  155   21 Apr 2017, 09:59 Jan GrünertGeneralInformationXGM status

XGM status 21.4.2017

During Easter break, the two XGMs in the control system (XTD2+9) had no issues.
XGM@XTD10 however had an issue: tuesday morning it was found that all pumps had stopped. The scroll pump showed an error. UPS apparently had excess load sunday evening 19h30 but couldn't send email (network error). Possibly vented with tunnel air up to 10mbar since that time. Investigation is ongoing.

Thursday enabled DOOCS pressure reading of XGM in XTD10, UPS rechecked

System surveillance on coming weekend: Jan and Theo 1 day

Other remarks:
- WP74 staff have received their dosimeters for ZZ access if required
- some automatic monitoring and info system is needed soon, e.g. karabo to NAGIOS connection

 

  197   02 May 2017, 20:11 Jan GrünertXTD2ProblemXGM scenes/devices offline - UHV pressures increasing - Please respond now !!

All devices went into unknown state in the karabo XGM scenes in XTD2 and XTD9 at 19h52.

Pressures INCREASE since then (as measured/shown in DOOCS):

XTD2:  2,5E-7mbar and rising

XTD9:  7,7E-7mbar and rising

Please respond now !! We are still in but want to go home !

  35   02 Feb 2017, 17:54 Jan GrünertGeneralInformationXGM resistors - progress w5

Presentation for SASE1readiness-Meeting

on XGM resistor issue progress (w5) and plan (w6)

Attachment 1: XGM-resistors.pptx
  31   01 Feb 2017, 17:42 Jan GrünertGeneralProblemXGM resistor issue - analysis progress

This is the current (w5) progress at DESY concerning the analysis of the serious XGM resistor issue (summary; a detailed report by DESY is available):

  • The new “pulser test” was verified at an operational XGMD at FLASH. The test method is (unfortuately) OK. This means that the test results with issues from last week on all our XGMs are REAL.
  • 25% of all resistors in XBPMs affected, 0% of resistors in HAMPs affected, no capacitors affected.
  • Since no HAMP resistors are damaged, damage by environmental conditions (venting, humidity etc.) can be excluded. The main differences to the affected resistors are the HV-conditioning and the experienced HV-values of the resistors (typically XBPM resisotors are tested up to 12kV, HAMP resistors each see much lower voltages).
  • An XGMD chamber at FLASH was tested-to-destruction-of-resistor by applying a large differential voltage (>3kV) between neighboring electrodes, e.g. on mesh_e and FC_e. These resistors (Caddock MS220) have a nominal voltage breakthrough rating of ~500V but never had issues. They are used in all our XGMs.
  • New, other resistors (Ohmite MOX-1N-13) with higher voltage breakthrough rating of 10kV were procured and arrived tuesday
  • The new resistors were built into the tested-to-destruction XGMD at FLASH, unit is now pumping, will be retested with applying pulsed HV (on both Caddoc and Ohmite resistors) when at suitable pressure.

Further plan (w5end + w6) concerning the XGM resistor issue:

  • If the new resistors survive the test, then next monday the XGM01 at HERA-S will be opened, the tested-defect resistors will be checked and replaced with the new resistors.
  • If all tests on XGM01 are then ok including an acceptable RGA, all other XGMs (XBPM chambers) will be opened and resistors exchanged. Even ok-tested resitors would be exchanged to avoid future unexpected failures. HAMP chamber resistors will not be exchanged (large number >20 of resistors, no failures).
  • If the RGA is not acceptable, the resistor Ohmite MOX-1N-16 is another alternative, but has increased delivery time.
  27   26 Jan 2017, 17:02 Tobias HaasXTD2ProblemXGM at XTD2 / issue with in-vacuum-resistor

Post on behalf of Jan Grünert:

 

during HV-tests on the installed XGMs, our DESY colleagues from Kai Tiedtkes team have found an issue with one of the electrodes / resistors inside one XGM vacuum chamber at XTD2.

 

Roughly, we know the following:

1)      If not repaired, we would lose at least the capability of monitoring shot-to-shot horizontal beam position at this XGM location. This is a lower-priority info.

2)      However, it’s not yet fully tested if other functionalities could be affected. In case the absolute calibrated intensity info is affected, then clearly we would have to repair.

3)      Since the cause of the resistor-irregularity is not understood, there is a risk to damage the other (operational) remaining resistors in the other chambers of the same XGM.

 

It is not yet fully clear 

a)      what is the cause for the irregular behavior (it concerns a resistor inside vacuum which dramatically changed its resistance, which apparently possibly might happen even during a correct dry-nitrogen venting),

b)      the entire consequences for operation with this XGM

c)       the effort/details of a potential repair (could include up to removing one of the four chambers off the girder out of the tunnel into a lab, certainly needs re-survey)

d)      if another XGM chamber is affected (so far tested 2 of 6).

 

The DESY colleagues are running various tests with us on the XGMs, also extending to all the other XGMs, to get answers to the above questions in order to allow a decision on “repair/not repair”. 

 

Since this concerns the internals of the high-prio XGM in XTD2, we could ask Kai Tiedtke to give us his brief 10min report and recommendation in the tomorrow SASE1Readiness Meeting. Should we request his presence / will you add him to the agenda ?

 

Best regards,

Jan

________________________________________

Dr. Jan Grünert

Group Leader X-ray Photon Diagnostics (WP74)

European XFEL GmbH

Holzkoppel 

  19   19 Dec 2016, 09:44 Frederike WittmaackGeneralInformationXGM Safe State Definition
as defined by Jan Grünert: available on Alfresco: XGM-safe-state.docx and available at N:\4all\intern\User data\wp74\Devices\11-1_XGMD\03 - Components\XGM-safe-state.docx
  78   16 Mar 2017, 13:34 Torben FalkGeneralFeedbackWiring status

Wiring status SASE 1:

Wiring progress:

  • Internal wiring of the XGM in XTD 9 is done.
  • Vacuum part wiring of the XGM in XTD 9 is done (ready for local Beckhoff test).
  • Gas Panel wiring of the XGM in XTD 9 is done.
  • Crate wiring (ADAM & Femto crate) of the XGM in XTD 9 is done.

Upcoming work XTD 2:

  • Serial connection from Beckhoff to TCP 350.
  • Change cold plug cables into halogenfree cables.

Upcoming work XTD 9:

  • INHIBIT connection Iseg HV crate.
  • Serial connection from MTCA to RVC 300.

Upcoming work XTD 10:

  • Vacuum part wiring of XGM.
  • Gas Panel wiring of XGM.
  • Internal wiring of XGM.
  • Installing ADAM & Femto crate.
  • Measure cable lengths for Imager and prepare cables.
  89   31 Mar 2017, 07:24 Liubov SamoylovaGeneralInformationWeb cameras in SASE1 tunnels
Attachment 1: TmpPhCom_CR_2017-03-31-1.pptx
  504   12 Apr 2018, 15:34 Adriano ViolanteGeneralInformationWater cooling mointenance by MKK done

Die Arbeiten an der Kühlwassersteuerung konnten innerhalb des genannten

Zeitraums abgeschlossen werden,

so dass die Kühlwasserversorgung nun schon einige Zeit wieder geregelt

läuft.

 

Großer Dank an alle Beteiligten, die den Ablauf der Abschaltung meines

Wissens auswirkungsfrei gestalten konnten.

Wir bitten über kurze Rückmeldungen zur Optimierung, sollten

Schwierigkeiten im Zusammenhang mit der Abschaltung entstanden sein.

 

Mit freundlichen Grüßen

Jörg Hanik

  36   02 Feb 2017, 18:29 Bernard BaranasicXTD2InformationWP74 components in XTD2 - electrical connections
Status of WP74 components testing and wiring this week:
 
On Monday we tested SR Imager and K-Mono:
- issue with motor connect pinouts was discovered and I wanted to correct pinout today, but K-Mono and SR imager motor connectors are Lemo with soldering pins, which make pin changing more difficult than crimp version...
- this is still not done (we can exchange all connectors to crimp version or temporary change pins on crate side).
 
This week done:
- connected SR imager EPS switch (on the imager - not yet in the crate)
- On XGM Gas Panel is installed new HUBA gauge, and I connected it to the crate (now everything from Gas Panel is connected to Beckhoff terminals in WP73_VAC crate - Rack 1.3).
- FEL imager - EPS switch is connected properly, but Digital Input terminal in WP73 EPS crate - Rack 1.5 is defect (doesn't work at all).
- I placed cable for EPS switches of MCP detector, but not placed in the Rack (Rack needs to be opened - Roxtec feedthrough is closed)
 
To be done:
- K-Mono - switch pins 1 and 2 on Motor connectors (Y-1, Y2 and X).
- SR imager - switch pins 1 and 2, and switch pins 7 and 8 on all Motor connectors.
- SR imager - EPS switch connect from WP74 crate to WP73_EPS crate (one cable inside crate).
- XGM vacuum to HV crate interlock (inhibit) is still not connected (I am waiting for Beckhoff terminal, but this connection was not tested yet).
- MCP detector - EPS switch cable needs to be laid inside Rack 1.7 (Rack needs to be opened - Roxtec feedthrough is closed).

- MCP detector - vacuum to HV crate interlock (inhibit) needs to be connected - Beckhoff crate is prepared - missing cable from MPOD to Beckhoff terminals.

  332   14 Jul 2017, 09:31 Jan GrünertGeneralInformationWP74 SASE1/3 readiness status and outlook

SASE1 / SASE3 readiness --- WP74

2017-07-14

SASE1: 

  • commissioning of Kmono started yesterday at 10h for some hours
  • Kmono will be used for undulator commissioning as soon as Kmono is commissioned itself, and machine is ready for this
  • Support to SASE tuning given to machine (ongoing)
  • Maybe today: support during SASE gain studies
  • During last week (service week) : GLT-Anbindung XTD2 established

SASE3:

  • During last week shutdown : 
    • progress on DP installation, XGM cabling almost done, much imager and timing cabling done
  • When XTD10 is closed (as now) we currently cannot do much because there is no PLC loop in SASE3.
  • Non-Beckhoff technical commissioning started (e.g. some progress on MPOD HV-power supply)
  • WP74 must do a lot of technical commissioning in XTD10. Our work is by far not done when all our vacuum screws are tightened. There are different WP74 components in XTD10 than in SASE1 (not just a simple copy). WP74 requires the Beckhoff loops for tech. commissioning.
  • Alignment of DP „islands“ to be done in next shutdown.
  • Planned for next shutdown: installation of PES in XTD10, finishing of cabling
ELOG V3.1.4-7c3fd00