Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Joint Operation and Readiness Logbook, Contact: T.Haas, A. Violante, G. Wellenreuther, Page 4 of 30  Not logged in ELOG logo
ID Date Authordown Location Severity Subject
  184   27 Apr 2017, 15:28 Tobias HaasGeneralInformationAccelerator plans for the next 5 days
27/04 Th A Beam operation to TLD 10 GeV, 1 bunches, 0.1 nC, 1 Hz; interlock 
set XTD2-XTD4
27/04 Th N Beam operation to TLD 10 GeV, 1 bunches, 0.1 nC, 1 Hz, EOD shift
28/04 Fr M Beam operation to T4D 10 GeV, 1 bunches, 0.1 nC, 1 Hz
28/04 Fr A Beam operation to T4D 10 GeV, 1 bunches, 0.1 nC, 1 Hz
28/04 Fr N Beam operation to T4D 10 GeV, 1 bunches, 0.1 nC, 1 Hz 
29/04 Sa M Beam operation to T4D 10 GeV, 1 bunches, 0.1 nC, 1 Hz
29/04 Sa A Beam operation to T4D 10 GeV, 1 bunches, 0.1 nC, 1 Hz
29/04 Sa N Beam operation to T4D 10 GeV, 1 bunches, 0.1 nC, 1 Hz
30/04 Su M Beam operation to T4D 10 GeV, 1 bunches, 0.1 nC, 1 Hz
30/04 Su A Beam operation to T4D 10 GeV, 1 bunches, 0.1 nC, 1 Hz
30/04 Su N Beam operation to T4D 10 GeV, 1 bunches, 0.1 nC, 1 Hz 
01/05 Mo M Beam operation to T4D 10 GeV, 1 bunches, 0.1 nC, 1 Hz
01/05 Mo A Beam operation to T4D 10 GeV, 1 bunches, 0.1 nC, 1 Hz
01/05 Mo N Beam operation to T4D 10 GeV, 1 bunches, 0.1 nC, 1 Hz
 
Access to TLD:  
  187   28 Apr 2017, 13:08 Tobias HaasGeneralInformationStatus and plans after SASE1 Readiness Meeting

 Tunnel Status (T. Haas):

  • Tunnels XTD2/4/10 were interlocked yesterday afternoon
  • Beam is already going through the T2 and T4 beam lines to T4D
  • XTD9 remains open until approximately 15 May

Vacuum (J. Eidam, R. Villanueva):

  • The interlock in the gas section was tested successfully in XTD9. The interlock does currently not include the gas injection. This still needs setting up and testing
  • Systematic testing of ion pumps and interlocks is ongoing in XTD9 but needs to continue next week
  • The system generally works reliably
  • However, there was an incident this week in which the gas sections in XTD2 and XTD9 went completely off. The reason is still not understood

Mirrors and PBLMs (H. Sinn):

  • All three mirrors in the SASE1 beam line in XTD2/9 are installed and pumped
  • N. Gerassimova installed PMTs in XTD2 yesterday and set up the cameras of the PBLMs
  • The problem with injected properties disappearing was identified on the Karabo side and fixed. The fix still needs to be deployed
  • The motors of the PBLMs are still not functioning completely. 
  • The read out rate of the cameras is ok (of the order of 10Hz or better)

Imagers (A. Koch):

  • Imagers in XTD2 and XTD9 are ready for beam
  • Work continues on improvements
  • Read out rate is ok, but the latency is sometimes high and needs to be unterstood

XGM (J. Grünert):

  • The gas on the XGM in XTD2 was changed at the request of K. Tiedtke from Ar to Ne
  • Tests were done with the remote control of the gas system. This is now fully functional
  • The HV/Vacuum interlock is not operational yet
  • Otherwise the XGM is ready accept beam. Next week software tests should be performed with the readout

FXE (A. Galler):

  • Currently commissioning loop 1. There is still a problem reading out encoders. It appears that this is a firmware issue. TF is working on this.

SPB (B Weinhausen):

  • Currently commissioning the SPB tunnel components. The encoders have the same problem as the one reported by FXE
  • I broken terminal required changing

PLC (T. Freyermuth):

  • CRL in XTD2 was integrated into the PLC motion loop yesterday during the access.
  • A first version of the EPS logic was agreed upon and implemented. Details to be discussed again with DESY next week

Karabo (A. Silenzi):

  • ITDM provided an additional control server
  • A redeployment of Karabo is necessary and will be done later today (users will need to re-connect afterwards) 
  • The problems previously observed with the GUI server have not re-occured. 

Plans for next week:

  • Consolidate vacuum in XTD2 so that V0 can be reliably opened when first beam should be transported
  • Finish work in XTD2, in particular PBLMs and instrument components
  • Finish systematic tests of ion pumps in XTD2
  • Deploy fix for Renishaw encoders in firmware

Other topics:

  • We continue the 09:30 meetings next week until further notice

 

 

  188   28 Apr 2017, 13:24 Tobias HaasGeneralInformationSmall correction to minutes posted just before

Note that plans for next week (points 2& 3) should refer to XTD9 and *NOT* XTD2

 Plans for next week:

  • Consolidate vacuum in XTD2 so that V0 can be reliably opened when first beam should be transported
  • Finish work in XTD9, in particular PBLMs and instrument components
  • Finish systematic tests of ion pumps in XTD9
  • Deploy fix for Renishaw encoders in firmware
  •  
  199   03 May 2017, 11:04 Tobias HaasGeneralInformationStatus after 0930 meeting

Tunnel Status: XTD2/4/10 closed. XTD9 open. Controlled Access to 2/4/10 possible upon request

 

Vacuum (M. Dommach):

  • Systematic tests of ion pumps in XTD9 concluded
  • Tests of DPS in XTD9 should happen today with R. Villanueva
  • Systematic tests of all interlock conditions in XTD9 should happen tomorrow

PBLMs (H. Sinn, P. Gessler):

  • Debugging session for the ELMO controller was successful. The problem was traced to details in the parameter settings
  • Proper setting of parameters is tricky and requires care and expert knowledge.
  • Proper parameters now need to be programmed into the firmware. Manual setting is also possible but not favored.
  • AE will set this up and deploy next week in order to maximise optimal use of resources (This week only one expert, TF, is here)

Imagers (A. Koch):

  • Imagers in XTD2 and XTD9 are ready for beam
  • It is important that images can be stored. This is not yet the case and will be required latest when PBS commissioning starts
  • AK will be away from tomorrow until next Thursday

XGM (J. Grünert):

  • Late yesterday, Karabo went into error triggering the interlock on the Vatterfly valves on both XGMs. Pressure is still low but slowly rising
  • If the condition cannot be resolved remotely a local intervention is necessary. This can possibly wait until the scheduled interrupt tomorrow
  • Today tests should occur with the DESY experts for gas injection
  • Tests are currently hindered by the Karabo problem. AS suspects that this may have to do with the redeployment of Karabo yesterday. He is now working with high pressure on solving the problem

FXE (A. Galler):

  • Currently commissioning loop 1. There is still a problem reading out encoders. It appears that this is a firmware issue. TF is working on this.

SPB (B Weinhausen):

  • Fixes were deployed in the firmware for the Reinshaw encoder problem (16/32 bit issue). Still one encoder is in error. TF points out that this is a different problem. He will investigate

PLC (P. Gessler, T. Freyermuth):

  • CRL in XTD2 was integrated into the PLC motion loop yesterday during the access.
  • Meeting today with DESY experts to finalise the EPS logic
  • Focus this week on SPB and AGIPD

Karabo (A. Silenzi):

  • Karabo (Components Beckhoff-Device and Beckhoff-Com) were re-deployed yesterday.
  • This maybe the origin of the problems observed in the evening 

Plans for today:

  • XGM work on gas injection
  • Bring back Karabo and clear XGM error codes
  • Perform systematic test of DPS in XTD9

Other topics:

  • No 09:30 meeting tomorrow due to access. 
  • Request should be made to break the interlock in XTD10 on maintenance days in order to allow continuation of installation work

 

  202   03 May 2017, 13:29 Tobias HaasGeneralInformation*IMPORTANT* Change of plans re Access tomorrow
Due the recent results from XFEL, the urgent maintenance is shiftet from Thursday 4th to Friday 
5th. On Thursday, there will be operation till 14:00, after 14:00 the machine will be 
switched to standby. All the work planned will shift accordingly by one day. No ZZ before 
Thursday 14:00. 
 
The machine will be shut down Friday moring 7:00. 
 
Interlock situation: The machine will stay in interlock, only the access to XTL from OSDORF will 
be brocken.  
 
XTL: Access from Osdorf 
- activation measurement XS1 XTL/rear part by D3 
- Leak search and repair in the TLD beamline by MVS 
- A20 work by MHF-p (Exchange of filament heating, work on phase shifter) 
- CS8 RF measurement on load (MHF-p) 
- Repair of wire scanner relais 
 
XTL: Access from Bahrenfeld 
- Exchange of filter in the BCM monitors by MKS 
- Repair of DCCT of a B2D quad 
- Change of AMC board in A8 by MSK 
 
XTD2: 
- ZZ for repair of a BPM system 
XTD10:  
ZZ for Photon Beamline Work 
 
 
All further work has to be agreed by the run or machine coordination. 
 
  203   03 May 2017, 13:38 Tobias HaasGeneralInformationAccelerator Schedule for the next days

 Author: Decking

Run Coordinators: W. Decking (93430), D. Sanzone

Tunnels XTIN, XTL, XTD2-4, XTD10 closed
Temporary access to XTL,XTD2-4, XTD10 possible on Wed, 4.5.
Next open access XTIN, XTL, XTD2-4, XTD10 on Wed, 10.05. 08-16

|01/05 Mo M |  Beam operation  to T4D 11 GeV, 1 bunches, 0.5 nC, 1 Hz
|01/05 Mo A | Beam operation  to T4D 11 GeV, 1 bunches, 0.5 nC, 1 Hz
|01/05 Mo N |  Beam operation  to T4D 11 GeV, 1 bunches, 0.5 nC, 1 Hz
|02/05 Tu M |  Beam operation  to T4D 11 GeV, 1 bunches, 0.5 nC, 1 Hz; establish 6, 8 GeV File
|02/05 Tu A |  Beam operation  to T4D 6 GeV, 1 bunches, 0.5 nC, 1 Hz
|02/05 Tu N |  Beam operation  to T4D 6.4 GeV, 1 bunches, 0.5 nC, 1 Hz
|03/05 We M |  Beam operation  to T4D 6.4 GeV, 1 bunches, 0.5 nC, 1 Hz; study beam optics
|03/05 We A |  Beam operation  to T4D 6.4 GeV, 1 bunches, 0.5 nC, 1 Hz
|03/05 We N |  Beam operation  to T4D 6.4 GeV, 1 bunches, 0.5 nC, 1 Hz 
|04/05 Th M |  Beam operation  to T4D 6.4 GeV, 1 bunches, 0.5 nC, 1 Hz
|04/05 Th A |  No beam operation, tunnels closed
|04/05 Th N |  No beam operation, tunnels closed
|05/05 Fr M |  No beam operation, Acces to TLD for leak search, Temporary access to T2-T4 possible
|05/05 Fr A |  No beam operation, Acces to TLD for leak search, Temporary access to T2-T4 possible
|05/05 Fr N |  No beam operation, tunnels closed
|06/05 Sa M |  No beam operation, tunnels closed
|06/05 Sa A |  No beam operation, tunnels closed
|06/05 Sa N |  No beam operation, tunnels closed
|07/05 Su M |  No beam operation, tunnels closed
|07/05 Su A |  No beam operation, tunnels closed
|07/05 Su N |  No beam operation, tunnels closed
|08/05 Mo M |  Beam operation  to T4D 11 GeV, 1 bunches, 0.5 nC, 10 Hz
|08/05 Mo A |  Beam operation  to T4D 11 GeV, 1 bunches, 0.5 nC, 10 Hz
|08/05 Mo N |  Beam operation  to T4D 11 GeV, 1 bunches, 0.5 nC, 10 Hz

  205   04 May 2017, 11:36 Tobias HaasGeneralInformationInfo from H. Sinn

 Hallo allerseits

 
der Beschleuniger wird heute um 13:00 Uhr abgeschaltet und erst wieder Montag 
angeschaltet. Ich hab Winni überredet, dass wir den XTD10 brechen können, damit ihr 
heute und  morgen im XTD10 Zugang habt. 
Allerdings solltet ihr nicht die Magnettür zum XSDU2 öffnen, weil dann auch der komplette XTD4 
aus dem Interlock fällt. 
Ich hab mit Michael Bieler verabredet, dass wir in der zweiten Maihälfte Absuchtraining für XFEL Leute 
machen können (bis ca. 10 Leute auf einmal wäre sinnvoll), damit wir in Zukunft dann XTD10 und XTD9 selber 
absuchen könnnen (Termin kommt noch). 
 
Grüße 
 
Harald 
 
  229   12 May 2017, 13:33 Tobias HaasGeneralInformationStatus and plans after SASE1 Readiness Meeting

Focus of meeting is on SASE1 Instruments, Laser and Detectors

SPB (B. Weinhausen)

  • All motors in the SPB tunnel loop have been commissioned except for one TECHNOSOFT motor where the updated driver was not yet available
  • Comment by P. Gessler:
    • The updated MC2 lib was deployed yesterday evening. Testing should be possible now
  • The second camera of the screen broke. Concern exists over possible overvoltage in the power that comes directly from the PLC
  • All encoders are working
  • The vacuum in the Optics hutch is closed
  • Info by A. Violante:
    • All cabling in D02/D03 is done
    • There are a few damaged connectors that prevent pushing in the modules. This should be fixed on Monday
    • Pins are swapped in one connector. Will be fixed locally
  • Comment by P. Gessler:
    • This week AE was busy with AGIPD and tunnels
    • Next week resources should be available to support start of commissioning loop 1 

FXE (A. Galler)

  • E2E tests are progressing 
  • A recent update of the Beckhoff firmware generated new problems with encoders
  • Info from T. Korsch:
    • The vacuum in the hutch is closed and has reached 5e-7 mb
    • There is a minor leak in one of the bellows
    • Compressed air is working to operate the gate valves
    • Vacuum gauges can be read out remotely
  • Attention should be paid to being able to read out detectors, e. g. diodes

Laser (D. Kane/M. Lederer)

  • Slides were provided in INDICO with a detailed account of the status. Only Key points are summarised here:
    • Hutch infrastructure is working in general and temperature stability is ok but laser group is lacking access to controlling the parameters, humidity is oscillating and smoke detectors are not connected
    • Pre-assembly of PP laser is 75% done
    • Beam delivery to instruments is on the list now
    • Synchronisation with optical system might not be available before October
    • Control are generally working and software has improved a lot but some stages cannot be controlled and Karabo appears still to have some resource leaks

Detectors (M. Kuster)

  • LPD is in E2E tests and AGIPD is still being integrated into the XFEL environment
  • This week it was possible to run the DAQ chain on LPD for the first time
  • All tests on LPD including data taking in the X-Ray chamber in HERA-S should be done by end June
  • Situation with AGIPD is more difficult as basic integration is still not complete

Discussion

  • Follow up on progress with instruments, laser and detectors will continue in S1R meeting from now on
  • The S1R dispatch meeting takes place on Mondays 09:00 in BKR and on Wednesday 09:30 in XHQ 
  • Groups that require help from AE and CAS and that need to coordinate with other activities should attend
Attachment 1: AttendanceS1R120517.pdf
AttendanceS1R120517.pdf AttendanceS1R120517.pdf AttendanceS1R120517.pdf AttendanceS1R120517.pdf
  233   15 May 2017, 11:02 Tobias HaasGeneralInformationStatus and plans after 09:00 meeting in BKR

 Issues observed by PCT over the weekend (from H. Sinn entry in the PCT log)

- The interlock of the vacuum valves worked as expected. However, we had two times the gas section around the XGM tripping the beam, because the gate valves around the XGM were closing. The reason for these trips will be investigated (probably noise on one of the involved pressure gauges). In the future it would be good to change the Vacuum-to-MPS interlock such that V0 always closes, if any of the other gate vales closes. Then the accelerator permission would come automatically come back after the trip. However re-booting of the vacuum loop needs to be planned (trips the DESY beam permission and potentially shuts down the turbo pumps). 

- The SR Imager may loose steps when moving larger distances (speed too high?)

- Several general problems of Karabo were observed, which make live difficult: For example, the 'V0 closed' and 'B4C in' indication on our main screen may just lock, even when the state of the device is changing (was observed mostly on GUI server1). It means that the status displayed on a scene can be in general not be trusted. In many cases we observed that connecting freshly opened scenes to devices take unacceptably long times (many minutes or never).  The policy of saving projects and sub-projects leads to overwriting changes, if more people work on projects and projects stay open for longer time.  

- The fact that the PLC does actually not store values through a reboot causes many problems. It basically means that motor positions are lost (set to zero) at every reboot and can be only recovered, if homing or absolute encoders exist. Also that positions of motors cannot be reset to their theoretical values means that in practice the state before the PLC reboot cannot be recovered by resetting the values.

- The imagers, in particular the SR-imager, caused a lot of problems because they were often crashing and require advanced and complicated procedures to make them run again (e.g. setting after re-instantiating the imagers are lost and come up with wrong pre-sets). The SR-imager does auto-scaling on the intensity, also when this is disabled in the software. This make the imager only useful for qualitative studies (e.g. not for gain curve or flux measurements).

General

  • Parameters of motors get lost after reboot of the PLC
  • Setting trigger delays can currently only be done with special authorisation from DOOCS. 
  • Suggested solution from AE: Hardwire the correct defaults in the firmware
  • A better procedure is needed to communicate the parameters between hardware experts and AE
  • L. Samoylova suggests that CAS person on call contacts BKR once per day to establish contact and get an overall impression
  • The support of CAS during the weekend was greatly appreciated

Vacuum

  • No calls to experts over the weekend
  • Issue with the XGM vacuum (spurious triggers of the interlock) needs to be fixed 
  • Interlock logic should be changed so that V0 always closes if one of the gate valves closes

Imagers

  • SR Imager crashed frequently and was hard to bring back
  • Auto-scaling of SR-imager cannot be switched off. This needs fixing with high priority

XGM

  • Commissioning starts today
  • See above about vacuum issues

PLC

  • No calls over the weekend to the experts
  • Firmware for MC2 lib (TECHNOSOFT motors) is prepared and waiting for tests

Karabo

  • CAS was called a few times on the weekend
  • Running more than one camera at the same time appears  to cause crashes. Possibly network bandwidth is insufficient
  • A procedure can be set up to read out the motor parameters at a well defined point in time for storing them in the firmware 
  • Setting trigger delays should be made to work from Karabo

Work for next days

  • Karabo test with MC2 Lib in the lab. As soon as this is successful it will continue in XTD9. Will be done on the SPB attenuator as N. Gerassimova is not available for PBLM tests due to a beam time
  • Fix the Photonics camera driver so that auto-scaling can be turned off

 

 
  240   17 May 2017, 08:52 Tobias HaasGeneralInformationReminder S1R Dispatch at 09:30 today in front of MCR (Mockup Control Room)
  241   17 May 2017, 11:55 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

 Interlock in XTD10 is broken today and tunnel is open until 15:00

General:

  • Unfortunately, info on access to XTD10 came too late for Vacuum group to organise the work in XTD10
  • Technical issues and coordination between AE/CAS and PCT/Instruments continues to happen via SASE1 Readiness Log

Vacuum:

  • Issue of spurious beam aborts due to short term vacuum spikes in XGM is solved (respective gauges taken out of interlock?)
  • Change to interlock logic was requested by H. Sinn: V0 always closes if one gate valve closes) The reason is that after V0 is closed the accelerator has beam permission and can continue
  • This logic will now be implemented in the next update by AE

Imagers:

  • Problems with several photonics cameras for data collection exist. The data transfer is sensitive to packet losses. Hence dedicated servers need to be set up to avoid loss of data.
  • ITDM has provided one additional server in balcony room. Eventually a dedicated server should be set up in the tunnel
  • Maybe the way the camera sends the data could also be optimised
  • Auto-scaling switch problem has not been tackled yet and is considered second priority after solving general readout problem

PLC:

  • Fix for MC2 lib for TECHNOSOFT motors is ready. Tests together with N. Gerassimova can start today after motion loop update 
  • SPB can perform a parallel test on the PSLITs
  • Motion loop and vacuum loop updates are scheduled for 12:00. 

KARABO:

  • A bug was found where device clients drop messages and hence the GUI looses the state of the device
  • There is a fix that needs to be deployed.  This should happen in parallel to the cycling of the loops between 12:00 and 14:00

Next Steps:

  • Cycling of vacuum and motion loop at 12:00. T. Freyermuth informs the Photon Commissioning team
  • Update of Karabo betweem 12:00 and 14:00
  • Tests of PBLM with updated MC2 lib today
  • Tests of PSLITS with updated MC2 lib by SPB

 

  251   19 May 2017, 11:30 Tobias HaasGeneralInformationStatus and plans after SASE1 Readiness Meeting

General (T. Haas)

  • Due to problems with interlock cabling the approval date with the TÜV on 1 June has been cancelled
  • The MB, SASE1 Instruments, AE, CAS  and PSPO met yesterday and agreed that in view of the schedule risks with technical commissioning the focus of the next weeks should be enabling both FXE and SPB/SFX to accept beam for doing radiation safety measurements no later then end of June.
  • SPB/SFX were asked to identify the minimum functionality for this goal. The respective components will be marked in the component priority list

FXE (A. Galler)

  • So far work has concentrated on motors
  • This week PSLITs and BIU2 successfully underwent E2E tests
  • JJ was back this week to fix some problems on patch panels
  • Johan spectrometer is back in the hutch

SPB (B. Weinhausen)

  • Work continued on the tunnel loops.
  • The power supply problem with photonics cameras has been solved by AE (Additional 12V terminals installed)
  • Triggers for the cameras are working
  • Valve between optics hutch and tunnel vacuum was opened for the first time
  • There is still the unsolved problem with the TECHNOSOFT motor.
  • Work will now move to the optics hutch.

Laser (T. Jezynski)

  • Alarm systems are (smoke, gas etc) are now connected
  • Big problems with AC systems. The effort with FM to stabilise the humidity now results in temperature swings of up to 2 degrees. The same problem also appears in the instrument laser hutches
  • AC problems lead to large instabilities of the laser
  • Alignment beam is now delivered to both instrument laser hutches
  • No new information was received on the topic of optical synchronisation

Detector (M. Kuster)

  • Management decided that LPD will be moved to FXE in June, in weeks 23/24 to allow further testing of AGIPD in HERA-S
  • Interlock test on AGIPD continue
  • CAS is working on integrating the DAQ of AGIPD. When this is done an update of Karabo is needed. This will not happen this week and hence not before S. Hauf is on holidays

Electronics (P. Gessler)

  • There is still some work for the tunnels:
  • For integration of MCP tests were done in the lab yesterday. One of the two axes is working, the other one not yet
  • Tests for PBLMs could not be done as there was no common window between on N. Gerassimova and M. Umar. Tests could be done by M. Umar if N. Gerassimova agrees. She is on holidays for two days next week
  • The interface of the vacuum loop and the EPS loop to the DESY MPS requires additional work for XTD9 in the next days
  • Work also continues on AGIPD for one more day
  • There are some absences due to sickness and holidays that also slow down the work

Karabo (A. Silenzi/B. Brockhauser)

  • There will be a swap of the GUI server today to allow debugging the issue that the device states are sometimes not properly shown. People will need to re-connect
  • Tests of TECHNOSOFT motor were successful. (Does not include encoder needed for SPB motor)
  • There is a fundamental problem with the Photonics camera used in the SR imager. It has a rolling shutter that does not allow to get well-timed, triggered images. The same issue might be persent for the HIREX camera
  • The KARABO/DOOCS driver has been re-established. This should allow to set time delays directly from Karabo again

Discussion/Next Steps

  • SPB should start with technical commissioning of OPTICS hutch
  • Instruments identify components needed for beam in the hutch for radiation safety measurements
  • AE finishes pending tunnel work and then focus on SPB/SFX and FXE
  • Displatch meetings on Monday and Wednesday at 09:30 in XHQ/MCR (*not at DESY*)
  260   22 May 2017, 13:31 Tobias HaasGeneralInformationStatus and Plans after 09:30 Meeting
General:
  • No break this week on Wednesday. (Wednesday breaks for XTD10 should start next week)
  • Possibility of ZZ access to XTDs on Tuesday from 0700 - 1500. Harald organises the access for vacuum and
    diagnostics. No ZZ without previous experience
  • Expect XTD9 to close next week.

XTDs:
- SR imager crashed several times on the weekend. D. Görries spent a lot of time investigating and found that
when the configuration of the camera is set to mono-8 it runs stably. This indicates that there is a network
bandwidth issue
- D. Görries also had to restart the KARABO server for the MCP. One motor was working but the other one had
hardware problem and requires an access to the tunnel
- Tests for ELMO motor on PBLMs this week by Mahadi and A. Silenzi. N. Gerassimova is on holidays but agreed to
the test
- A. Parenti would like to deploy SW with added debugging functionality for imagers

FXE
- A. Galler and W. Gawelda are not available this week
- D. Görries reports that there are still problems with controlling the vacuum, I. e. gauges, pumps, valves,
fast valve. Some are related to cabling problems that are currently being fixed
- A firmware upgrade is requested for the commissioning crate. Will be discussed in detail with AE

SPB
- Work by AE on AGIPD for this week was called off as detector consortium wants to work on the hardware
- AE will concentrate on commissioning loops 1&2 for the optics hutch
- Firmware for loops 1&2 needs to be first regenerated
- All cabling problems should be solved by tonight
- All crates can then be pushed in
- All cables should be done except for 4 or 5 in the instrument hutch

KARABO

- The bug that results in devices not updating in the GUI server still persists
- Users are requested to inform A. Silenzi as soon as they discover this behaviour

Plan for the next days
- Start with SPB optics hutch
- Update firmware of FXE commissioning crate
- Test ELmo motor in XTD9
  261   24 May 2017, 09:06 Tobias HaasGeneralInformationReminder: SASE1 Readiness Dispatch @ 0930 today

see you there 

  262   24 May 2017, 10:39 Tobias HaasGeneralInformationStatus after 0930 meeting

 General:

  • DESY will try to lase again at higher energies during the next days
  • XTD9 will searched an interlocked this afternoon at 1400 as PCT will try to transport photons as far as possible
  • Company Wille has started to work on the radiation interlocks in SASE1. New TÜV date on 20 June and rehearsal on 14 June
  • Instruments should be prepared that on these days

 

XTDs:

  • CAS (A. Parenti) is still working on the instability problem of the SR imager. For the moment the workaround with reduced resolution (mono-8) seems to acceptable
  • One (non-existing) pump needs to be removed from interlock conditions in XTD9. Otherwise interlock blocks one gate valve
  • Filter was taken off the pop-in in XTD2
  • Tests for PBLMs still need to be done in XTD9 when it re-opens next week

FXE:

  • Problems exist with vacuum controls. J. Tolkiehn is currently working on it
  • Firmware of commissioning crate was upgraded
  • Test of Johan Spectrometer was done with test crate
  • CRL test are next

SPB:

  • Still waiting for firmware for loops 1&2. AE is almost ready and will deploy today
  • All cables are ready for Optics hutch
  • AE is currently pushing in the crates

PLC:

  • DESY MPS claims that a cable from the interlock to an AE crate is still missing. 
  • AE got vital information from MPS just a few days ago and is still waiting for info from the laser interlocks

KARABO:

  • CAS is working on a version with bug fixes for stability. Will be deployed when appropriately test and when a break is available
  • X2 timer interface still has issues. A. Sienzi is working on it

ITDM:

  • An update of network switches is needed. This will be scheduled for next week. Details to be discussed during Monday 1500 BKR meeting

 

  265   29 May 2017, 16:30 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

 General

  • Photon tunnels are open until Wednesday afternoon due to the flooding on the weekend. 
  • The down time should be used to do important fixes/upgrades
  • XTD9 can stay open all week depending on the decision of the PCT
  • Photon commissioning successfully brought beam to the end of both the SPB and FXE beam lines

XTDs

  • Stability problem of SR imager is still being worked on by A. Parenti (CAS)
  • A new version of Karabo with many fixes is currently being tested and will be deployed once the test results appear satisfactory
  • Test of the PBLM motors still need to be done in XTD9. This requires an update of the motion loop that should be done today or tomorrow
  • There is also the need of an update of the vacuum loop. This should also be done during the down time

FXE

  • Problem still exist with vacuum controls. The problem appears to be understood and seems to be on the PLC side. FXE uses ion pumps with an analog output that does not interface with the alarm level settings.J. Tolkiehn is working on it
  • Work progresses on motor testing
  • FXE requests firmware for loop 7. But this work interferes with the priority on the vacuum.

SPB

  • Loop 1 is now fully available with all modules
  • Loop 2 is available with only the first module. The other modules are away for modification
  • Due to the flooding the connectors cannot be attached until cables have dried and have been re-tested

PLC

  • AE will work again on AGIPD this week. This limits resources for the instruments

KARABO

  • Problem with X2 timer interface is solved. But PCT apparently still uses the DOOCS interface.
  • Waiting for the go ahead to release the next KARABO version
  • Work progresses in parallel to intergrate DAQ into KARABO. This will be the next version after the bug-fix version

ITDM

  • The announced update of the network switches will be  done on Tuesday morning and will result in a 5 minute network interrupt

 

  274   31 May 2017, 11:05 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

 General

  • Photon tunnels will be searched starting at 1500 today and then closed. Machine will go back into regular operation this afternoon
  • XTD9 stays open until further notice
  • Flooding damaged several connectors in SPB Optics and FXE Instrument. 
  • Jovo will replace connectors that show optical damage and test all cables that were in the water. A list is being compiled by Adriano. Meeting held for this purpose today at 1330 in XTOB.

XTDs

  • Work continues on stability problem of SR imager 
  • 2 updates were done on motion loop since a bug was still found for the MC2 lib after the first update
  • 1 update was done for vacuum loop but another one needs to be done since there is still an issue with the NAGIOS system
  • Test with the PBLM is still outstanding and will be done today
  • The systems should be in a fully functional state again this afternoon!

FXE

  • Vacuum gate valves can be controlled now after some work by J. Tolkiehn. Ion pumps are not controlled yet
  • Next update of firmware should resolve the problem with ion pumps 
  • Cables for loops 4&5 were in the water and hence work on these components has to wait

SPB

  • Full E2E test was done for the PSLIT.
  • Further tests will have to wait for fixes to cables

PLC

  • AE works on AGIPD today and will go back to instruments tomorrow
  • An update to the EPS needs to be done at some point in the near future to implement the end switches of the screens
  • When cables are fixed and tested, all modules in the respective loop have to be pulled out as they are daisy-chained

KARABO

  • New system implemented for deploying new versions that allows quick switch and possible roll-back
  • Script system implemented that performs schema evolution for scenes. Hence, old scenes will be adapted to changes automatically. This is important for the many scenes developed by the PCT.
  • Deployment of next Karabo version with bug fixes to be done before machine restart this afternoon

 

 

  275   02 Jun 2017, 13:01 Tobias HaasGeneralInformationStatus and plans after SASE1 Readiness Meeting

General

  • Due to the water incident in the hall commissioning activities are somewhat delayed
  • Next week 2 technicians from Actemium/Jovo arrive and shall fix damaged connectors, disassemble a subset of connectors and test all cables
  • Detailed planning for the repair and testing will be made once Jovo is on site. But the work should go in this order: SPB Optics, FXE Instrument, SPB Instrument
  • A few cables are also affected in the tunnels but the Vacuum group can shorten the cables and reconfection them
  • Update of the motion loop in the tunnels should happen early on Tuesday
  • SRP should present the detailed plans for the radiation safety tests asap so a respective road map can be worked out
  • It was noted that the newly installed laser chicanes appear not to be radiation tight

XTDs

  • The bug that leads to the GUI not updating is annoying and has led to a loss of at least 2 h of beam time
  • One arm of the MCP got stuck since the end switch was not handled properly. For the moment this arm cannot be moved safely. The problem is understood but requires an update of the motion loop.
  • The update on Tuesday also contains code for HIREX, updates for PBLMs and imagers

FXE

  • Gate valves can be operated
  • Problems persist with ion pumps and pressure gauges
  • For radiation safety tests also the Fast Valve and the interlocks need to be working. This is not yet the case
  • JJ XRay is coming again next week. It is not currently clear how much they can do in view of the cable problems

SPB

  • The list of cables affected by the water were given to A. Violante
  • Testing activities should progress in parallel with cable testing if possible. This requires the respective module to remain in the crates. It needs to be clarified whether this is possible

Laser

  • The humidity in the hutch is still too high (>75%)
  • Humidity regulation is not ok and oscillates by +- 5%
  • The optical glue was found to be very sensitive to humidity and needs to be exchanged
  • A few connectors were damaged in the flood. They will be exchanged by AE

Detectors

  • AGIPD is currently open to fix problems with readout of temperature sensors and other controls
  • Next week the detector will be closed again and then PLC tests will be carried out
  • The modifications of the electronics took 1.5 weeks. Only 2 days were estimated
  • The LPD detector is currently already controlled with KARABO
  • DAQ is working and calibration runs with the internal source are being carried out
  • Next week the detector will be moved into the X-Ray chamber and calibrations with X-Rays will be done
  • 2-3 weeks from now LPD could move to FXE
  • Readiness of FXE needs to be checked as KARABO versions are currently not compatible

Electronics

  • FXE Loop 7 firmware is ready

Software

  • Working on a more systematic approach to upgrades and support. In this scheme a candidate version can be fully set up and switch from old and new and back can be done quickly
  • Working on a definitive list of supported devices in order to organise proper support

 

  279   07 Jun 2017, 11:43 Tobias HaasGeneralInformationStatus and plans after SASE1 Readiness Meeting

 General

  • Technicians from Actemium/JOWO arrived and found that a lot more connectors than originally estimated need to be replaced
  • Tests are finished in SPB Optics (40 connectors to be replaced) and continue now in FXE 
  • Replacing connectors starts tomorrow with 3 technicians and should take 45 minutes per connector 
  • There is an interference of connector replacement and tests of the interlock. This needs to be resolved.
  • Starting this week, new messages in the elog appear not to be sent to all registered users. (Info from J. Szuba: Some users intentionally or unintentionally un-subscribed)
  • WLAN access at the end of XTD9 is not very good and not sufficient for testing cameras, e. g. in PBLMs

XTDs

  • On the weekend the broker queue filled up. This was fixed using "extreme measures". This led to V0 closing and  BKR crew was not aware of the state of V0. It is the opinion of the experts that the BKR crew could have known but were not fully informed where to look
  • The motion loop was updated yesterday for PBLM tests. But the update was not complete and will be redone today before 12:00
  • PBLM tests with Mahadi and Natalia shall start after motion loop update
  • XTD9 will be closed on Thursday (not confirmed)
  • There has been a modification of the interlock conditions by RAUL for the gas section. This needs to be carefully checked.

FXE

  • Communication is now possible with the ion pump controllers but there is still an error message from the controller that cannot be interpreted. The manufacturer of the ion pumps (AGILENT) has been contacted
  • JJ XRay is here this week. They work on the patch boxes for the CRLs and the von Hamos Spectrometer
  • The LPD 2-tile system will be brought into the hutch today to test the controls
  • Commissioning on motors continues

SPB

  • Currently there is no working version of Karabo for SPB (Fixes were implemented that broke base functionality)
  • Loops 7 & 12 have not connectors affected by water and could be commissioned. AE was informed to provide firmware

Laser

  • The humidity in the hutch is down to 50%, but still oscillates
  • AE is fixing connectors with water problems
  • After PLC cycling the Beckhoff terminals loose the proper parameter set. This issue needs attention.

Software

  • Deployment of next KARABO version is postponed until the new version switching method is sufficiently tests. H. Sinn points out that this version (2.1.12) contains many urgent fixes and is needed asap.
  • The incident on the weekend showed again the need for the consolidated list of mandatory devices. This is being worked on 
  • The bug where the gui server looses track of the state of the system is still not fixed! If it occurs inform CAS immediately

 

  282   08 Jun 2017, 08:24 Tobias HaasGeneralInformationXTD10 open
 Author: limberg, tischhauser
due to the cryogenic failure we will open XTD10 from 9am for working.
at XTL and XTD2/4 ZZ is possible for repairs/work.
ELOG V3.1.4-7c3fd00