Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Joint Operation and Readiness Logbook, Contact: T.Haas, A. Violante, G. Wellenreuther, Page 5 of 30  Not logged in ELOG logo
ID Date Authordown Location Severity Subject
  296   21 Jun 2017, 10:21 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

XTDs:

  • DESY requests the KMONO to be commissioned since the K Values of the undulators appear not to be as accurately calibrated as originally advertised. Management decided to put KMONO at the top of the priority list for this reason. W. Freund should work together with Mahadi and Nerea on getting the two goniometer motors (ELMO controller) working. When software is ready a ZZ access should be requested
  • Latency of FEL imager is ~ 5s which is a problem for tuning and scans. M. Messerschmitt is looking into this. A. Silenzi was not aware of the problem up to now.

Radiation Safety Tests:

  • Radidation safety tests are scheduled for 26 - 28 June. Proposed order is SPB Optics, FXE instrument, SPB instrument. Detailed plans to be discussed in a dedicate meeting on Thursday and plans to be presented in the Friday TC meeting
  • Vacuum interlocks will not be implemented before the rad safety tests and vacuum will be operated completely in manual mode
  • Open topic: Can the instruments use the beam after the rad safety test are done and how is the procedure?
  • SRP needs to make precise statements about where people can/should be during the rad safety tests

FXE:

  • Ready for radiation safety tests.

SPB:

  • Tested motors in loop3
  • Tested valves in loops 2&3

Electronics:

  • Concentrating on getting KMONO going in the next days

Software:

  • No special topic
  298   22 Jun 2017, 15:15 Tobias HaasXTD2InformationSchedule for first beam SASE1 hutches

It was just decided to put a very low intensity beam into the SASE1 hutches starting tomorrow morning at 8 AM. Both instruments declared that they are ready to accept it. Due to the very low intensity no special measures need to be taken outside the hutches. SRP and D3 shall be in the experiment hall. Harald Sinn shall coordinate beam activities from the BKR. Please note that the TC and S1R meetings take place as announced.

  299   23 Jun 2017, 11:11 Tobias HaasGeneralInformationStatus and plans after SASE1 Readiness Meeting

General

  • A low intensity beam is being put into the SASE1 intrument hutches in this order: SPB Optics, FXE Instrument, SPB Instrument
  • No special precautions outside the hutches are needed due to the low intensity. 
  • The work will most likely not finish today. If necessary ti will continue next week Monday
  • From now on, access to the SPB Optics, SPB Instrument and FXE Instrument hutches requires these three safety trainings
    • General Safety (AllgSi)
    • XFEL Safety (SiXfel)
    • General Radiation Safety (StraSchu)
  • Check with SRP if you are not sure about yout status

XTDs

  • W. Freund and the AE colleagues successfully tested their firmware on the the KMONO in HERA-s. This will be integrated in the motion loop and a controlled access will be requested on Tuesday to try this out in XTD2

FXE, SPB:

  • Working in the hall to bring the beam into the hutches

Laser:

  • 90% of the hardware is installed on the tables
  • Humidity in the laser hutch still varies wildly, even after the humidity in XHEXP1 is below 60%
  • Humidity variations translate into a pointing instability of the seed laser which cannot go into the amplifier
  • There is a discrepancy between KARABO names and motor terminal names that needs to be cleaned up

Detectors

  • Interlock tests on AGIPD were successfull
  • The train builder is integrated
  • LPD is about to finish the tests in the X-ray chamber
  • Afterward the KARABO version needs to be updated 
  • Transport ot FXE is scheduled for week 27

Electronics:

  • Getting SPB and FXE ready for today's beam exercise required quite some short term effort
    • Mahadi had to get the cameras ready
    • Bruno had to set up the trigger timing
  • Implementation of the interlock conditions were delayed for the exercise of bringing the beam in. This should happen immediately afterwards together with the connection to the MPS system which is currently not present
  • The remaining problems with vacuum in SPB and FXE were solved (Some had to do with hw problems and wrongly wired controllers)
  • Work continues on bringing up more SPB loops. Most recently loop 4 was brought up and the firmware for loop 7 is prepared for tests
  • Implementation of the interlock conditions were delayed for the exercise of bringing the beam in. This should happen immediately afterwards
  • The work on KMONO delays some of the instrument work

Software:

  • CAS is currently working with high priority together with ITDM to get the DAQ system and archiving up 
  • There was a dedicated SQUAD for this purpose
  • The functionality has already been tested successfully on the LPD detector.
  • The interface needs work to become usable
  • Tests of full scalabiity are still outstanding
  • The system needs to be deployed in the real environment
  • It is estimated that the remaining work should take ca 3 - 4 weeks

 

  300   26 Jun 2017, 10:57 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

General:

  • ​Beam was brought to all SASE1 hutches on Friday. Beam was available to both instruments splitting it with M3 until Sunday morning. Afterwards SASE tuning was done and the beam should be back in the hutches some time today. Beam operation will continue this week with very low intensity. Split beam operation to both instruments.
  • Rules as follows:
    • Only one bunch and very low intensity (< 100uJ)
    • Mechanical manipulation on vacuum parts only when shutter and all-metal gate valve are closed
    • Shutter and gate valve closed when instrument people are not in attendance
  • CAS appears to be in a 2 day workshop from 9 - 5. This is a problem as some urgent work is needed. 

XTDs

  • No access for KMONO commissioning this week
  • All preparations that can be done for KMONO operation should be done however
  • M. Messerschmitt prepares interface for the FEL imager to DOOCS so that KMONO can be used for tuning

SPB

  • A list with essential components has been prepared
  • It appears that some of the previously brought up loops contain only vacuum components. This should be fixed
  • Loops 5 and 12 are needed most urgently now. 
  • 5 additional servers are needed from CAS

FXE

  • No remarks from FXE
  303   30 Jun 2017, 11:33 Tobias HaasGeneralInformationStatus and plans after SASE1 Readiness Meeting

Data Acquisition and Data Archiving

  • K. Wrona summarised the basic ingredients of the system.
  • All components are ready and tested individually
  • Integration in the instrument environment is needed and will be done first in the context of commissioning LPD in FXE starting from 5 July
  • DAQ and archiving for the tunnels was originally not foreseen but is being worked on now
  • The split up of the KARABO environment into several "Topics"  was done on purpose to allow development with minimal interference
  • The separate topics have to be re-integrated now
  • The sildes from Krzysztof can be found here

XTDs

  • KMONO integration should happen next week starting on Monday
  • The planned work on the network switches should only start on Tuesday as it interferes with KMONO integration

FXE

  • Topics to be worked on next:
    • Vacuum interlock integration
    • LPD integration
    • uTCA digitizer (was already working in Karabo 1.4.7)
    • Great Eyes Detector has a rate limitation that was not there before
  • Longer term topics
    • Gotthard detector

SPB

  • Loops 12 and 5 are prepared and uploaded but need to be commissioned now
  • Firware for loop 13 is needed next
  • Many motors seem to be getting 24V, but should be ruuning with 48V. What is wrong? This needs to be checked in the EPLAN and CRDs
  • Loops appear to be missing components

Detectors

  • LPD goes to FXE on 5 July. Integration work in the hutch starts immediately after
  • AGIPD then goes into the X-Ray test stand in HERA-S
  • Note that the DAQ infrastructure can only support one detector at full rate at a time. 
  • In principle this should not be an issue at 30 bunches but it requires the veto system to work which needs testing

Electronics

  • Work this week concentrated on preparing everying for deploying the instrument vacuum interlocks next week
  • The problem with wrong names in the PP laser was identified as a wiring issue in one crate 
  • Work also concentrates on timing and train builder to support detector integration from next week

 

 

  306   03 Jul 2017, 10:26 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

General

  • Accelerator was down all weekend due to cold compressors that were damaged in conjunction with the power outage on Friday
  • Since 0700 all interlocks are broken and tunnels are open.
  • Tunnels except XTD9 stay open until Thurday.
  • XTD9 can remain open longer

Availability of Networks

  • Network mainentenance that was requested last Friday for Tuesday has to happen today together with the rest of the facility. It was scheduled for 0700 - 0900 and is already almost done
  • Following the network maintenance, N. Jardon will bring down the motion loop for KMONO integration. This only affects the tunnels and instruments can work during this time
  • After the work by N. Jardon, IT needs to replace kernels on server machines. This will result in KARABO being down until early afternoon
  • Afterwards CAS needs to bring back KARABO
  • All measures will be announced on this log book

Instruments

  • Implementation of vacuum interlock should be implemented this week. 
  • SPB requires several adjacent loops to be included. Some of them are not up or complete. Maybe a simplified version should be installed first
  • SPB requests loop 12 from AE. However this will take until mid July as it contains new motors (SMARAGD) that have not been tested so far

AE

  • Work is currently ongoing on preparing to connect instrument interlocks to the DESY MPS system
  • Work is also required to fix problems for the laser group that are most likely due to faulty wiring or a broken terminal

IT

  • The dual power supply for switches saved a lot of work for IT after the power cut on Friday
  • Unfortunately, the PLC CPUs in SASE1 are not on dual power. This should be upgraded as it is now also planned for SASE2/3.
  • Dual power should also be put for the uTCA systems
  Draft   10 Jul 2017, 10:26 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting
  323   10 Jul 2017, 10:31 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

General

  • Interlock was set in the injector last Friday
  • All shifts were cancelled for the weekend
  • Startup today and interlocks set in XTD10
  • It is still the aim to have photons by Wednesday (info from XFEL runn coor at 10:30)
  • XTD9 remains open until Friday afternoon
  • Tests of the emergency off buttons by TS (Thorsten Schön/TS) need to be performed in the instrument hutches. This is currently scheduled for Wednesday and should be done this week but requires careful coordination in order not to break equipment and disrupt commissioning

XTDs

  • Progress on KMONO was unfortunately not reported as W. Freund was involved in tunnel search during the meeting. A. Koch shall ask W. Freund to put an update in the log book
  • A lot of work was done on XTD10 installations last week, e. g. cooling water connections, gas attenuator installation
  • Unfortunately, there is still a vacuum leak on top of the XSDU2 dump
  • Work shall continue during the next break week in August and during individual service day if the opportunity is given

 

SPB

  • Loops 5 & 12 are needed for the vacuum interlock. Hence cross-loop communication is needed. This requires additional testing
  • Loop 5 is deployed but misses 2 modules that are being modified
  • Loop 12 is not deployed and also requires that a few modules be modified
  • The goal is to get the interlock up during this week

FXE

  • The vacuum interlook will be deployed once the inter-loop communicationn has been tested in FXE
  • JJ worked all of last week to 
    • Fix a leak in a bellow
    • Exchange one pump controller
    • Rewire motors to conform to XFEL standards
    • Install diamond screens in the imagers
  • LPD was installed
  • There is still confusion about the CRL alignment: Are individual lenses misaligned or the whole stack? This information is needed to obtain the next security level clearance from D3

AE

  • AE will not attend the next meeting on Wednesday since there is a parallel event with MPS on the details of the interlock connections, in particular how to deal with the fast valves in the instrument hutches

CAS/ITDM

  • ITDM is currently working with highest priority on DAQ for LPD. Once this is integrated, DAQ for the tunnels will follow
  • Work on LPD DAQ is done in a separate KARABO "Topic" in order not to disrupt other work
  • There are ocnfusing statements of whether DAQ can deal with more than one topic per SASE in the long run...

Important topics for this week

  • Perform emergency off tests
  • Get LPD DAQ going
  • Integrate vacuum interlocks
  • Make KMONO available for SASE tuning
  326   12 Jul 2017, 10:45 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

XTDs

  • Mechanical operation of KMONO is prepared. Work is now ongoing on optimizing the scenes in KARABO
  • Data from the SR imager that is needed for scanning the undulator gaps needs to be available in DOOCS. This is prepared.
  • Once the machine can provide beam, one hour for KMONO first commissioning has already been agreed

SPB

  • Test of the Emergency Power Off should take place this afternoon. PLCs will be shut down and hence parameters have to be put badk
  • N. Jardon will put as much information as she can into the firmware do reduce the work of putting back the parameters
  • However, in FXE it was found that the Emergency Off buttons only act on the interlock and not on the electrical systems. The situation in SPB is probably similar
  • Work is ongoing on technical commissioning but there are still key components physically missing (e.g. CSS and Sample Environment)
  • Vacuum interlock is not yet implemented as it is still waiting for a number of components  in loops 12 and 5

FXE

  • JJ XRay worked last week and now the vacuum has to be re-established. Pump down should start soon but there was still one leak.
  • Vacuum interlock definition is ready and it will be implemented by AE today
  • LPD was installed. Currently 2 out of 4 super modules are installed. The other two should come early next week

DAQ

  • Cabling and preparations are ongoing
  • Tests should start early next week

AE

  • Currently working on changes in loop 12 for SPB

CAS

  • Currently working on bug fixes. Some of these bugs are probably responsible for the system not updating vacuum info for 30 minutes
  • Deployment should happen this or next week
  • There appears to be some confusion/communication issue as to what version of KARABO is installed where.
  • It needs to be ensured that the startup of the next photon commissioning period goes smoothly
  335   14 Jul 2017, 13:17 Tobias HaasGeneralInformationStatus and plans after SASE1/3 Readiness Meeting

General

  • From now on progress with the SASE3 tunnel will be monitored in this meeting

FXE (A. Galler)

  • Work is going on to be ready for the start of instrument commissioning of Sunday
  • Currently the LPD movement is being tested
  • Today the firmware for the vacuum interlock system is being deployed

SPB (M. Messerschmidt)

  • All inputs needed for the vacuum interlocks can now be read out
  • Karabo was migrated to version 2.1.12. This appears to have some fixes for reading out cameras, but the GUI becomes unusable after ca. 10 min. Hence the version had to be rolled back to 2.1.11. This generated a lot of extra work
  • The test of the emergency off system was done this week. In preparation the PLCs were shut down to avoid damage. Bringing the system back was a significant effort. This should be getting less as more and more parameters are migrated to the firmware
  • A partial test of the MPOD power supplies was done in preparation for the AGIPD commissioning. Unfortunately some Wiener power supplies still have an older firmware that appears to produce voltage spikes when ramping up. This could damage the detector. Hence a firmware upgrade is needed. But no Windows PC was available on the controls network. The respective card was dismounted and taken to the lab for upgrading by K.-E. Ballack

Tunnel Installations SASE3 (M. Dommach)

  • A lot of installation work was carried out during the service period last week
    • All Day 1 devices are in place
    • A lot of missing connections were made (water, pressurized air)
    • Calbing was done for the imagers
    • The Solid Attenuator was assembled
    • There are still two vacuum leaks, one of them is on top of the dump. This may have to wait for the next service period in August
  • Focus during the next service period in August:
    • Install missing connection pieces and bellows in order to close the entire vacuum
    • Start bringing up Beckhoff loops with support from AE
    • Bring up as many components as possible 
  • For the comments made by WP74/J. Grünert, see the respective log book entry today

Laser

  • After a number of fixes and adjustments the AC parameters (Humidity/Temperature) are now according to specs

LPD

  • LPD is now fully installed in FXE
  • Work on the DAQ system starts next week
  • Next step for AGIPD in HERA-S is to get the DAQ system working. After this the detector will be brought to SPB
  • K. Wrona would like to cross check the configuration in HERA-S before this happens

AE

  • Work focussed this week on getting the remaining SPB loops up, in particular loops 12 and 5
  • For loop 12 a number of modules had to be taken out, modified and brought back. This relates to the operation of so-called SMARAGD motors
  • Originally it was planned to test the vacuum interlock system in SPB first. This requires inter-loop communication and there are still unused loops in SPB
  • Due to the problems with loop 12, it was decided to do the tests in FXE.
  • The firmware for the FXE interlock should be deplyed today
  • A meeting was held with MPS to clarify the interface between XFEL and MPS sind the MPS system cannot distinguish between the branch beam lines. This can now be handled by logic inside the PLC
  • AE is preparing for the support of SASE3 during the next service period

CAS

  • For more details see the detailed slides presented by S. Brockhauser during the meeting
  338   19 Jul 2017, 10:11 Tobias HaasGeneralInformationStatus and Schedule after 09:30 meeting

General

  • The latency observed by SPB in the GUI client could be reproduced by CAS. Also a  potential reason was identified. As soon as this has been sufficiently tested it will be released
  • DAQ tests in FXE with LPD worked for the first time yesterday for 1/16 of the detector
  • FXE and SPB will show 1-2 slides about progress and ongoing work during the TC meeting on Friday morning

XTDs

  • Fast valve in XTD9 still has issues with noise and will probably need to remain disabled

FXE

  • Interlock for loop 1 was deployed. Still need to do loop 2. Work per loop requires ca. 3-4 h.

SPB

  • Firmware for the AGIPD hv power supply was updated. The spikes during ramping are gone
  • Next items to get going are the SMARAGD motors
  • Loop 7 needs to be brought back. Crate 51 has been fixed.
  • Work on in vacuum interlock in SPB will need to be carefully timed and coordinated after finishing FXE. Due to impending beam probably not before next week
  360   09 Aug 2017, 10:23 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

General

  • Main focus for Vacuum Group and AE next week will be to get as much done in XTD10/SASE3 as possible. Conflicts with activities in SASE1 need to be carefully monitored

SPB

  • SMARAGD motors are still not working even though one of them worked once. Mahadi/AE is focussing on this problem. It should be solved asap
  • Focus should be on loops 11 and 13. Loop 8 has lower priority at the moment. Loop 11 is urgently needed for the laser

  • A vacuum event occured last night. Currently some parts of the instrument vacuum are at 10-3 mbar.

Tunnels

  • There is an issue with disk quotas for storing camera images. This is due to the fact that the DAQ system is not implemented for the tunnel components and an interim solution is being used.
  • The focus of the DAQ activities is on AGIPD and LPD

DAQ Tests

  • Tests with LPD achieved recording 10000 trains. Performance is still limited when many images (>300) are being stored per train. 
  • Currently data is not yet stored on gpfs but recorded on disks locally
  361   11 Aug 2017, 10:07 Tobias HaasGeneralInformationStatus and plans after SASE1/3 Readiness Meeting

General

  • The focus of activities next week for the AE and vacuum groups is on getting as much done in XTD10 as possible. There is a conflict with the aim to bring AGIPD to SPB and start commissioning. A lot of preparatory work was done for the latter this week already. Nevertheless this conflict needs to be monitored carefully. There will be a daily stand up meeting at 11:30 in front of the MCR to monitor the ongoing work. The SASE1 displatch meetings on Monday and Wednesday at 09:30 are correspondingly cancelled

FXE

  • Philipp Lang reported on the status of the LPD commissioning. The detector is essentially ready to take data with 14 out of 16 super modules on the weekend. A few software issues remain but should not stop the activities.
  • FXE is working on commissioning their greateyes camera 
  • Loop 7 needed to be re-worked for the van Hamos spectrometer
  • Work is stil required for the Alio stage in the monochromater in XTD9. This will probably not be ready for first user operation.
  • During the shutdown week work will focus on getting the instrument laser hutch going with the Tangerine laser. After the XFEL beam is back, first pump-probe experiments should be possible
  • This afternoon radiation safety tests with 30 bunches and different materials shall take place

SPB

  • One SmarACT motor is now running. The problem was identified as a combination of a connection and a Karabo issue
  • The next step is to reconnect the remaining motors correctly and then all SmarACT motors should be operational (The firmware is set up for all)
  • Updates need to be done for loop 5 (AGIPD chiller) and loop 7 (interlock). Since this can only be done after 1500 once the sample chamber is vented, this work was postponed to Monday
  • SPB also provided an updated priority list to AE in order to fine tune the remaining work until user operation 

Detectors

  • Moving AGIPD will start early on Monday and the detector shall arrive in SPB around lunch time
  • Immediate works shall be mechanical, connection of vacuum, chillers, power and cooling. 
  • A. Sztuk points out that the integration plan from SPB is very optimistic

Tunnels

  • The goal of next week is to get the vacuum and the imagers into the PLC and eventually KARABO controls
  • Detailed schedule planning was unfortunately stopped yesterday due to the fire next door but will be done today
  • There is a scheduled power outage next week in the tunnels. Here is the respective email with information.
  • The problem with the fast valves in SASE1 (spurious trips of the interlock) has not re-occured after the controllers were exchanged. They have been sent to the manufacturer

Laser

  • Progress was set back last week due to un-announced work on the 11 C cooling circuit. This necessitated a re-alignment of the lasers
  • Otherwise commissioning work in SASE1 is progressing

Electronics

  • The points discussed are included with the affected groups

Software

  • The storage for images from the cameras in the tunnels was changed due to a disk space crisis. Currently 150TB are available. This should be enough for some time
  • CAS support for XTD10 work is need only after Thursday next week once the PLC work is done
  • Karabo 2.1.14 was released. Currently 2.1.13 is deployed.
  • Currently the data from LPD cannot be archived. Work on this topic was stopped yesterday due to the fire. Should happend today
  363   18 Aug 2017, 11:23 Tobias HaasGeneralInformationStatus and plans after SASE1/3 Readiness Meeting

Software:

  • CAS meets with SPB and FXE on a daily basis to fine tune progression towards user operation
  • A list of required deliverables for user operation has been agreed between CAS and SPB/FXE (see slide 5 in presentation by H. Santos attached to these minutes)
  • The list has been associated with Karabo releases and dates
  • These dates and respective progress needs to be monitored continuously as the schedule is very tight

SPB

  • AGIPD installation is progressing according to plan. 
  • Next steps are data taking and then the exchange of the detector modules by the consortium
  • SmarACT stages in the sample chamber started working yesterday but it is not understood why they are working now while they were not working before

FXE

  • Work continues on van Hamos integrations
  • Next step is integration with the Tangerine laser

Tunnel Installations

  • This week the focus was on SASE3 installation in XTD10
  • The vacuum group closed almost all gaps
  • A lot of cabling was completed
  • Local tests together with AE are being carried out on the vacuum components
  • MCP was delivered with too short bellows so this could not be connected
  • XGM is connected on one side only
  • The Diagnostics group brought PES into the tunnel
  • 5/10 imagers are operational. 2 more are almost done

Laser

  • Work is back on track after the cooling water incident 10 days ago
  • AC controls are ok but the air flow is too high for laser operation

Electronics

  • A lot of progress was made in the course of AGIPD integration in SPB (Chiller working, Gate Valve working. interlocks working and tested)
  • A smaller effort was done for FXE (Some support for LPD and re-integration of van Hamos)
  • Tests of the vacuum components in XTD10 are still ongoing and continue through Monday morning
  • A new email with associated ticketing has been set up: ae-support@xfel.eu

 

Attachment 1: Readiness.pdf
Readiness.pdf Readiness.pdf Readiness.pdf Readiness.pdf Readiness.pdf Readiness.pdf Readiness.pdf
  365   21 Aug 2017, 16:26 Tobias HaasGeneralInformationStatus and Schedule after 09:30 meeting

General

  • Access to tunnel XTD10 ends today around midday and beam is expected back for the instruments on Thursday

SPB

  • Good progress was made over the weekend with AGIPD. On Saturday first dark images were recorded
  • Today the detector hybrids are being exchanged (1.0 -> 1.1)
  • The injector motion system was taken into operation
  • The SmarACT stages can currently not be tested since some parts are disassembled for final AGIPD installation

FXE

  • Some loose ends were tied up for LPD
  • JJXray was here last week and did some more installations, e. g. I0 monitors and alignment of the sample stack
  • This week Gotthard integration will proceed

Tunnels

  • The vacuum loop is now running for XTD10 with the full design firmware
  • Approximately 40 ion pumps were locally test and are no under PLC control
  • Almost all valves were locally tested and are also under PLC control
  • XGM is connected to its own PLC currently (integrating Vacuum and gas supply)

CAS

  • A disucssion on the details of Gotthard integration will happen with FXE after this meeting
  369   23 Aug 2017, 10:20 Tobias HaasGeneralInformationStatus and Schedule after 09:30 meeting

CAS

  • Finishing tests for KARABO 2.1.15. Deployment should start today during the middle of the day for SPB
  • SPB asks for additional slow data to be included in the DAQ. This requires tests after 2.1.15 is deployed
  • For the moment 2.1.15 will only be deployed for SPB. Once it is installed on all control servers, switch from 2.1.13 can take place
  • The switch can be reversed in case of problems
  • AGIPD control server will remain on current software version for the moment

FXE

  • FXE was unfortunately not represented
  • AE needs to perform updates on loops 9 and 7 

Tunnels

  • Beam should be coming back today
  • XTD9 will be searched today at 1400
  • In XTD10 7/10 imagers were succefully tested and integrated. The rest will have to be done in October

AE

  • Need to test one motor for SPB/CSS
  • Yesterday 4 encoders in SPB were fixed but one additional problem was identified with the microscope stage in the sample chamber`
  • N. Jardon needs to do further updates of PLC loops for SPB. This will be done after KARABO has been upgraded, probably tomorrow

CAS

  • KARABO 2.1.15 should contain crucial fixes to associate data from tunnel devices with detector images
  • Initially this will be possible train-by-train
  • Pulse-by-pulse association, e. g. as needed for XGM, will require further work
  370   25 Aug 2017, 13:42 Tobias HaasGeneralInformationStatus and plans after SASE1/3 Readiness Meeting

General

  • T. Haas conveys the congratulations of the management
    • for the achievements in installing and commissioning the AGIPD in SPB
    • for the progress made with installations in XTD10/SASE3
  • There will be a meeting next week in order to determine whether we are ready for "Early User Experiments" in SASE1.  
  • A discussion on what needs to be prepared for this meeting followed with the following conclusions
    • The term "Early User Experiments" needs further qualification in order to establish a well defined scope
    • Instruments and support groups (SPB, FXE, AE, CAS, ITDM, Detectors) should prepare a table with their list of deliverables and the corresponding status, following the model presented by CAS in the talk by H. Santos last week
    • In the wake of the meeting it needs to be communicated to the first scheduled groups what boundary conditions they will most likely encounter

FXE

  • The optical signal for laser synchronisation is still missing and not likely to arrive before next week
  • Hence a pump-probe experiment cannot happen before the scheduled "Readiness Meeting" as there will also be no beam on Tuesday and Wednesday
  • It will be difficult to answer the question whether a pump-probe experiment is possible
  • JJ was here this week and installed the intensity monitor

SPB

  • Big gate valve between AGIPD and sample chamber was opened for the first time 10 mins ago
  • The liquid jet is running and the differential pumping is working so that proper vacuuum can be maintained
  • Issues remain with the SmarACT stages. Resets are needed at short invervals
  • Availability of "slow" data in the DAQ chain remains the hot topic

Tunnel Installations

  • Work in XTD10 continued through Monday morning
  • Ion pumps and valves are now connected to the PLC. 
  • KARABO control has to wait for CAS resources

Laser

  • Issues remain with AC system.
  • The flow rates are way to high and it appears that the system was designed for much higher flows than needed
  • Weiss Klimatechnik is coming on Monday for a discussion
  • Otherwise, installation proceeds and is still on track for laser beam delivery in October

Detectors

  • A lot of progress was made with the detectors
  • However, time is still needed to take calibration data. This is estimated as one day without beam per detector
  • A reduced rates both detectors can run in parallel for tests. This is not possible for the calibration

Electronics

  • The encoder bug reported on Wednesday was found and consequently all loops were updated
  • Currently work continues on the SPB SmarACT stages
  • The interface to the MPS system still needs to be set up. This requires an interrupt and testing

CAS

  • Several unexpected issues were found in the most recent KARABO release, e. g. there are problems with the time server that still prevent DAQ integration of the slow data
  • This takes a lot of additional time
  • A plan review has now been agreed with both instruments once per week
  • A survey was made on the need for specific DOOCS devices
  373   01 Sep 2017, 10:34 Tobias HaasGeneralInformationStatus and plans after SASE1/3 Readiness Meeting

General:

  • The length of the shut down in October is still under discussion. Currently it appears that it is shortenend to 8 working days
  • The management reviewed the readiness of the instruments for first users on 14 September:
    • Very good progress was made over the last weeks
    • Data was taken with both large pixel detectors
    • A few "red lights" remain
    • In spite of the remaining difficulties, the first users will be invited
    • However, the Management shall inform the first users that they will get another beam time in March in case the experiment objectives cannot be reached
  • The second  call for proposal will only cover 5 weeks in May/June
  • The third call will start on 6 September for all 6 instruments

FXE

  • van Hamos was aligned for the Cu K_\beta line (required for the 3rd exp)
  • XRay emission was observed on the GreatEyes detector
  • Work is still urgently needed to get the Gotthardt Detector working 
  • The laser is synchronised to 100fs. It is currently up to the shutter in the instrument hutch

SPB

  • On Monday AGIPD took first data  with 30 frames 
  • The sample jet is working with sufficient vacuum to operate the detector
  • Yesterday, everything was ready to take data with liquid jet and AGIPD. Unfortunately, there was a major software/electronics failure that lasted for 6.5h
    • A fuse was blown in one crate needed for the train IDs (single point of failure)
    • This affected all crates and KARABO
    • A fallback is currently being implemented
  • The door interlock could not be operated because there was a problem with the operator password

Tunnel

  • SASE3 tunnel installation will not be reviewed because there is no work on it
  • SASE2 tunnel installations will be reviewed once AE and CAS get involved.
  • Network installations may take up to 4 months (info by K. Wrona)
  • First signals were seen from HIREX last week
  • Currently this integrates over 30 bunches as Gotthardt is not available

Laser

  • Differently from what was reported earlier, the AC system works at the required lower flow rates
  • Progress on laser installation and commissioning is progressing as planned
  • There are a few problems with motor operations from KARABO

Detectors

  • Both AGIPD and LPD are taking uncalibrated data
  • A cooling leak was detected in LPD. Experts from RAL are going to look at this today
  • Calibration may just be achieved for AGIPD. Probably not for LPD due tot the HW problems

AE

  • All SPB loops were updated to accommodate the train ids
  • Almost all FXE loops were updated too
  • The tunnel loops were not updated yet. 
  • For the tunnel, the motion loop needs to be updated. EPS and Vacuum loops should remain unchanged
  • There remains one open issue with an encoder on the sample injector. X and Y encoders will be exchanged today to isolate the problem

CAS

  • Work this week concentrated on GUI issues (achieve faster feedback)
  • One patch was released to fix GUI problems
  • Good progress was made with data analysis tests together with people from CFEL
  • Next important topic on the list is to get the XGM data into the KARABO DAQ stream. This requires the DOOCS interface
  • KARABO 2.1.16 needs to be closed
  • For FXE there is good progress with Gotthardt. This now needs testing in the hutch. The same applies to the digitizers.
  • W. Wrona points out that independent KARABO installations exist for SPB, FXE and tunnels. This needs to be fixed to allow DAQ integration.

 

  375   04 Sep 2017, 10:39 Tobias HaasGeneralInformationStatus after 0930 meeting

SPB

  • Demo experiment done last week
  • Flat fields taken with AGIPD over the weekend
  • Focus was re-characterised. This required modifications to several beam parameters and then led to a controversial discussion with the RunCoor
  • The sluggish behaviour of the GUI remains an issue and might pose a real risk if the injector freezes up and direct reflections into the detector occur
    • Kerstin and Gero looked at it last week
    • John is back from holidays and will also look
    • One observation is that the same information may update quickly on one server but not on another
  • One motor is stuck in XTD9. A temporary access is requested
  • On Sunday at beam hand over the CRL in XTD2 was not fully retracted. This was then done unannounced. Nothing bad happened this time but  this might cause real damage. 

FXE

  • on shift and not represented at the meeting
  • Harald mentions that 2 motors in the XTD2 CRL are stuck/in error. This should be fixed during this week's repair period
  • Info by CB after the meeting: Scanned K_\beta and established machine energy scale within 40 eV

Tunnels

  • Motion loop and SPB loop to be updated by AE tomorrow
  • Tunnels and instruments are in different KARABO "Topics". K. Wrona states that this is a problem for DAQ
  • SPB states that they have all information required already in their "Topic"
  • It is unclear whether this might be an issue for FXE

CAS

  • No specific issue
  376   04 Sep 2017, 12:03 Tobias HaasGeneralInformationStatus after 0930 meeting

Just to clarify:

  • Tunnel and SPB are in different Karabo Topics. It should not be a problem since we agreed that SPB does not need XTD2 slow data (from devices)
  • Tunnel and FXE are in the same Karabo Topic
  • We will keep prioritizing the configuration and deploy of Karabo-DAQ in SPB and FXE. Before going for Tunnel updates (we are mitigating risks of broadcast unknown issues just before the 1st User Experiments).  
Tobias Haas wrote:

SPB

  • Demo experiment done last week
  • Flat fields taken with AGIPD over the weekend
  • Focus was re-characterised. This required modifications to several beam parameters and then led to a controversial discussion with the RunCoor
  • The sluggish behaviour of the GUI remains an issue and might pose a real risk if the injector freezes up and direct reflections into the detector occur
    • Kerstin and Gero looked at it last week
    • John is back from holidays and will also look
    • One observation is that the same information may update quickly on one server but not on another
  • One motor is stuck in XTD9. A temporary access is requested
  • On Sunday at beam hand over the CRL in XTD2 was not fully retracted. This was then done unannounced. Nothing bad happened this time but  this might cause real damage. 

FXE

  • on shift and not represented at the meeting
  • Harald mentions that 2 motors in the XTD2 CRL are stuck/in error. This should be fixed during this week's repair period
  • Info by CB after the meeting: Scanned K_\beta and established machine energy scale within 40 eV

Tunnels

  • Motion loop and SPB loop to be updated by AE tomorrow
  • Tunnels and instruments are in different KARABO "Topics". K. Wrona states that this is a problem for DAQ
  • SPB states that they have all information required already in their "Topic"
  • It is unclear whether this might be an issue for FXE

CAS

  • No specific issue

 

ELOG V3.1.4-7c3fd00