Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Joint Operation and Readiness Logbook, Contact: T.Haas, A. Violante, G. Wellenreuther, Page 15 of 30  Not logged in ELOG logo
ID Date Author Location Severitydown Subject
  292   16 Jun 2017, 10:18 Monica ArestéGeneralInformationStatus and plans after SASE1 Readiness Meeting

General:

  • E. Boyd update the status about the tasks for radiation measurements the 26th June. See presentation attached.
  • J. Gruenert suggest to use similar interface as is being use for the machine and will send the link to G. Wellenreuther.

XTDs

  • Images for Photo commissioning on the tunnel are stored by a temporary solution. J. Grunert request when the DAS routines will work, CAS will prepare a short presentation for the meeting next Friday to show the progress on that issue.
  • This weekend is scheduled to commissioning with a WL of 1,5Å and 30 bunches into the dump for first time.

FXE

  • Radiation safety measures done last Wednesday.
  • Leaks in the Vacuum system already fixed.
  • Cables for motors already repaired by JOWO this week. Reparations will continue next week after urgent cables for SPB are done.
  • In general loops are working but there are still some minor issues, AE working in some loops updates.
  • Meting on Monday between FXE and AE to define Interlock to deploy.

SPB

  • Loop 1 is working, AE to fix some mismatchs in loops 2 and 3.
  • Export for loop 7 is done, AE is working to generate the firmware. EET has two persons working in the exports for loops 4 and 12.
  • Ion pump cables repaired and tests on going.
  • All connector reparations in the OPT-hutch are done and the test of the motors are on going.
  • JOWO will keep working in 20 urgent cables for SPB and then move back to FXE.

Detector

  • AGIPD is fully powered, there are still some issues for the Intelock that needs AE support.
  • More details see attached file provided by Detector Group.

Laser

  • The humidity in the hutch still oscillates, this shoud be fixed urgently since it is preventing further commissioning.
  • Image processor not working since each 2-3 hours stops, CAS to fix that issue.
  • There are motors not working, CAS to investigate.

Electronics

  • First priority is is to have the Vacuum system for FXE and SPB operational at the end of June. Next two weeks AE will be mainly focus in the loops that are still missing (SPB 4, 5, 7,12) or still not running (SPB 2, 3)
  • Elmo controllers not integrated, AE will test a solution in SPB on next week. If it works will be deployed also for the tunnels but this is not first priority and will be done in July.

Software

  • CAS is working to have a more robust system, S. Brockhauser point out that new request from instruments should we send to CAS to define priorities.
  • To prepare a short presentation for next Friday about the issue of the tunnel DAS to store images (see point in XTDs)
Attachment 1: Radiation_Measurments_for_Commissioning.pptx
Attachment 2: 20170615-Components-Detectors.xlsx
  293   16 Jun 2017, 18:12 Jan GrünertGeneralInformationWP74 OCD plan update
The WP74 OCD plan is also published in WP74-Alfresco and sent by email to HR/WoCo/STGL.
Please note that this plan could be subject to changes depending on the needs of the involved colleagues (e.g. if they want to swap OCD assignments).
The actually performed OCD-times are reported to HR at the start of each following month.

Attachment 1: WP74-OCD-plan-6-8-2017.xlsx
  294   19 Jun 2017, 10:17 Monica ArestéGeneralInformationStatus and plans after SASE1 Readiness Meeting

XTDs:

  • There are no major issues, commissioning works smoothly this weekend.

FXE:

  • Radiation safety measures done last Wednesday.
  • Tests with CRL are on going but there are some problems with motors since are moving only in one direction. CAS is working on that issue.
  • Loop1 need an update, support from AE necessary.
  • Interlock conditions meeting to be held today, to carry out  the test end this week.

SPB:

  • Test with loop2 continue.
  • Cables for Loop3 will be repaired today and tomorrow. Firmware already available.
  • Export for loop 7 is done, AE is working to generate the firmware. EET has two persons working in the exports for loops 4 and 12.
  • Interlock conditions already defined by SPB sometime ago.

Diagnostics:

  • External trigger for Basler cameras still not always working, CAS keep working on that.

 

Electronics:

  • Today and tomorrow working for the AGIPD, required an additional interlock part for the Vacuum.
  • First priority is is to have the Vacuum system for FXE and SPB operational at the end of June. Next two weeks AE will be mainly focus in the loops that are still missing (SPB 4, 5, 7,12) or still not running (SPB 2, 3)

 

Software:

  • Karabo version installed in a different domain, CAS is still testing ths version to ensure a smooth transition from one version to other.
  295   19 Jun 2017, 16:55 Gerd WellenreutherXTD9InformationAccess to tunnels updated

Tunnel access schedule has been updated, access for XTD9 on Wednesday from 7-14:00 is now for granted.

https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules

  296   21 Jun 2017, 10:21 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

XTDs:

  • DESY requests the KMONO to be commissioned since the K Values of the undulators appear not to be as accurately calibrated as originally advertised. Management decided to put KMONO at the top of the priority list for this reason. W. Freund should work together with Mahadi and Nerea on getting the two goniometer motors (ELMO controller) working. When software is ready a ZZ access should be requested
  • Latency of FEL imager is ~ 5s which is a problem for tuning and scans. M. Messerschmitt is looking into this. A. Silenzi was not aware of the problem up to now.

Radiation Safety Tests:

  • Radidation safety tests are scheduled for 26 - 28 June. Proposed order is SPB Optics, FXE instrument, SPB instrument. Detailed plans to be discussed in a dedicate meeting on Thursday and plans to be presented in the Friday TC meeting
  • Vacuum interlocks will not be implemented before the rad safety tests and vacuum will be operated completely in manual mode
  • Open topic: Can the instruments use the beam after the rad safety test are done and how is the procedure?
  • SRP needs to make precise statements about where people can/should be during the rad safety tests

FXE:

  • Ready for radiation safety tests.

SPB:

  • Tested motors in loop3
  • Tested valves in loops 2&3

Electronics:

  • Concentrating on getting KMONO going in the next days

Software:

  • No special topic
  297   21 Jun 2017, 14:13 Gerd WellenreutherGeneralInformationTunnel access schedule updated

Dear all,

I extended the tunnel access schedule up to the beginning of the shutdown (3.7.). As always, you can find it under https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules

Access request to Harald Sinn. Works during the shutdown have to be reported to Harald Sinn and Dirk Nölle for scheduling.

Cheers, Gerd

  298   22 Jun 2017, 15:15 Tobias HaasXTD2InformationSchedule for first beam SASE1 hutches

It was just decided to put a very low intensity beam into the SASE1 hutches starting tomorrow morning at 8 AM. Both instruments declared that they are ready to accept it. Due to the very low intensity no special measures need to be taken outside the hutches. SRP and D3 shall be in the experiment hall. Harald Sinn shall coordinate beam activities from the BKR. Please note that the TC and S1R meetings take place as announced.

  299   23 Jun 2017, 11:11 Tobias HaasGeneralInformationStatus and plans after SASE1 Readiness Meeting

General

  • A low intensity beam is being put into the SASE1 intrument hutches in this order: SPB Optics, FXE Instrument, SPB Instrument
  • No special precautions outside the hutches are needed due to the low intensity. 
  • The work will most likely not finish today. If necessary ti will continue next week Monday
  • From now on, access to the SPB Optics, SPB Instrument and FXE Instrument hutches requires these three safety trainings
    • General Safety (AllgSi)
    • XFEL Safety (SiXfel)
    • General Radiation Safety (StraSchu)
  • Check with SRP if you are not sure about yout status

XTDs

  • W. Freund and the AE colleagues successfully tested their firmware on the the KMONO in HERA-s. This will be integrated in the motion loop and a controlled access will be requested on Tuesday to try this out in XTD2

FXE, SPB:

  • Working in the hall to bring the beam into the hutches

Laser:

  • 90% of the hardware is installed on the tables
  • Humidity in the laser hutch still varies wildly, even after the humidity in XHEXP1 is below 60%
  • Humidity variations translate into a pointing instability of the seed laser which cannot go into the amplifier
  • There is a discrepancy between KARABO names and motor terminal names that needs to be cleaned up

Detectors

  • Interlock tests on AGIPD were successfull
  • The train builder is integrated
  • LPD is about to finish the tests in the X-ray chamber
  • Afterward the KARABO version needs to be updated 
  • Transport ot FXE is scheduled for week 27

Electronics:

  • Getting SPB and FXE ready for today's beam exercise required quite some short term effort
    • Mahadi had to get the cameras ready
    • Bruno had to set up the trigger timing
  • Implementation of the interlock conditions were delayed for the exercise of bringing the beam in. This should happen immediately afterwards together with the connection to the MPS system which is currently not present
  • The remaining problems with vacuum in SPB and FXE were solved (Some had to do with hw problems and wrongly wired controllers)
  • Work continues on bringing up more SPB loops. Most recently loop 4 was brought up and the firmware for loop 7 is prepared for tests
  • Implementation of the interlock conditions were delayed for the exercise of bringing the beam in. This should happen immediately afterwards
  • The work on KMONO delays some of the instrument work

Software:

  • CAS is currently working with high priority together with ITDM to get the DAQ system and archiving up 
  • There was a dedicated SQUAD for this purpose
  • The functionality has already been tested successfully on the LPD detector.
  • The interface needs work to become usable
  • Tests of full scalabiity are still outstanding
  • The system needs to be deployed in the real environment
  • It is estimated that the remaining work should take ca 3 - 4 weeks

 

  300   26 Jun 2017, 10:57 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

General:

  • ​Beam was brought to all SASE1 hutches on Friday. Beam was available to both instruments splitting it with M3 until Sunday morning. Afterwards SASE tuning was done and the beam should be back in the hutches some time today. Beam operation will continue this week with very low intensity. Split beam operation to both instruments.
  • Rules as follows:
    • Only one bunch and very low intensity (< 100uJ)
    • Mechanical manipulation on vacuum parts only when shutter and all-metal gate valve are closed
    • Shutter and gate valve closed when instrument people are not in attendance
  • CAS appears to be in a 2 day workshop from 9 - 5. This is a problem as some urgent work is needed. 

XTDs

  • No access for KMONO commissioning this week
  • All preparations that can be done for KMONO operation should be done however
  • M. Messerschmitt prepares interface for the FEL imager to DOOCS so that KMONO can be used for tuning

SPB

  • A list with essential components has been prepared
  • It appears that some of the previously brought up loops contain only vacuum components. This should be fixed
  • Loops 5 and 12 are needed most urgently now. 
  • 5 additional servers are needed from CAS

FXE

  • No remarks from FXE
  301   26 Jun 2017, 15:52 Gerd WellenreutherGeneralInformationTunnel access schedule updated

Dear all,

I tried to update the TAS to include the times for each XTD during the shutdown-week at the beginning of July. It is currently not entirely clear when XTD9 and XTD10 will be searched, and as always this is subject to change...

Link to Tunnel Access Schedule

Cheers, Gerd

  302   27 Jun 2017, 10:26 Gerd WellenreutherGeneralInformationTunnel access schedule updated

Dear all,

according to Dirk Nölle access to XTD4 during the shutdown will be extended until Thursday.

Link to Tunnel Access Schedule

Cheers, Gerd

  303   30 Jun 2017, 11:33 Tobias HaasGeneralInformationStatus and plans after SASE1 Readiness Meeting

Data Acquisition and Data Archiving

  • K. Wrona summarised the basic ingredients of the system.
  • All components are ready and tested individually
  • Integration in the instrument environment is needed and will be done first in the context of commissioning LPD in FXE starting from 5 July
  • DAQ and archiving for the tunnels was originally not foreseen but is being worked on now
  • The split up of the KARABO environment into several "Topics"  was done on purpose to allow development with minimal interference
  • The separate topics have to be re-integrated now
  • The sildes from Krzysztof can be found here

XTDs

  • KMONO integration should happen next week starting on Monday
  • The planned work on the network switches should only start on Tuesday as it interferes with KMONO integration

FXE

  • Topics to be worked on next:
    • Vacuum interlock integration
    • LPD integration
    • uTCA digitizer (was already working in Karabo 1.4.7)
    • Great Eyes Detector has a rate limitation that was not there before
  • Longer term topics
    • Gotthard detector

SPB

  • Loops 12 and 5 are prepared and uploaded but need to be commissioned now
  • Firware for loop 13 is needed next
  • Many motors seem to be getting 24V, but should be ruuning with 48V. What is wrong? This needs to be checked in the EPLAN and CRDs
  • Loops appear to be missing components

Detectors

  • LPD goes to FXE on 5 July. Integration work in the hutch starts immediately after
  • AGIPD then goes into the X-Ray test stand in HERA-S
  • Note that the DAQ infrastructure can only support one detector at full rate at a time. 
  • In principle this should not be an issue at 30 bunches but it requires the veto system to work which needs testing

Electronics

  • Work this week concentrated on preparing everying for deploying the instrument vacuum interlocks next week
  • The problem with wrong names in the PP laser was identified as a wiring issue in one crate 
  • Work also concentrates on timing and train builder to support detector integration from next week

 

 

  304   30 Jun 2017, 15:33 Janusz SzubaGeneralInformationNetwork and servers maintenance

As discussed offline with NOC, Monday schedule was already fixed and not movable to Tuesday. Therefore, the network maintenance will take place on Monday 7:00 - 9:00.

During that time, no stable network is guaranteed.

After the network maintenance, the foreseen update and restart of all control server will take place, which take approx. ~2 hours. The exceptions are sase1 control servers and plc gateways as well as data logger and brokers and probably most importantly, exflgateway. These will be done after the work in sase1 (KMONO integration) is finished.  

  305   03 Jul 2017, 10:13 Krzysztof WronaXTD2InformationNetwork upgrade /information and problem

The upgrade of the switches is finished to the extend that it allows Advanced Electronic group to work on KMono (Nerea is informed)

However, during the upgrade of the network one switch got stuck and this is the switch in XTD2 tunnel. The IP network in the XTD2 tunnel is not reachable at the moment (Beckhoff loops are fine) and we are going top the tunnel soon.

 

 

  306   03 Jul 2017, 10:26 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

General

  • Accelerator was down all weekend due to cold compressors that were damaged in conjunction with the power outage on Friday
  • Since 0700 all interlocks are broken and tunnels are open.
  • Tunnels except XTD9 stay open until Thurday.
  • XTD9 can remain open longer

Availability of Networks

  • Network mainentenance that was requested last Friday for Tuesday has to happen today together with the rest of the facility. It was scheduled for 0700 - 0900 and is already almost done
  • Following the network maintenance, N. Jardon will bring down the motion loop for KMONO integration. This only affects the tunnels and instruments can work during this time
  • After the work by N. Jardon, IT needs to replace kernels on server machines. This will result in KARABO being down until early afternoon
  • Afterwards CAS needs to bring back KARABO
  • All measures will be announced on this log book

Instruments

  • Implementation of vacuum interlock should be implemented this week. 
  • SPB requires several adjacent loops to be included. Some of them are not up or complete. Maybe a simplified version should be installed first
  • SPB requests loop 12 from AE. However this will take until mid July as it contains new motors (SMARAGD) that have not been tested so far

AE

  • Work is currently ongoing on preparing to connect instrument interlocks to the DESY MPS system
  • Work is also required to fix problems for the laser group that are most likely due to faulty wiring or a broken terminal

IT

  • The dual power supply for switches saved a lot of work for IT after the power cut on Friday
  • Unfortunately, the PLC CPUs in SASE1 are not on dual power. This should be upgraded as it is now also planned for SASE2/3.
  • Dual power should also be put for the uTCA systems
  307   03 Jul 2017, 11:01 NEREA JARDONGeneralInformationMotion loop update

Dear all,

We will be working in the Motion loop till this afternoon. So as I said in the morning meeting, I will let you know when we have finished.

Thank you

  308   03 Jul 2017, 16:03 Gerd WellenreutherGeneralInformationTunnel access schedule updated

Dear all,

based on the information from todays BKR-meeting and communication with Harald Sinn, I updated the TAS: https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules

Basically, Harald is trying to keep XTD9 open until middle of next week, he still has to talk to DESY...

Cheers, Gerd

  309   03 Jul 2017, 18:22 Janusz SzubaGeneralInformationcontrol servers maintenance

All control servers, brokers, dl and finally gateway were updated and restarted.

  310   03 Jul 2017, 20:53 Alessandro SilenziGeneralInformationKarabo for SASE1 topic restarted

Here attached the main SASE1 panel

Attachment 1: 07.png
07.png
  311   04 Jul 2017, 09:41 NEREA JARDONXTD9InformationMotion loop

Dear all,

Today we are planning to integrate part of Hirex motors into the Motion loop of SASE1. Therefore, the loop will be break, so you will loose communication with whole XTD9 Motion part. I will back again to you when we are done,

Thank you

ELOG V3.1.4-7c3fd00