Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Joint Operation and Readiness Logbook, Contact: T.Haas, A. Violante, G. Wellenreuther, Page 13 of 29  Not logged in ELOG logo
New entries since:Thu Jan 1 01:00:00 1970
Entry   Status after 9.30 Meeting, posted by Adriano Violante on 24 Jul 2017, 10:38 

General

  • The latency observed by SPB in the GUI client has been almost completely fixed. Still some "freezing" from time to time remains.
  • DAQ tests in FXE with LPD worked for 12/16 of the detector. Trigger's signal stability issue being addressed by AE.
  • XTD 9 and 10 will remain open from 25.07. at 7:00 to 26.07. at 14:00  
  • On Wednesday afternoon the machine will be prepare to lase with 30 bunches in order to allow the radiation measurements in SASE1 Exp. Hall on Thursday and Friday.

XTDs

  • Fast valve in XTD9 still has issues with noise. Issue will be addressed tomorrow with AE support.

SPB

  • Integration of the turbo pumps in  the VAC loop ongoing.
  • Chiller control being included in Loop 5
  • Firmware for the AGIPD hv power supply was updated. The spikes during ramping are gone
  • SMARACT motors being implemented. (depend on Loop 13)
  • Work on in vacuum interlock in SPB will probably start this week.
  • Some problems with Karabo (While measuring profiles the level scaling does not work, Region of interest values wrong) have been reported to CAS.
Entry   Status and plans after SASE 1/3 Readiness Meeting, posted by Frederike Wittmaack on 24 Jul 2017, 10:07 

General (T. Tschentscher/G. Wellenreuther)

  • Further tuning of the machine might require some time which was initially dedicated to photon/experiment commissioning.
  • Since Harald Sinn will be on vacation: If you need any kind of access please address T. Tschentscher or M. Dommach. TT will organize coordination of groups requiring access to the tunnels vs. requirements of the machine vs. the demand of the instruments for commissioning.
  • Lasing with 30 bunches was achieved this week. Consequently the radiation protection measurements have to be undertaken as soon as possible.

FXE (C. Bressler)

  • yesterday no beam at all
  • attenuators are being tested
  • all hardware installed

SPB (R. Bean/A. Mancuso)

  • Implementation of loops required for focal characterization — mainly loops 12 and 13. Also loops required for vacuum interlock.
  • Still more loops required to be brought up—working with AE down a clear priority list.
  • Clear plan for AGIPD to come to SPB/SFX instrument. Requires DAQ and more.
  • CAS reacted quickly to undesirable behavior (freezing) in Karabo, which is now largely solved.

Tunnel Installations SASE3 (J. Eidam, L. Samoylova, N. Kujala)

  • SASE3: No access – no progress
  • SASE2: work as planned is ongoing
  • SASE1: There are still issues with the fast valve.
  • During this and last week maintenance days, the Newton PICO motors of FXE monochromator were successfully tested in the tunnel together with Nicola. All four motors for crystal roll and pitch can be moved in vacuum. However a slow motion, necessary for fine tuning, seems still not available. Further motor parameters adjustment is needed, which will be done in the lab with test environment.
  • To fulfill the technical commissioning and make the FXE mono available for photon commissioning and operation, the firmware for Alio linear stage should be created. The work is on-going. May be available for tests before mid-August, but the schedule and priorities should be clarified.
  • Status of HIREX spectrometer in XTD9 tunnel: The HIREX saw FEL beam for the first time yesterday. All motors were commissioned with Karabo software and ready for commissioning with FEL beam. It is in discussion with SPB and FXE to have parasitic beam for commissioning in the coming week.

Laser (Daniel Kane)

  • The pump-probe laser group reported that, with the stabilization of the AC system, we are now continuing with production of the laser system. We are still missing the functionality some components of our control system, but we have enough at the moment that it is not an impediment to us building the laser for now, however it is something that needs keeping an eye on.

Detectors (J. Sztuk-Dambietz)

  • LPD: K. Wrona reported that they could observe on all channels but they are still working on storing the data. Loss of device settings induced by glitches in Karabo cost a lot of time to overcome.
  • AGIPD: ten out of 16 modules have been successfully tested but there is still a lot of work to do; still testing procedures and electronics, etc. before AGIPD is moving  in to SPB in August

AE (P. Gessler)

  • Focus is on loop 12 this week, continued to get remaining parts for loop 12 running
  • The firmware based interlock for FXE was implemented, certain conditions are disabled but otherwise it is running.
  • Plans for shut down week of SASE3 in tunnel in August are currently being made

CAS (S. Brockhauser)

  • As reported previously, a release candidate for 2.1.13 has been prepared last Friday
  • During the last week-end CAS could systematically reproduce the GUI delay problem SPB was reporting
  • In the beginning of the week CAS could identify the source of the GUI delay issue (which was in an old code of the GUI client and got triggered only under special circumstances) and fix it.
  • Solution was patched into the new 2.1.13 release resulting in a new release candidate which CAS finished testing now.
  • Note that the new release will also fix most of the annoying issues (especially the configuration persistence problems) experienced recently during LDP integration to FXE
  • As soon as the new release becomes finalized its deployment in the different production systems will be done under CAS coordination after consulting with all relevant WPs involved.
  • The newly introduced quick release cycles with the attached deployment process (as shown on the meeting last week) will help provide access to improved releases while guaranteeing that no surprises and irreversible regressions apply.
  • On the ScanTool thread opened by Christian: CAS has started to design a ScanTool around the SRD from SPB which is now being crosschecked against requirements coming from others, too, like FXE, before starting its implementation.
  • Thomas, Gerd, and Harald suggested to disseminate its design, so others can also give feedback. Hence, we agreed, that Sandor Brockhauser provide this information and organize a meeting next week.
Entry   Tunnel access schedule updated, posted by Gerd Wellenreuther on 24 Jul 2017, 10:03 

Dear all,

access to XTD9 and XTD10 will be available from tomorrow Tuesday the 25.7. 7:00 (Vacuum group will make sure the interlock is broken), until Wednesday 26.7. 14:00:

https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules

Please send any additional access requests to M. Dommach and T. Tschentscher.

Cheers, Gerd

Entry   Tunnel access schedule updated, posted by Gerd Wellenreuther on 20 Jul 2017, 15:19 

Dear all,

according to the current planning on next Tuesday (25.7.) both XTD9 and XTD10 will be accessible from 7-14:00:

https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules&listViewLinkBack=true

Cheers, Gerd

Entry   Status and Schedule after 09:30 meeting, posted by Tobias Haas on 19 Jul 2017, 10:11 

General

  • The latency observed by SPB in the GUI client could be reproduced by CAS. Also a  potential reason was identified. As soon as this has been sufficiently tested it will be released
  • DAQ tests in FXE with LPD worked for the first time yesterday for 1/16 of the detector
  • FXE and SPB will show 1-2 slides about progress and ongoing work during the TC meeting on Friday morning

XTDs

  • Fast valve in XTD9 still has issues with noise and will probably need to remain disabled

FXE

  • Interlock for loop 1 was deployed. Still need to do loop 2. Work per loop requires ca. 3-4 h.

SPB

  • Firmware for the AGIPD hv power supply was updated. The spikes during ramping are gone
  • Next items to get going are the SMARAGD motors
  • Loop 7 needs to be brought back. Crate 51 has been fixed.
  • Work on in vacuum interlock in SPB will need to be carefully timed and coordinated after finishing FXE. Due to impending beam probably not before next week
Entry   Tunnel access schedule updated, posted by Gerd Wellenreuther on 18 Jul 2017, 10:57 

Dear all,

an updated TAS is provided: https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules

There is potential access to the XTDs on next Tuesday + Wednesday (25+26.7.), as well as on Monday - Wednesday (31.7.-2.8.). Access will be organized by M. Dommach, since H. Sinn will be on vacation - so please send Martin your access request in time.

Cheers, Gerd

Entry   Information AE OCD July 14--17 (till Monday 8:00), posted by Nicola Coppola on 14 Jul 2017, 18:46 

AE on call service:

    Contact person:

        Nicola Coppola

    Phone

        9 - 8040

Entry   Status and plans after SASE1/3 Readiness Meeting, posted by Tobias Haas on 14 Jul 2017, 13:17 

General

  • From now on progress with the SASE3 tunnel will be monitored in this meeting

FXE (A. Galler)

  • Work is going on to be ready for the start of instrument commissioning of Sunday
  • Currently the LPD movement is being tested
  • Today the firmware for the vacuum interlock system is being deployed

SPB (M. Messerschmidt)

  • All inputs needed for the vacuum interlocks can now be read out
  • Karabo was migrated to version 2.1.12. This appears to have some fixes for reading out cameras, but the GUI becomes unusable after ca. 10 min. Hence the version had to be rolled back to 2.1.11. This generated a lot of extra work
  • The test of the emergency off system was done this week. In preparation the PLCs were shut down to avoid damage. Bringing the system back was a significant effort. This should be getting less as more and more parameters are migrated to the firmware
  • A partial test of the MPOD power supplies was done in preparation for the AGIPD commissioning. Unfortunately some Wiener power supplies still have an older firmware that appears to produce voltage spikes when ramping up. This could damage the detector. Hence a firmware upgrade is needed. But no Windows PC was available on the controls network. The respective card was dismounted and taken to the lab for upgrading by K.-E. Ballack

Tunnel Installations SASE3 (M. Dommach)

  • A lot of installation work was carried out during the service period last week
    • All Day 1 devices are in place
    • A lot of missing connections were made (water, pressurized air)
    • Calbing was done for the imagers
    • The Solid Attenuator was assembled
    • There are still two vacuum leaks, one of them is on top of the dump. This may have to wait for the next service period in August
  • Focus during the next service period in August:
    • Install missing connection pieces and bellows in order to close the entire vacuum
    • Start bringing up Beckhoff loops with support from AE
    • Bring up as many components as possible 
  • For the comments made by WP74/J. Grünert, see the respective log book entry today

Laser

  • After a number of fixes and adjustments the AC parameters (Humidity/Temperature) are now according to specs

LPD

  • LPD is now fully installed in FXE
  • Work on the DAQ system starts next week
  • Next step for AGIPD in HERA-S is to get the DAQ system working. After this the detector will be brought to SPB
  • K. Wrona would like to cross check the configuration in HERA-S before this happens

AE

  • Work focussed this week on getting the remaining SPB loops up, in particular loops 12 and 5
  • For loop 12 a number of modules had to be taken out, modified and brought back. This relates to the operation of so-called SMARAGD motors
  • Originally it was planned to test the vacuum interlock system in SPB first. This requires inter-loop communication and there are still unused loops in SPB
  • Due to the problems with loop 12, it was decided to do the tests in FXE.
  • The firmware for the FXE interlock should be deplyed today
  • A meeting was held with MPS to clarify the interface between XFEL and MPS sind the MPS system cannot distinguish between the branch beam lines. This can now be handled by logic inside the PLC
  • AE is preparing for the support of SASE3 during the next service period

CAS

  • For more details see the detailed slides presented by S. Brockhauser during the meeting
Entry   Fast Valves in XTD9, posted by Martin Dommach on 14 Jul 2017, 12:44 

Dear all,

the fast valves in XTD9 were causing some trouble. From time to time they collect some electrical noise what triggers the valve. The pressure reading on the valve controller then shows oscillations of up to 10^-5 mbar, while the pressure around the fast valve gauges in the beamline is in the 10^-9 mbar range.
To operate the beamline in the meantime I have opened and disabled both fast valves. 

This needs further investigation on the service day next wednesday.

Best regards,
Martin

Entry   TAS updated, posted by Gerd Wellenreuther on 14 Jul 2017, 10:50 

Dear all,

the Tunnel Access Schedule has been update - potential access has been shifted from Wednesday the 19.7. to Tuesday the 18.7. Should you need this access, please inform Harald Sinn!

https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules

Cheers, Gerd

Entry   WP74 SASE1/3 readiness status and outlook, posted by Jan Grünert on 14 Jul 2017, 09:31 

SASE1 / SASE3 readiness --- WP74

2017-07-14

SASE1: 

  • commissioning of Kmono started yesterday at 10h for some hours
  • Kmono will be used for undulator commissioning as soon as Kmono is commissioned itself, and machine is ready for this
  • Support to SASE tuning given to machine (ongoing)
  • Maybe today: support during SASE gain studies
  • During last week (service week) : GLT-Anbindung XTD2 established

SASE3:

  • During last week shutdown : 
    • progress on DP installation, XGM cabling almost done, much imager and timing cabling done
  • When XTD10 is closed (as now) we currently cannot do much because there is no PLC loop in SASE3.
  • Non-Beckhoff technical commissioning started (e.g. some progress on MPOD HV-power supply)
  • WP74 must do a lot of technical commissioning in XTD10. Our work is by far not done when all our vacuum screws are tightened. There are different WP74 components in XTD10 than in SASE1 (not just a simple copy). WP74 requires the Beckhoff loops for tech. commissioning.
  • Alignment of DP „islands“ to be done in next shutdown.
  • Planned for next shutdown: installation of PES in XTD10, finishing of cabling
Entry   Information AE OCD July 13, posted by Nicola Coppola on 13 Jul 2017, 18:15 

AE on call service:

    Contact person:

        Nicola Coppola

    Phone

        9 - 8040

Entry   Tunnel access schedule updated, posted by Gerd Wellenreuther on 13 Jul 2017, 15:45 

Dear all,

I updated and extended the tunnel access schedule (TAS) until the 24th of July. According to Harald, there will be an opportunity to access XTD next Wednesday. Please keep him informed should you require access.

https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules&listViewLinkBack=true

Cheers, Gerd

Entry   Vacuum Loop in XTD9, posted by NEREA JARDON on 13 Jul 2017, 10:27 

Dear all,

One power supply needs to be changed in SASE1 XTD9 rack 1.12 tomorrow and it's related to the Vacuum loop. Denis Finze will do this change tomorrow morning, but we have to make sure before that we have all the equipments after this rack 1.12 in safe state (most concerning part, XGM in XTD9). Please, could you make sure that everything it's ok tomorrow at 10am? However I will send an email now to the involved people.

Thank you and best regards,

Entry   Motion loop update, posted by NEREA JARDON on 12 Jul 2017, 15:15 

Dear all,

Tomorrow morning we will do an update in the Motion loop due to some hardware changes requested in Rack number 1.18. You might will not have communication with this rack during whole day, because they will be doing local test after changing the hardware..

Thank you and bests,

    Reply   Motion loop update, posted by NEREA JARDON on 13 Jul 2017, 07:46 

Motion loop is up and running again, as I have said, you will not have communicatin with equipments of Racks 1.18 till Denis finishes with hardware changes.

Thank you,

NEREA JARDON wrote:

Dear all,

Tomorrow morning we will do an update in the Motion loop due to some hardware changes requested in Rack number 1.18. You might will not have communication with this rack during whole day, because they will be doing local test after changing the hardware..

Thank you and bests,

 

Entry   Status and Plans after 09:30 meeting, posted by Tobias Haas on 12 Jul 2017, 10:45 

XTDs

  • Mechanical operation of KMONO is prepared. Work is now ongoing on optimizing the scenes in KARABO
  • Data from the SR imager that is needed for scanning the undulator gaps needs to be available in DOOCS. This is prepared.
  • Once the machine can provide beam, one hour for KMONO first commissioning has already been agreed

SPB

  • Test of the Emergency Power Off should take place this afternoon. PLCs will be shut down and hence parameters have to be put badk
  • N. Jardon will put as much information as she can into the firmware do reduce the work of putting back the parameters
  • However, in FXE it was found that the Emergency Off buttons only act on the interlock and not on the electrical systems. The situation in SPB is probably similar
  • Work is ongoing on technical commissioning but there are still key components physically missing (e.g. CSS and Sample Environment)
  • Vacuum interlock is not yet implemented as it is still waiting for a number of components  in loops 12 and 5

FXE

  • JJ XRay worked last week and now the vacuum has to be re-established. Pump down should start soon but there was still one leak.
  • Vacuum interlock definition is ready and it will be implemented by AE today
  • LPD was installed. Currently 2 out of 4 super modules are installed. The other two should come early next week

DAQ

  • Cabling and preparations are ongoing
  • Tests should start early next week

AE

  • Currently working on changes in loop 12 for SPB

CAS

  • Currently working on bug fixes. Some of these bugs are probably responsible for the system not updating vacuum info for 30 minutes
  • Deployment should happen this or next week
  • There appears to be some confusion/communication issue as to what version of KARABO is installed where.
  • It needs to be ensured that the startup of the next photon commissioning period goes smoothly
Entry   Motion loop update, posted by NEREA JARDON on 10 Jul 2017, 15:23 

Dear all,

We will do an update of the Motion Loop in the next 15minutes in order to fix one analog signal related to the KMONO.

Thank you

Entry   K-Mono control, posted by Wolfgang Freund on 10 Jul 2017, 14:35 

During the first K-Mono test with Karabo on Friday the first goniometer THETA1 (Elmo controller) moved beyond the CW limit switch and stopped  at the CCW switch. So the goniometer was trapped between both switches with a movement range of a few degrees. Movement of encoder and motor were opposite. This behaviour is not understood and under investigation.

Now the goniometer is back within the nominal range and movement of motor and encoder reading is consistent. CCW limit switch at 117.5° / CW limit switch at ~182°.

Entry   Status and Plans after 09:30 meeting, posted by Tobias Haas on 10 Jul 2017, 10:31 

General

  • Interlock was set in the injector last Friday
  • All shifts were cancelled for the weekend
  • Startup today and interlocks set in XTD10
  • It is still the aim to have photons by Wednesday (info from XFEL runn coor at 10:30)
  • XTD9 remains open until Friday afternoon
  • Tests of the emergency off buttons by TS (Thorsten Schön/TS) need to be performed in the instrument hutches. This is currently scheduled for Wednesday and should be done this week but requires careful coordination in order not to break equipment and disrupt commissioning

XTDs

  • Progress on KMONO was unfortunately not reported as W. Freund was involved in tunnel search during the meeting. A. Koch shall ask W. Freund to put an update in the log book
  • A lot of work was done on XTD10 installations last week, e. g. cooling water connections, gas attenuator installation
  • Unfortunately, there is still a vacuum leak on top of the XSDU2 dump
  • Work shall continue during the next break week in August and during individual service day if the opportunity is given

 

SPB

  • Loops 5 & 12 are needed for the vacuum interlock. Hence cross-loop communication is needed. This requires additional testing
  • Loop 5 is deployed but misses 2 modules that are being modified
  • Loop 12 is not deployed and also requires that a few modules be modified
  • The goal is to get the interlock up during this week

FXE

  • The vacuum interlook will be deployed once the inter-loop communicationn has been tested in FXE
  • JJ worked all of last week to 
    • Fix a leak in a bellow
    • Exchange one pump controller
    • Rewire motors to conform to XFEL standards
    • Install diamond screens in the imagers
  • LPD was installed
  • There is still confusion about the CRL alignment: Are individual lenses misaligned or the whole stack? This information is needed to obtain the next security level clearance from D3

AE

  • AE will not attend the next meeting on Wednesday since there is a parallel event with MPS on the details of the interlock connections, in particular how to deal with the fast valves in the instrument hutches

CAS/ITDM

  • ITDM is currently working with highest priority on DAQ for LPD. Once this is integrated, DAQ for the tunnels will follow
  • Work on LPD DAQ is done in a separate KARABO "Topic" in order not to disrupt other work
  • There are ocnfusing statements of whether DAQ can deal with more than one topic per SASE in the long run...

Important topics for this week

  • Perform emergency off tests
  • Get LPD DAQ going
  • Integrate vacuum interlocks
  • Make KMONO available for SASE tuning
Entry   Status and Plans after 09:30 meeting, posted by Tobias Haas on 10 Jul 2017, 10:26 
 
ELOG V3.1.4-7c3fd00