Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Joint Operation and Readiness Logbook, Contact: T.Haas, A. Violante, G. Wellenreuther, Page 17 of 30  Not logged in ELOG logo
ID Date Author Locationdown Severity Subject
  279   07 Jun 2017, 11:43 Tobias HaasGeneralInformationStatus and plans after SASE1 Readiness Meeting

 General

  • Technicians from Actemium/JOWO arrived and found that a lot more connectors than originally estimated need to be replaced
  • Tests are finished in SPB Optics (40 connectors to be replaced) and continue now in FXE 
  • Replacing connectors starts tomorrow with 3 technicians and should take 45 minutes per connector 
  • There is an interference of connector replacement and tests of the interlock. This needs to be resolved.
  • Starting this week, new messages in the elog appear not to be sent to all registered users. (Info from J. Szuba: Some users intentionally or unintentionally un-subscribed)
  • WLAN access at the end of XTD9 is not very good and not sufficient for testing cameras, e. g. in PBLMs

XTDs

  • On the weekend the broker queue filled up. This was fixed using "extreme measures". This led to V0 closing and  BKR crew was not aware of the state of V0. It is the opinion of the experts that the BKR crew could have known but were not fully informed where to look
  • The motion loop was updated yesterday for PBLM tests. But the update was not complete and will be redone today before 12:00
  • PBLM tests with Mahadi and Natalia shall start after motion loop update
  • XTD9 will be closed on Thursday (not confirmed)
  • There has been a modification of the interlock conditions by RAUL for the gas section. This needs to be carefully checked.

FXE

  • Communication is now possible with the ion pump controllers but there is still an error message from the controller that cannot be interpreted. The manufacturer of the ion pumps (AGILENT) has been contacted
  • JJ XRay is here this week. They work on the patch boxes for the CRLs and the von Hamos Spectrometer
  • The LPD 2-tile system will be brought into the hutch today to test the controls
  • Commissioning on motors continues

SPB

  • Currently there is no working version of Karabo for SPB (Fixes were implemented that broke base functionality)
  • Loops 7 & 12 have not connectors affected by water and could be commissioned. AE was informed to provide firmware

Laser

  • The humidity in the hutch is down to 50%, but still oscillates
  • AE is fixing connectors with water problems
  • After PLC cycling the Beckhoff terminals loose the proper parameter set. This issue needs attention.

Software

  • Deployment of next KARABO version is postponed until the new version switching method is sufficiently tests. H. Sinn points out that this version (2.1.12) contains many urgent fixes and is needed asap.
  • The incident on the weekend showed again the need for the consolidated list of mandatory devices. This is being worked on 
  • The bug where the gui server looses track of the state of the system is still not fixed! If it occurs inform CAS immediately

 

  280   07 Jun 2017, 12:00 NEREA JARDONGeneralInformationMotion loop update

Dear all,

Due to some hardware changes needed in Motion loop, we will last a little bit more in the Motion update. You will loose communication but I will come back when it is running again.

Thank you and sorry for inconvenience.

 

  281   07 Jun 2017, 14:19 NEREA JARDONGeneralInformationMotion loop update

Dear all,

Motion loop is up and running again, now with all the PBLMs configured.

Thank you,

  282   08 Jun 2017, 08:24 Tobias HaasGeneralInformationXTD10 open
 Author: limberg, tischhauser
due to the cryogenic failure we will open XTD10 from 9am for working.
at XTL and XTD2/4 ZZ is possible for repairs/work.
  283   08 Jun 2017, 08:24 Harald SinnGeneralInformationXTD10 and XTD9 tunnel opening and closings

Dear all, 

according to the DESY logbook XTD10 will be opened today again: See DESY logbook entry:

'due to the cryogenic failure we will open XTD10 from 9am for working.
at XTL and XTD2/4 ZZ is possible for repairs/work.'

I don't know hoe severe the cryo failure is, but otherwise the agreement is that XTD9 will be closed Friday morning around 9am.

(I assume that they may close Friday morning also XTD10 again).

Best regards

Harald  

 

  284   09 Jun 2017, 12:41 Monica ArestéGeneralInformationStatus and plans after SASE1 Readiness Meeting

General

  • E. Boyd presents a summary of the next tasks for the radiation measurements for hutch commissioning. There are some dates (13th and 20th June) that safety needs exclusively access to the hutches. Safety will be in close contact with Instruments to agree the dates.
  • Tests are finished in SPB Optics (40 connectors to be replaced) and continue now in FXE.
  • There is an interference of connector replacement and tests of the interlock. If Instruments grant exclusively access for the Interlock works, this has to communicate to PSPO to inform company JOWO that is working in the cable reparations.
  • Starting this week, new messages in the elog appear not to be sent to all registered user. The system unsuscribed automatically from one elog when you suscribe to a new one. IT has already fixed this problem.
  • WLAN access at the end of XTD9 is not very good and not sufficient for testing cameras, e. g. in PBLMs

XTDs

  • Motion loop updated twice during this week, but there is still an issue with Elmo limits. AE will first test a solution and decide if a new update is necessary.
  • PBLM tests with Mahadi and Natalia shall start after motion loop update.
  • There has been a modification of the interlock conditions by RAUL for the gas section. This needs to be carefully checked.
  • There is a request to improve the information when the tunnels are open/close, now it takes too much time to find the information in the elog. Suggested to have a unique place with the information up-to-date.

FXE

  • There is a mistake in the channel assignment of the Ion pump controllers, modules BKF00074 and BKF00096 will be modified today. Moreover firmware for loops 1 and 2 have to be updated.
  • JJ XRay is here this week, acceptance test for CRL is done. Work will continue with von Hamos Spectrometer
  • The LPD 2-tile system brought into the hutch to test the controls.
  • Loop 8 already deployed.
  • Interlock defintion for FXE is done.

SPB

  • Currently there is no working version of Karabo for SPB (Fixes were implemented that broke base functionality)
  • EET is working to generate the exports for loops 7 and 12.
  • There are still some mismatches in the connectors of 11 cables, A. Legrand working with Actemium to fix the problems.
  • In loop2 one module is being reworked by AE.
  • SPB is also affected by the problem with the Ion pumps, AE to figure out which modules have to be reworked.

Laser

  • The humidity in the hutch is down to 50%, but still oscillates
  • AE is fixing connectors with water problems
  • After PLC cycling the Beckhoff terminals loose the proper parameter set. AE working on that issue but need soe additional information.
  • There is a mismatch beween the motors and trthe control, AE will check if it a firmware or hardware problem.

Detector

  • LPD test working succesfully, waiting when FXE hutch will be ready to move the LPD. Radiation protection has to be finished before to move the detector.

Software

  • Deployment of KARABO version 2.1.12 will be deployed today to FXE. D. Goeries shows a presentation with a description of improvements in the new version.

  285   09 Jun 2017, 19:09 Nicola CoppolaGeneralInformationInformation AE OCD June 9 -- 12

 AE/PLC on call service:

     Contact Person:

              Nicola Coppolla

    Phone:

   9 - 8040

  287   12 Jun 2017, 10:55 Monica ArestéGeneralInformationStatus and plans after SASE1 Readiness Meeting

Tunnel's schedule:

  • Monday 12th June:  XTD10 closed, XTD9 open
  • Tuesday 13th June: from 7:00 to 15:00 all open.
  • There is a request to have a unique place with updated information when the tunnels are open/closed, PSPO is working to set a place in the intranet and will inform as soon as this will be agreed.

General

  • Cable reparations on OPT hutch on going, FXE will follow.
  • WLAN access at the end of XTD9 is not very good and not sufficient for testing cameras, e. g. in PBLMs. ITDM re-cabled some ports and provided office network port in rack 1.17 that could be used to commission the cameras. According to Liuba it worked well.
  • From 08/06/2017 the ITDM group provides the OCD service. The general principle is that the 1st level support is provided by CAS group and in case they cannot solve the ITDM related issue they call us. The phone number for ITDM OCD is: 98070 or directly +49 175 9814494. There is a single number for 3 mobile phones so the number is valid independent on the person providing OCD.

XTDs

  • Motion loop updated twice during last week, but there is still a feature to be fixed.
  • There has been a modification of the interlock conditions by RAUL for the gas section. Already implemented and working.

FXE

  • There is a mistake in the channel assignment of the Ion pump controllers, modules BKF00074 and BKF00096 modified. Bug with the ion pump controllers still not corrected, AE and CAS are working on that.
  • Acceptance test for CRL is done, final parameters settled down, next step is to test CRL with PLC.
  • Loop 8 already deployed but still not working. This loop is low priority.
  • Radiation safety measurements are the first priority for this wwek in FXE.

SPB

  • Currently there is no working version of Karabo for SPB (Fixes were implemented that broke base functionality)
  • EET is working to generate the exports for loops 7 and 12. Export for loop 7 will take longer than expected acc. to last info from EET.
  • All motors in loop 1 are working.
  • In loop2 one module is being reworked by AE, still on going.
  • Firmware for Loop 3 is available.
  • SPB is also affected by the problem with the Ion pumps, modules BKF00056, 00057 affected. AE working to solve this issue.

Laser

  • After PLC cycling the Beckhoff terminals loose the proper parameter set. AE working on that issue but need some additional information from Laser group.
  • There is a mismatch beween the motors and the control, AE will check if it ia a firmware or hardware problem.

Software

  • Deployment of KARABO version 2.1.12 was deployed to FXE on Friday. The new version is deployed but not activated since there are some issues to fix.
  288   12 Jun 2017, 11:17 Monica ArestéGeneralInformationTunnel's schedule

Tunnel's schedule clarification:

  • Monday 12th June:  XTD10 closed, XTD9 open
  • Tuesday 13th June: from 7:00 to 15:00 all XTD9 and XTD10 open (all is incorrect, I mean XTD9 and XTD10).

Someone pointed out that XTD2 maintenance for tomorrow is cancelled and XTD2 wil be closed.

 

 

 

  289   12 Jun 2017, 13:21 Monica ArestéGeneralInformationTunnel's schedule updated

Last information is that tomorrow Fire brigade will come to inspect the tunnels, therefore all tunnels will be open from 7:00 to 15:00.

H. Sinn inform that XTD9 will not be searched until Wednesday morning.

Tunnel's schedule:

  • Monday 12th June:  XTD10 closed, XTD9 open
  • Tuesday 13th June: from 7:00 to 15:00 all open

 

  290   14 Jun 2017, 10:57 Monica ArestéGeneralInformationStatus and plans after SASE1 Readiness Meeting

General:

  • G. Wellenreuther has created a link to the first version of a central schedule of "our" tunnels: https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules
  • Any changes of schedules should be put in there first, and THEN a short message can be sent using the e-log pinpointing people always to this page. Please check correctnesss, and feel free to provide Gerd with any feedback.

 

XTDs

  • Minor problem with Ion pump controllers, AE working on it. 
  • Vacuum loop needs an update but it is not urgent.

FXE

  • Ion pumps controller issue already fixed.
  • Test of CRL with PLC is on going. There are some issues with encoders, could be a cable mismatch problem in PP, JJ to check. The cables for CRL have been already measured and are correct. 
  • Radiation safety measurements being doing today.

SPB

  • EET is working to generate the exports for loops 7 and 12. Export for loop7 will be ready this week and EET will continue with loop 12.
  • Tests with loop2 on going.
  • Firmware for Loop 3 is available, but cables have to be repaired.
  • Modules BKF00056, 00057 affected by Ion pumps issue already modified.To double check with N. Coppola if more modules are also affected by this problem.
  • Cameras are not in Karabo, this is a requirement before cameras can be connected. A. Silenzi to work on that.

Laser

  • After PLC cycling the Beckhoff terminals loose the proper parameter set. AE working on that issue but need some additional information from Laser group.
  • There is a mismatch beween the motors and the control, AE will check if it ia a firmware or hardware problem.

Diagnostics

  • External trigger not always working, CAS working to find the cause and provide a solution.

Software

 

  • Karabo version installed in a different domain, this will permit to fix errors. When this version will be ready, CAS will need 2 hours of downtime to implement.
  292   16 Jun 2017, 10:18 Monica ArestéGeneralInformationStatus and plans after SASE1 Readiness Meeting

General:

  • E. Boyd update the status about the tasks for radiation measurements the 26th June. See presentation attached.
  • J. Gruenert suggest to use similar interface as is being use for the machine and will send the link to G. Wellenreuther.

XTDs

  • Images for Photo commissioning on the tunnel are stored by a temporary solution. J. Grunert request when the DAS routines will work, CAS will prepare a short presentation for the meeting next Friday to show the progress on that issue.
  • This weekend is scheduled to commissioning with a WL of 1,5Å and 30 bunches into the dump for first time.

FXE

  • Radiation safety measures done last Wednesday.
  • Leaks in the Vacuum system already fixed.
  • Cables for motors already repaired by JOWO this week. Reparations will continue next week after urgent cables for SPB are done.
  • In general loops are working but there are still some minor issues, AE working in some loops updates.
  • Meting on Monday between FXE and AE to define Interlock to deploy.

SPB

  • Loop 1 is working, AE to fix some mismatchs in loops 2 and 3.
  • Export for loop 7 is done, AE is working to generate the firmware. EET has two persons working in the exports for loops 4 and 12.
  • Ion pump cables repaired and tests on going.
  • All connector reparations in the OPT-hutch are done and the test of the motors are on going.
  • JOWO will keep working in 20 urgent cables for SPB and then move back to FXE.

Detector

  • AGIPD is fully powered, there are still some issues for the Intelock that needs AE support.
  • More details see attached file provided by Detector Group.

Laser

  • The humidity in the hutch still oscillates, this shoud be fixed urgently since it is preventing further commissioning.
  • Image processor not working since each 2-3 hours stops, CAS to fix that issue.
  • There are motors not working, CAS to investigate.

Electronics

  • First priority is is to have the Vacuum system for FXE and SPB operational at the end of June. Next two weeks AE will be mainly focus in the loops that are still missing (SPB 4, 5, 7,12) or still not running (SPB 2, 3)
  • Elmo controllers not integrated, AE will test a solution in SPB on next week. If it works will be deployed also for the tunnels but this is not first priority and will be done in July.

Software

  • CAS is working to have a more robust system, S. Brockhauser point out that new request from instruments should we send to CAS to define priorities.
  • To prepare a short presentation for next Friday about the issue of the tunnel DAS to store images (see point in XTDs)
Attachment 1: Radiation_Measurments_for_Commissioning.pptx
Attachment 2: 20170615-Components-Detectors.xlsx
  293   16 Jun 2017, 18:12 Jan GrünertGeneralInformationWP74 OCD plan update
The WP74 OCD plan is also published in WP74-Alfresco and sent by email to HR/WoCo/STGL.
Please note that this plan could be subject to changes depending on the needs of the involved colleagues (e.g. if they want to swap OCD assignments).
The actually performed OCD-times are reported to HR at the start of each following month.

Attachment 1: WP74-OCD-plan-6-8-2017.xlsx
  294   19 Jun 2017, 10:17 Monica ArestéGeneralInformationStatus and plans after SASE1 Readiness Meeting

XTDs:

  • There are no major issues, commissioning works smoothly this weekend.

FXE:

  • Radiation safety measures done last Wednesday.
  • Tests with CRL are on going but there are some problems with motors since are moving only in one direction. CAS is working on that issue.
  • Loop1 need an update, support from AE necessary.
  • Interlock conditions meeting to be held today, to carry out  the test end this week.

SPB:

  • Test with loop2 continue.
  • Cables for Loop3 will be repaired today and tomorrow. Firmware already available.
  • Export for loop 7 is done, AE is working to generate the firmware. EET has two persons working in the exports for loops 4 and 12.
  • Interlock conditions already defined by SPB sometime ago.

Diagnostics:

  • External trigger for Basler cameras still not always working, CAS keep working on that.

 

Electronics:

  • Today and tomorrow working for the AGIPD, required an additional interlock part for the Vacuum.
  • First priority is is to have the Vacuum system for FXE and SPB operational at the end of June. Next two weeks AE will be mainly focus in the loops that are still missing (SPB 4, 5, 7,12) or still not running (SPB 2, 3)

 

Software:

  • Karabo version installed in a different domain, CAS is still testing ths version to ensure a smooth transition from one version to other.
  296   21 Jun 2017, 10:21 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

XTDs:

  • DESY requests the KMONO to be commissioned since the K Values of the undulators appear not to be as accurately calibrated as originally advertised. Management decided to put KMONO at the top of the priority list for this reason. W. Freund should work together with Mahadi and Nerea on getting the two goniometer motors (ELMO controller) working. When software is ready a ZZ access should be requested
  • Latency of FEL imager is ~ 5s which is a problem for tuning and scans. M. Messerschmitt is looking into this. A. Silenzi was not aware of the problem up to now.

Radiation Safety Tests:

  • Radidation safety tests are scheduled for 26 - 28 June. Proposed order is SPB Optics, FXE instrument, SPB instrument. Detailed plans to be discussed in a dedicate meeting on Thursday and plans to be presented in the Friday TC meeting
  • Vacuum interlocks will not be implemented before the rad safety tests and vacuum will be operated completely in manual mode
  • Open topic: Can the instruments use the beam after the rad safety test are done and how is the procedure?
  • SRP needs to make precise statements about where people can/should be during the rad safety tests

FXE:

  • Ready for radiation safety tests.

SPB:

  • Tested motors in loop3
  • Tested valves in loops 2&3

Electronics:

  • Concentrating on getting KMONO going in the next days

Software:

  • No special topic
  297   21 Jun 2017, 14:13 Gerd WellenreutherGeneralInformationTunnel access schedule updated

Dear all,

I extended the tunnel access schedule up to the beginning of the shutdown (3.7.). As always, you can find it under https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules

Access request to Harald Sinn. Works during the shutdown have to be reported to Harald Sinn and Dirk Nölle for scheduling.

Cheers, Gerd

  299   23 Jun 2017, 11:11 Tobias HaasGeneralInformationStatus and plans after SASE1 Readiness Meeting

General

  • A low intensity beam is being put into the SASE1 intrument hutches in this order: SPB Optics, FXE Instrument, SPB Instrument
  • No special precautions outside the hutches are needed due to the low intensity. 
  • The work will most likely not finish today. If necessary ti will continue next week Monday
  • From now on, access to the SPB Optics, SPB Instrument and FXE Instrument hutches requires these three safety trainings
    • General Safety (AllgSi)
    • XFEL Safety (SiXfel)
    • General Radiation Safety (StraSchu)
  • Check with SRP if you are not sure about yout status

XTDs

  • W. Freund and the AE colleagues successfully tested their firmware on the the KMONO in HERA-s. This will be integrated in the motion loop and a controlled access will be requested on Tuesday to try this out in XTD2

FXE, SPB:

  • Working in the hall to bring the beam into the hutches

Laser:

  • 90% of the hardware is installed on the tables
  • Humidity in the laser hutch still varies wildly, even after the humidity in XHEXP1 is below 60%
  • Humidity variations translate into a pointing instability of the seed laser which cannot go into the amplifier
  • There is a discrepancy between KARABO names and motor terminal names that needs to be cleaned up

Detectors

  • Interlock tests on AGIPD were successfull
  • The train builder is integrated
  • LPD is about to finish the tests in the X-ray chamber
  • Afterward the KARABO version needs to be updated 
  • Transport ot FXE is scheduled for week 27

Electronics:

  • Getting SPB and FXE ready for today's beam exercise required quite some short term effort
    • Mahadi had to get the cameras ready
    • Bruno had to set up the trigger timing
  • Implementation of the interlock conditions were delayed for the exercise of bringing the beam in. This should happen immediately afterwards together with the connection to the MPS system which is currently not present
  • The remaining problems with vacuum in SPB and FXE were solved (Some had to do with hw problems and wrongly wired controllers)
  • Work continues on bringing up more SPB loops. Most recently loop 4 was brought up and the firmware for loop 7 is prepared for tests
  • Implementation of the interlock conditions were delayed for the exercise of bringing the beam in. This should happen immediately afterwards
  • The work on KMONO delays some of the instrument work

Software:

  • CAS is currently working with high priority together with ITDM to get the DAQ system and archiving up 
  • There was a dedicated SQUAD for this purpose
  • The functionality has already been tested successfully on the LPD detector.
  • The interface needs work to become usable
  • Tests of full scalabiity are still outstanding
  • The system needs to be deployed in the real environment
  • It is estimated that the remaining work should take ca 3 - 4 weeks

 

  300   26 Jun 2017, 10:57 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

General:

  • ​Beam was brought to all SASE1 hutches on Friday. Beam was available to both instruments splitting it with M3 until Sunday morning. Afterwards SASE tuning was done and the beam should be back in the hutches some time today. Beam operation will continue this week with very low intensity. Split beam operation to both instruments.
  • Rules as follows:
    • Only one bunch and very low intensity (< 100uJ)
    • Mechanical manipulation on vacuum parts only when shutter and all-metal gate valve are closed
    • Shutter and gate valve closed when instrument people are not in attendance
  • CAS appears to be in a 2 day workshop from 9 - 5. This is a problem as some urgent work is needed. 

XTDs

  • No access for KMONO commissioning this week
  • All preparations that can be done for KMONO operation should be done however
  • M. Messerschmitt prepares interface for the FEL imager to DOOCS so that KMONO can be used for tuning

SPB

  • A list with essential components has been prepared
  • It appears that some of the previously brought up loops contain only vacuum components. This should be fixed
  • Loops 5 and 12 are needed most urgently now. 
  • 5 additional servers are needed from CAS

FXE

  • No remarks from FXE
  301   26 Jun 2017, 15:52 Gerd WellenreutherGeneralInformationTunnel access schedule updated

Dear all,

I tried to update the TAS to include the times for each XTD during the shutdown-week at the beginning of July. It is currently not entirely clear when XTD9 and XTD10 will be searched, and as always this is subject to change...

Link to Tunnel Access Schedule

Cheers, Gerd

  302   27 Jun 2017, 10:26 Gerd WellenreutherGeneralInformationTunnel access schedule updated

Dear all,

according to Dirk Nölle access to XTD4 during the shutdown will be extended until Thursday.

Link to Tunnel Access Schedule

Cheers, Gerd

ELOG V3.1.4-7c3fd00