Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Joint Operation and Readiness Logbook, Contact: T.Haas, A. Violante, G. Wellenreuther, Page 12 of 29  Not logged in ELOG logo
New entries since:Thu Jan 1 01:00:00 1970
Entry   Office network in XTD10, posted by Krzysztof Wrona on 17 Aug 2017, 07:59 

Dear All,

In XTD10 there are now office network ports available in each rack. These can be used to connect your regular laptops with a network cable without special configuration and registration of your laptop.

The list of racks and corresponding port numbers is listed below. Please, note that in lead racks (3.4, 3.7, and 3.13) you need to plug the cable directly to the office switch port 24. This port is located in the bottom row, most to the right.

Rack3.1        

116.732

Rack3.2        

116.741

Rack3.3        

116.755

Rack3.4        

switch: SW-HH-AL-285 port: 24(last, bottom row)

Rack3.5        

116.762

Rack3.6        

116.877

Rack3.7

switch: SW-HH-AL-286 port 24 (last, bottom row)

Rack3.8        

116.885

Rack3.9        

116.891

Rack3.10

116.895

Rack3.11

116.903

Rack3.12

116.909

Rack3.13

Switch SW-HH-AL-287 port 24 (last, bottom row)

Rack3.14

117.021

Rack3.15

117.032

 

Entry   Status and plans after SASE1/3 Readiness Meeting, posted by Tobias Haas on 11 Aug 2017, 10:07 

General

  • The focus of activities next week for the AE and vacuum groups is on getting as much done in XTD10 as possible. There is a conflict with the aim to bring AGIPD to SPB and start commissioning. A lot of preparatory work was done for the latter this week already. Nevertheless this conflict needs to be monitored carefully. There will be a daily stand up meeting at 11:30 in front of the MCR to monitor the ongoing work. The SASE1 displatch meetings on Monday and Wednesday at 09:30 are correspondingly cancelled

FXE

  • Philipp Lang reported on the status of the LPD commissioning. The detector is essentially ready to take data with 14 out of 16 super modules on the weekend. A few software issues remain but should not stop the activities.
  • FXE is working on commissioning their greateyes camera 
  • Loop 7 needed to be re-worked for the van Hamos spectrometer
  • Work is stil required for the Alio stage in the monochromater in XTD9. This will probably not be ready for first user operation.
  • During the shutdown week work will focus on getting the instrument laser hutch going with the Tangerine laser. After the XFEL beam is back, first pump-probe experiments should be possible
  • This afternoon radiation safety tests with 30 bunches and different materials shall take place

SPB

  • One SmarACT motor is now running. The problem was identified as a combination of a connection and a Karabo issue
  • The next step is to reconnect the remaining motors correctly and then all SmarACT motors should be operational (The firmware is set up for all)
  • Updates need to be done for loop 5 (AGIPD chiller) and loop 7 (interlock). Since this can only be done after 1500 once the sample chamber is vented, this work was postponed to Monday
  • SPB also provided an updated priority list to AE in order to fine tune the remaining work until user operation 

Detectors

  • Moving AGIPD will start early on Monday and the detector shall arrive in SPB around lunch time
  • Immediate works shall be mechanical, connection of vacuum, chillers, power and cooling. 
  • A. Sztuk points out that the integration plan from SPB is very optimistic

Tunnels

  • The goal of next week is to get the vacuum and the imagers into the PLC and eventually KARABO controls
  • Detailed schedule planning was unfortunately stopped yesterday due to the fire next door but will be done today
  • There is a scheduled power outage next week in the tunnels. Here is the respective email with information.
  • The problem with the fast valves in SASE1 (spurious trips of the interlock) has not re-occured after the controllers were exchanged. They have been sent to the manufacturer

Laser

  • Progress was set back last week due to un-announced work on the 11 C cooling circuit. This necessitated a re-alignment of the lasers
  • Otherwise commissioning work in SASE1 is progressing

Electronics

  • The points discussed are included with the affected groups

Software

  • The storage for images from the cameras in the tunnels was changed due to a disk space crisis. Currently 150TB are available. This should be enough for some time
  • CAS support for XTD10 work is need only after Thursday next week once the PLC work is done
  • Karabo 2.1.14 was released. Currently 2.1.13 is deployed.
  • Currently the data from LPD cannot be archived. Work on this topic was stopped yesterday due to the fire. Should happend today
Entry   Status and Plans after 09:30 meeting, posted by Tobias Haas on 09 Aug 2017, 10:23 

General

  • Main focus for Vacuum Group and AE next week will be to get as much done in XTD10/SASE3 as possible. Conflicts with activities in SASE1 need to be carefully monitored

SPB

  • SMARAGD motors are still not working even though one of them worked once. Mahadi/AE is focussing on this problem. It should be solved asap
  • Focus should be on loops 11 and 13. Loop 8 has lower priority at the moment. Loop 11 is urgently needed for the laser

  • A vacuum event occured last night. Currently some parts of the instrument vacuum are at 10-3 mbar.

Tunnels

  • There is an issue with disk quotas for storing camera images. This is due to the fact that the DAQ system is not implemented for the tunnel components and an interim solution is being used.
  • The focus of the DAQ activities is on AGIPD and LPD

DAQ Tests

  • Tests with LPD achieved recording 10000 trains. Performance is still limited when many images (>300) are being stored per train. 
  • Currently data is not yet stored on gpfs but recorded on disks locally
Entry   KARABO 2.1.13, posted by wajid ehsan on 08 Aug 2017, 15:25 

The system is up and running.

Regards,

Wajid 

Entry   KARABO 2.1.13, posted by wajid ehsan on 08 Aug 2017, 13:10 

As previously announced we will deploy KARABO 2.1.13 in tunnel under topic SA1. The system will go down in 10 mins. I will announce it again as soon the system is up again.

Regards,

Wajid Ehsan

Entry   Radiaiton Measurements Complete for SASE 1, posted by Eric Boyd on 07 Aug 2017, 18:30 

Radiaiton Measurements are complete for SASE 1 Normal access is restored.

 

Entry   Status after 9:30 disptach meeting, posted by Monica Aresté on 07 Aug 2017, 12:45 

General

  • The Radiation measurement test will be postponed until the beam reach the 30 bunches.

 

SPB

  • Problem with Smaract motors has been identified. Loop 12 updated and working fine.

  • SPB working to focus the CRL, it works but beam is not stable.

  • Vacuum interlock for Loop 5 (AGIPD) is being implemented. Interlock definitions for AGIPD under discussion with AE, this is still on going.

  • Export for Loop13 updated due to a reorganizattion of the modules into the rack. Firmware will follow.

  • Export for Loop 8 still missing.

Tunnels

  • Images are displayed later, this issue was discussed off-line with CAS. This issue has been fixed for one camera and it works, now will be deployed for the rest. Will be necessary 15min. of downtime to deploy, CAS to coordinate with Control room.

AE

  • SPB Loop 5 thre are some issues with Julabo Chiller, AE contacted the manufacturer for information, still working on this.

  • SPB Loop 13 - Phase 2 cables for some modules are at different positions compared to eplans. Change request submitted  to swap module positions. 

  • Loop 8 should be the next, EET  to clarify if the export is done and provide to AE.

  • AE ask to define priorities for next week since they will have to work in SASE3 tunnels but threre are still many issues form SASE1 on going (Firmware, AGIPD..).

CAS

  • 2.1.13 Karabo version update is being agreed with the interested parties. Implementation will be next Tuesday 8.08.2017 in the afernoon. It takes approx. 3 hrs. 

Entry   Time Schedule change in Radiation Measurements for Monday, posted by Eric Boyd on 04 Aug 2017, 15:24 

Dear All,

We have just changed the time that the Radiation Protection Measurements will take place on Monday. This will now begin at 15:00. The time has been pushed back so that the DESY Radiation Protection group will be able to also be there.

I will inform you if anything changes.

Entry   Radiation Measurements of FXE Monday 07.08, posted by Eric Boyd on 04 Aug 2017, 13:41 Restricted_areas_for_FXE_EXP_measurments.pptx

The control room thinks that they will be able to very easily provide us the desired parameters for commissioning  the FXE EXP Hutch this coming Monday. If that is the case we will be restricting access in SASE 1 in accordance to the attached presentation from 8:00 am until completion of the radiation measurements. A SASE 1 log book entry will be made when restrictions go into effect and are lifted.

We should find out Sunday evening from the control room if they don't think they can provide us with the proper parameters. If this happens I will send out an email informing you that the measurements have been canceled.  If you don't receive an email from me Sunday evening, assume that the measurements will be taking place beginning at 8:00 on Monday morning and will be in effect for most of the day.

Sorry for the short notice.

Entry   No Radiation Measurements in SASE 1 This week, posted by Eric Boyd on 03 Aug 2017, 10:52 

Do to repairs that need to be made with the cold compressor. We will be unable to perform Radiation Hutch Commissioning for SASE 1 this week. We will attempt to reschedule the Measurments for Thursday or Friday (10.08 or 11.08) of next week, depending on if it can be coordinated with all involved parties.

There is no restricted access to SASE 1 until then.

Entry   Status after 9:30 dispatch Meeting, posted by Monica Aresté on 02 Aug 2017, 10:17 

General

  • This Thursday the radiation test in D.05 (FXE) will be performed (from approximately 0900 to 1500), access to all areas adjacent to the hutch is only allowed by those that are assisting with the measurements.

  • Meeting on Friday is cancelled. We will meet again on Monday 7-08-2017.

FXE

  • Gotthard detectors to be tested in Karabo. On going.
  • Finished commissioning of OGT2_CRL and OGT1_ATT. The laser to be used in September installed and connected to electronics.

SPB

  • Problem with Smaract motors has been identified. Loop 12 updated, full test still on going.

  • Cameras trigger for the sample environment is now working. Software issues, CAS is addressing that. 

  • Vacuum interlock for Loop 5 (AGIPD) is being implemented. Interlock definitions for AGIPD under discussion with AE to continue work on this loop.

  • Working in the commissioning of Loop13.

Tunnels

  • In case of fake triggering of the fast valves, there is now a procedure to open them again remotely. Please check the related entry posted by M. Dommach.

  • Two issues with photonic cameras already solved by CAS.

  • Images are displayed later, this issue will be discussed off-line with CAS.

AE

  • FXE Interlock definitions have been changed and this reflects in the update of loop 1 and 2. Done.

  • Working on Alio Stages integration for Mono in the tunnel. Developing. 

  • SPB Loop 12 – Smaract motors and ELMO controllers implementation done.

  • SPB Loop 5 thre are some issues with Julabo Chiller, AE contacted the manufacturer for information.

  • SPB Loop 13 - Phase 2 cables for some modules are at different positions compared to eplans. Change request submitted  to swap module postions. 

  • Cables for interface to Person Interlock laid. Connections to the MPS system to be done this week.

  • Loop 8 should be the next, EET  to clarify if the export is done and provide to AE.

DET

  • LPD – Synchronization is still showing problems, this is delaying the tests.

  • AGIPD – Detector being tested in Hera south. KWrona started the tests of DAQ, some minor issues arised but in general it works.

CAS

  • 2.1.13 Karabo version update is being agreed with the interested parties. Implementation will be next Tuesday 8.08.2017 in the afernoon. It takes approx. 3 hrs. 

  • CAS will send around a list with the tasks foreseen to be solved during the next weeks.

Entry   Status after 9.30 dispatch Meeting, posted by Adriano Violante on 31 Jul 2017, 11:58 

General

  • SRP was not able to measure any radiation even inside D.09 and D.02. This Thursday the radiation test in D.05 (FXE) will be performed. 

  • Tomorrow XTD9 open 7:00 ==>14:00

FXE

  • Gotthard detectors to be tested in Karabo

SPB

  • Problem with Smaract motors has been identified. Loop to be updated. 

  • Cameras trigger for the sample environment is now working. Software issues.  CAS is addressing that. 

  • Vacuum interlock for Loop 5 (AGIPD) is being implemented. There will be a meeting soon (today?) with AE to check the interlock definitions for AGIPD and continue work on this loop.

  • Focus characterization with CRLs ongoing. Beam size reached: <10 um

 

  • Tunnels

  • Fast valve fake triggering has not been reported in the last week end. 

  • In case of fake triggering of the fast valves, there is now a procedure to open them again remotely. Please check the related entry posted by M. Dommach.

  • Some problems with the cameras that stopped working have been reported by A. Koch. That could be just a matter of restarting the GUI. To be checked.

AE

  • FXE Interlock definitions have been changed and this reflects in the update of loop 1 and 2. Ongoing.

  • Working on Alio Stages integration for Mono in the tunnel. To start this week. 

  • SPB Loop 12 – Smaract motors and ELMO controllers implementation ongoing

  • SPB Loop 5 is up including the AGIPD related systems. AGIPD interlock will be added once low level tests done

  • SPB Loop 13 - Phase 2 cables for some modules are at different positions compared to eplans. SPB wants to leave it and rather swap module positions and hand in a change request.

  • Cables for interface to Person Interlock laid. Connections to the MPS system to be done this week.

  • DET

  • LPD – Time server was set up. Images collected from 1 quadrant. Firmware upgrade for the other quadrants ongoing. 

  • AGIPD – Detector being tested in Hera south. KWrona will start the tests of DAQ in Hera today or tomorrow.

     

    CAS

  • 2.1.13 Karabo version update is being agreed with the interested parties. It takes approx. 1-3 hrs. 

Entry   Tunnel access schedule updated, posted by Gerd Wellenreuther on 30 Jul 2017, 23:04 

Dear all,

on Tuesday, XTD9 will be accessible from 7:00 - 14:00, due to requests by Naresh and Konrad. I updated the TAS:

https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules

Cheers, Gerd

Entry   Status and plans after SASE 1/3 Readiness Meeting, posted by Frederike Wittmaack on 28 Jul 2017, 11:50 

General

  • The radiation test in SASE1 could not take place yesterday since the machine was not able to deliver proper light intensity with 30 bunches. Another tentative is happening now.

  • Instrument commissioning during the weekend

  • Monday - Wednesday next week will be machine development time. XTD 9 will be accessible on request. Please contact M. Dommach. XTD 10 is foreseen to be close.

     

    SPB

  • After tests Smaragd motors are not working. Under investigation with AE/CAS

  • Cameras trigger for the sample environment is not working. AE has been made aware of that during the meeting. Ongoing checks.

  • Vacuum interlock for Loop 5 (AGIPD) is being implemented. This has to be done before the detector installation (foreseen beginning of August).

  • Freezing and delays of the GUI are being experienced. CAS ticket has been sent. This has to be addressed as soon as possible in view of the instrument commissioning time during the week end.

     

    Tunnels

  • Fast valve fake triggering has not been solved. After tests the suspect was on the controller side. Controller has been replaced but the issue has not been completely fixed. Investigation ongoing. Valves are ACTIVE regardless.

  • In case of fake triggering of the fast valves, there is now a procedure to open them again remotely. Please check the related entry posted by M. Dommach.

  • XTD10 – progress in the last 2 days have been achieved concerning closing of vacuum gaps and leaks testing

  • XTD6 – Vacuum connections ongoing.

     

    AE

  • FXE Interlock deployed and under tests.

  • Working on Alio Stages integration for Mono in the tunnel. The goal is to have it ready by the end of August.

  • SPB Loop 12 – Smaragd motors and ELMO controllers implementation ongoing

  • SPB Loop 5 is up including the AGIPD related systems. AGIPD interlock will be added once low level tests done

  • SPB Loop 13 - Phase 2 cables for some modules are at different positions compared to eplans. SPB wants to leave it and rather swap module positions and hand in a change request.

  • Cables for interface to Person Interlock laid. Connections to the MPS system to be done next week.

  • SASE3 Tunnel - Work started on PLC projects. There is the need for accurate schematics and a list of priorities in order to plan and prepare the shutdown week.

  • SASE3 Instruments – AE will start the installation of components ion the racks soon (Mid Aug. after network cables are finished in the PLC related racks).

  • General remark  - Do not leave cables in tunnels disconnected after having worked!

     

    DET

  • LPD – Trigger problems solved. DAQ tests to continue

  • AGIPD – Detector being tested in Hera south. As soon as the important issues concerning DAQ have been solved in Hera south (time allocated next week for that). The decision to move it to the SPB hutch can be taken. Schedule may be slightly affected, depending of the test results in HERA.

     

    CAS

  • 2.1.13 Karabo version has been presented yesterday

  • Scan tool measurement presentation today at the Mock-up control room

 

Next week NO SASE1/3 Readiness meeting!

Entry   No Restricted Areas for Radiation Commissioning, posted by Eric Boyd on 28 Jul 2017, 11:10 

Desired parameters where reached for radiation measurments of the SPB OPT and SPB EXP hutches. Radiaiton could not be detected inside the hutch with the beam shutters open and beam verified hitting the target, therefore it was not deemed necessary to take radiation measurments outside the hutches. As a result there are no additional access restrictions in SASE 1.

 

Entry   Restricted areas Durring Radiation Measurements of SASE 1, Friday 28.07, posted by Eric Boyd on 27 Jul 2017, 15:42 Restricted_areas_for_measurments.pptx

No radiation measurements have taken place today (27.07) due to insufficent energy of the machine. We think we can achive the desired energy by tomorrow morning at which time the SRP group will attemtp to commission both the SPB OPT and SPB EXP hutch. The attached presentation shows the new expected time schedule.

A log book entry will be made when area restriction goes into affect and when it is lifted.

Entry   Fast valves in XTD9, posted by Martin Dommach on 26 Jul 2017, 18:04 

Dear all,

the problem with the fast valves XTD9 tripping randomly is still not fully understood but we exchanged the controllers for both valves and they now seem to be stable. The valves are set back to active mode again with 1*10^-6 mbar trigger level while vacuum pressure at the sensors is around 1*10^-8 mbar.

In case one of the valves closes again in the next time you can do the following:
1. check the ion pump pressure in the beamline to make sure that it’s not a real event (they should be in 10^-8 mbar range or better)
2. If it’s not a real vacuum inrush you can open the valve by pressing “Open" button followed by the “Reset” button (SPB: Karabo scene SA1_XTD2_VAC/V11030F or for FXE: SA1_XTD2_VAC/V12030F )
3. Open the adjacent gate valves which were triggered by the vacuum interlock and continue with beam operation
4. Please inform the vacuum group (vacuum@xfel.eu)
 
If opening the valve again does not help because it trips to often, the fast valve can be disabled:
1. Open the valve by pressing “Open” button
2. When the valve is open again, switch off the high voltage of both sensors
3. Please inform the vacuum group (vacuum@xfel.eu)
 
Best regards,
Martin
Entry   SPB - Loop 5 is back online, posted by Bernard Baranasic on 26 Jul 2017, 14:10 

SPB Loop 5 is back online:

- but without crate BKF00095-SPB_IRU_CHL (there is missmatch of hardware and documentation (investigation is ongoin)),

- pumps: PUMP_TURBO4, PUMP_TURBO5, PUMP_TURBO8, PUMP_ROOT_1, PUMP_ROOT_2 ,PUMP_ROOT_3 and IRU_VAC/PUMP_ROOT_1  are without serial connection

Interlock is inlcuded and ready for testing.

 

Best Regards,

Bernard

Entry   Status after 9.30 Meeting, posted by Adriano Violante on 26 Jul 2017, 10:35 

General

  • Today the machine is being prepared to lase with 30 bunches in order to allow the radiation measurements in SASE1 Exp. Hall on Thursday and Friday.
  • Today GUI will be down for a couple of minutes at 11.30 to allow modifications of the servers for bugs fixing.
  • Specific SASE1 areas will be off limits during the test, scheduled for    SPB OPT 27.07.17   12:00-16:00 ,  SPB EXP 28.07.17 9:00-15:00   and  FXE 03.08.17  9:00-15:00.  Please address Eric Boyd's presentation for details. A mail reminder will be also sent to notify the beginning and ending of the tests.
  • The machine will be running with 30 bunches during the test and with 1 bunch during the night. Since no EPS is implemented, screens and sensitive components need to be taken out during the 30 bunches operation.
  • New version of Karabo ready to be deployed. The time slot when this will happen will be discussed on Friday,
  • Screens controlled by Karabo cannot be read from DOOCS. The Karabo/DOOCS interface problems will be be addressed with high priority by CAS.

XTDs

  • Fast valve in XTD9 still has issues with noise. Issue will be addressed tomorrow with AE support.

FXE

  • The detector group is updating the firmware for the LPD to fix the trigger signal problems. A test on just 1 quadrant will be done today together with ITDM
  • Interlock implementation in Loop 1 ongoing.

SPB

  • Integration of the turbo pumps in  the VAC loop ongoing. Interlock possible.
  • Chiller control being included in Loop 5 - Crate has been modified this morning. Loop will be updated checking that this will not stop the turbo pumps.
  • SMARACT motors being implemented. First motor is ready to be tested today after hardware problems have been fixed.
  • Work on in vacuum interlock in SPB ongoing.
  • The ELMO controllers for the motors of the liquid jet manipulator in Loop 13 should be brought and ready by CW 32. AE working on that. 
Entry   Tunnel access schedule updated, posted by Gerd Wellenreuther on 25 Jul 2017, 13:26 

Dear all,

I had some minor updates of the TAS during the last days, please check again.

https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules&listViewLinkBack=true

Be reminded that there will be virtually no access to XTD2, XTD4 and XTD10 before the 14.8. shutdown, so plan your work accordingly. Access requests please to M. Dommach, cc T. Tschentscher.

Cheers, Gerd

ELOG V3.1.4-7c3fd00