Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Joint Operation and Readiness Logbook, Contact: T.Haas, A. Violante, G. Wellenreuther, Page 8 of 30  Not logged in ELOG logo
ID Date Author Location Severity Subjectdown
  463   29 Jan 2018, 14:51 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

SPB/SFX:

  • Problems with data loggers ==> no statements about the past.
  • Loop 5 upgraded
  • Alle the other Loops are not at the 100% of their potential but sufficient for the users.
  • Test on nkb mirror movement to be done.

 

XPO

  • In SASE3, 4 cameras have trigger problems. AE is working on that.
  • In SASE3, 4 cameras have accessibility problems. ITDM is working on that.

CAS SASE3 (C. Youngman):

  • Interlock for VAC, GAT and XGM loops are tested and OK
  • The rest is so far as it could go. For details refer to C. Youngman report.

ITDM:

  • Broken Linecard  replaced .
  • Update/switch for the gateway to the control network will happen in one late evening during this week. ITDM will write an entry in the logbook just before. 
  465   31 Jan 2018, 14:56 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

SPB/SFX:

  • Fixing of Karabo scenes ongoing
  • Loop 5 need to be updated after discussion with DET group (Jolanta Stuk)
  • A meeting with AE will take place today to discuss the synchronous movement of the mirrors motor. 
  • The test on the NKB chamber of the indipendent movement should take place. It has to be double checked that such motors are implemented in Karabo.

CAS SASE3 (C. Youngman):

  • SASE3 tunnels closing today at 14:00. All the critical tasks were done. 
  • The day before the first lasing, a ZZ access is strongly requested. The request will be discussed in the PSO meeting.

ITDM:

  • Tomorrow the DAQ will be available for the AGIPD. LPD to follow. The goal is to have SASE1 ready next week as a whole.
  501   09 Apr 2018, 14:25 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

General

Emergency off test in SPB is shifted. Date to be agreed on Friday. FXE test stays on 16.04. TS will confirm that.

MKK will shut down the cooling water for Tunnels and XHEXP1 on Thursday startin from 11:00 for maintenance purposes.

  1. Based on the information we have the intervention could last up to 2 hrs. UBrueggmann is trying to check whether is possible to limit the duration of the intervention to bunches of 45 min. This could avoid the shut down of the Turbo pumps.
  2. UBrueggmann is taking care of opening the rack doors in the tunnels (all of them!) and close them again when the water is back. 
  3. The experiments should take care of opening the doors of the racks in the rackrooms. Also the main door.
  4. AV will speak with the important groups involved and then send a summary e-mail to staff today afternoon.

 

SPB

  1. Detector z motion would be needed. AE checks the status of the crate
  2. Quadrant motion - Suggestion from AE is to perform tests and implement it in the next shutdown.
  3. MIrrors installation ongoing. NO ACCESS to D.02!!!!
  4. Laser Interlock/Rad. Saf. interlock issue still being investigated.  No news from SRP.

 

SASE2 -CYoungman

Goal is to stop the HW changes by the end of Wed. Thursday final loops and firmware will be updated. Both in SASE2 and 3.

 

  503   11 Apr 2018, 13:48 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

SPB

  1. Detector z motion would be needed. AE checks the status of the crate. still pending
  2. MIrrors installation ongoing. NO ACCESS to D.02!!!!
  3. Laser Interlock change of logic by K.Witt will be done on monday at 9:00
  4. Karabo update installation dates being agreed with CAS. Probably early next week.
  511   16 Apr 2018, 14:20 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

Summary of Karabo 2.2.3 deployment dates:

  • Karabo 2.2.3 deployed in SASE3 tunnels last friday ==> no major issues. DAQ can be deployed
  • Karabo in SASE2 Tunnels to be deployed today at 14:00
  • Karabo in SASE1 Tunnels to be deployed tomorrow at 08:00
  • Karabo in SPB/SFX experiment to be deployed today and tomorrow
  • Karabo in FXE experiment to be deployed on Wednesday

SPB

  • By tomorrow the mirror installation will be done.
  • It is not clear whether the AGIPD firmware has to be updated. To clarify with Jola when she is back. The info is important foe ITDM to plan the DAQ tests.
  • During the last users run it happened that a valve in XTD9 was closed but the beam did not trip. It is not clear why. Will be clarified with AE

AE

  • Timing servers update - this Thurdsay, starting at 14:00 for 1 hour the trigger and train id signals will be not available.

ITDM

  • Infiniband port fixing ongoing
  • GPFS bug to be fixed with a patch that should be issued on 24.04. To be checked whether it is still OK to install the patch or it is too late.

General

  • PSPO will ask HSinn for a detailed schedule concerning closing of the tunnels to fine tune the activities going on this week in the SASE2 and 3 tunnels
  513   18 Apr 2018, 13:43 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

SPB

  • Karabo has been deployed  without major  problems! 
  • Now PLCs update follows. Sample chamber's PLC will be updated next week due to ongoing tests until monday.
  • It is not clear whether the AGIPD firmware has to be updated. To clarify with Jola when she is back. The info is important foe ITDM to plan the DAQ tests. 
  • During the last users run it happened that a valve in XTD9 was closed but the beam did not trip. It is not clear why. Will be clarified with AE

AE

  • Timing servers update - this Thurdsay, starting at 14:00 for 1 hour the trigger and train id signals will be not available.
  • Updating PLCs for MPS in the tunnels 

ITDM

  • Network stability problems in SASE3 are understood and a workaroung is being implemented.

General

Closing time of the tunnels on monday still not clear. To be clarified by PSPO.

  515   23 Apr 2018, 15:35 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

SPB

  • Timing tool for optical laser installed
  • Sample chamber's PLC will be updated next week due to ongoing tests until monday. Pending.
  • It is not clear whether the AGIPD firmware has to be updated. To clarify with Jola when she is back. The info is important foe ITDM to plan the DAQ tests. Pending. 
  • During the last users run it happened that a valve in XTD9 was closed but the beam did not trip. It is not clear why. Will be clarified with AE. Pending.

AE

  • SASE2 EPS Loop running
  • Updating PLCs for MPS in the tunnels. The update was stopped last friday due to a problem with the on/off funcionality of some ion pumps. The problem was found and the fixing requires an update of the VAC loops whoch will be done in the next hours/days. In case the loop update is not possible due to specific requirements the problem can be bypassed in Karabo. 

 

General

On Wednesday the meeting will be held at 13:00. Starting from next monday it will go back to 9.30

  517   25 Apr 2018, 13:28 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

SPB

  • Loops update: 1-4+8 this week. 5-7 Wed. next week. 11-13 end next week.
  • Smaract motors for PAM are needed and Nerea is on it.
  • It is not clear whether the AGIPD firmware has to be updated. To clarify with Jola when she is back. The info is important foe ITDM to plan the DAQ tests. Jola sick until 1st week of May. To be seen then.
  • During the last users run it happened that a valve in XTD9 was closed but the beam did not trip. It is not clear why. Will be clarified with AE. Interlock definitions  have to be checked next week when HSinn is back. 
  • During the switch on of the detector many Karabo devices had a problem even if no error messages were displayed. The problems disappeared restarting the devices. The errors could not be reproduced. Ot top of that it is possible to collect data only from 15 modules out of 16. The one missing changes every time the device is restarted. ASilenzi on it. 
  • Technofoft motor with magnetic switches do not work. In the tunnel the same configuration works, Will be investigated by AE/CAS/SPB
  • Motors upstream move sometimes by themselves. Discussion ongoing between AE SPB and CAS. To be adressed offline.

XPD

  • Access  of XTD1 today @14:00 to fix some EPS switches
  • SASE2 firsta lasing should be tried this week end + monday. CAS support requested. ASIlenzi checks with CAS whether this is possible.

AE

  • SCS exp: first loop running. 2 creates missing but loop is up.
  • MPS connection tunnels SASE2 done

ITDM

  • Online storage update patch to be installed today. The system should remain online but in some cases one could have some downtime (1-2 hrs)
  • MPS connection tunnels SASE2 done.

General

On Wednesday the meeting will be held at 13:00. Starting from next monday it will go back to 9.30

  536   20 Jun 2018, 14:12 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

SASE1 Experiments

Due to the interlock PLCs reprogramming, the emergency off circuit will be triggered tomorrow and power cuts will occur. Due to that, the AGIPD in SPB is being put into a safety state. ITDM and AE are informed. FXE and Optical lasers were also informed. The order is: Experiment in a safe state==>PLCs switched off==>Servers switched off. 

SPB will put all the motors to zero position and the parameters will be saved by a script prepared by CAS (AS). 

Next week Mon-Wed the planned power cut will also occur. 

SCS

  • Control room being put into operation - New cables to arrive soon. AE addressing the so far known issues.

AE

  • SASE2 MOV2 loop is up.
  • Master timing will be down due to maintenance by DESY on Thursday, from 9:00 to 17:00

ITDM

  • GPFS ran out of space in the week end. ITDM/DET/CAS meeting tomorrow. Then the experiments will be presented a way to go.
  • On Monday we would like to replace the dns/dhcp server in the balcony room. In principle we have the secondary one working at DESY but experience shows everything gets slow and in particular Karabo may have big problems. Due to the power off in SASE1, this will be scheduled for monday afternoon.

CAS

  • Issues with DAQ observed. Conflict on data aggregators. This was found to be a typo in the DAQ code. Fixing of the DAQ required but the release of Karabo 2.2.4. can proceed.
  • Coordinated motion for SPB, SCS, SQS: Follow up tests by AE to be done this week.
  538   25 Jun 2018, 13:34 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

SPB

  • The power shutdown has been delayed to tomorrow and power is supposed to come back on Thursday at 12:00. Torsten Schen will send an E-mail to readiness when the power comes back on Thursday.
  • Pumps are in a safe state since they currently get external power.

AE

  • Loop 4 SQS up and running. New SASE3 loops being prepared.

ITDM

  • GPFS space issue. Meeting with the experiments on Thursday.
  • MID controls, timing and signals cables have to go through the drag chain (40 m). ITDM and AE will discuss the issue with MID to evalueate problems due to the cables length.

CAS

  • XTD6 closed tomorrow. This will generate some delay of the technical commissioning. 
  • Karabo 2.2.4. deployment schedule proposed by Hugo Santos with an entry in the ELOG this morning.
  539   27 Jun 2018, 14:55 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

SPB

  • Electronic and instrumentation will remain OFF until the electricity comes back tomorrow (will be announced by TS on the logbook)
  • MIrrors installation will start next week
  • Mirrors movement test to happen, then Loop 4 and 1 to be updated 
  • In order to make the calibration of the motors easier after the powering up, they should not be moved before.

SCS

  • New cables arrived. Testing ongoing.
  • Loop 1,2,3, up. 1 has to be updated. Coordination AE/MTeichmann ongoing
  • Loop4 and 5 being prepared by AE

AE

  • XTD6 DPS and MCP being commissioned.
  • SCS issues with Beckhoff modules being fixed.
  • AE and CAS to agree on interlock reset procedure. 

CAS

  • Karabo 2.2.4. will be deployed in the SASE3 tunnels tomorrow at 10:00. It will take approx. 2 hours. 
  541   02 Jul 2018, 14:03 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

Info about tunnels accessibility

concening the XTD10 + XTD2 situation: 

According to my information these two tunnels should be open and will be closed tomorrow at 15:00.

XTD10 will be opened again on Friday 8.00 and then stay open until next week latest until Thursday July12, afternoon (depending if Martin can find somebody to search). 

XTD6 + XTD1: as said before: It will be opened tomorrow at 8:00 and closed again at 15:00 

Both will be opened again on Friday. 

Concerning the interlock test in general, the old table from MPS is still valid (if you add the info that the tunnels are searched the previous working day after 15:00). 

 

SPB

  • MIrrors installation ongoing. Almost all the beamline is vented. Only exception being the AGIPD, that will be vented this eveving.
  • Mirrors movement test to happen AE to agree with SPB about a point in time.
  • Motor parameters could be retrieved after the power cut last week.

AE

  • Tunnel commissioning ongoing
  • SQS/SCS loops being prepared.

ITDM

This Wednesday the Maxwell cluster will be not available from 9 to 12 due to mainteinance.

CAS

  • Karabo 2.2.4. will be deployed in the SASE2 tunnels today. Control system will be down until 15:30. PLCs will keep running. 
  • Karabo 2.2.4 deployment date soe SPB will be agreed offline.
  542   04 Jul 2018, 14:47 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

SPB

  • Mirrors installation ongoing. Lid is open. Movements are being locally tested. Test of synch. motion with PLC to happen likely tomorrow.
  • AGIPD firmware being updated. On friday all the tests should be finished and on Monday the deployment of Karabo 2.2.4. could happen. 

AE

  • SCS support ongoing
  • SQS Loop 4 being prepared
  • New Interlock definitions are being / will be added for SASE1 and 3 
  • SASE3 VAC loop updated today
  • MPS plc has to be rebooted and the kernel has to be updated. The intervention will be done today between 16:00 and 17:00. No timing during the intervention. B. Fernandes will send a mail to the readiness mailing list before and after the completion of the work.

ITDM

  • Maxwell cluster foxing postponed until 15:00

CAS

  • An issue with the middle layer ofthe new release was found. Hotfix being developed and will be released today or tomorrow. NO ITDM migration affected.

 

 

  543   09 Jul 2018, 14:32 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

SPB

  • Mirrors installatiostarting now. Preliminary motion tests conducted last friday were successful. Still closed loop for encoders signal has to be implemented. AE will work on that.
  • AGIPD firmware updated. Remaining tests ongoing. New Karabo release will be deployed tomorrow.
  • Peltiers being tested. 

SQS

  • End to end tests procceding. Laser incoupling and NQS chambers being set up.
  • Loop 5 needed for next week.
  • M pot firmware issue is being adreesed by CAS
  • It is not possible to switch the ion pumps on and off remotely using Karabo. AE and CAS to look into that.

 

AE

  • SASE3 exp. Loops preparation ongoing
  • SPB Loop 4 update being prepared
  • SASE3 tunnels interlock definitions are being updated for some diagnostic component
  • SASE2 MID CRLs being tested.

 

CAS

  • SPB 2.2.4.1 Karabo update scheduled for tomorrow morning between 7 and 9.
  545   12 Jul 2018, 08:11 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

SPB

  • Mirrors being installed. Tests continue. Karabo updated.

AE

  • Works in the tunnels SASE3 and 2 continue
  • Works on the SASE3 experiment preparation continue

General

Works to ensure the redundant power for Racks in SASE3 have to be performed. A suitable date has to be found. PSPO will coordinate that.

 

  546   16 Jul 2018, 14:18 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

SPB

  • Mirrors installed. Lid closed.  Las vacuum connection will be closed today. Then the electronics can be connected. 
  • Mock up pulse picker system ready
  • Some crates in the tunnels will be switched on today after updates of the interlock definitions to be ready for photons.
  • Train on demand technique is currently being discussed by FXE with DESY. SPB should be also involved.

SCS

  • Some problems occur during the test of the PLCs, plus after firmware update new problems showed up. Patrick Gessler will organize a meeting with SCS and Bernard to improve the communication and identify the error sources.

SQS

  • Tests ongoing. No relevant issues so far.

ITDM

  • Working on new proposals format.

CAS

  • XTD 6 open until the end of September.
  • This week due to lack of resources by AE only the last slit and one PBLM will be commissioned. The rest will be done next week.
  547   18 Jul 2018, 13:51 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

CAS

  • 3 MID CRL motors in XTD6 need to be repaired. The work is being planned and the clean tent is being prepared.
  548   23 Jul 2018, 13:45 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 13:00

SPB

  • Controls for the pulse picker being prepared. High priority for SPB
  • Coordinated motion tests ongoing. High priority.
  • ATT motors need to be re checked in XTD9. The closing dates for the tunnels are not known excactly. SPB should phone BKR for the last information

SQS

  • Radiation safety test preparation ongoing. 
  • Loop 5 motors being tested.

 

CAS

  • in XTD6 the VAC loop applied labels for the max excursions of the bellows. 
  • PBLM commissioning ongoing
  • CRLs for MID to be repaired.

 

General

  • Starting from this Wednesday the dispatch meeting will be shifted back to 9:30.
  557   03 Sep 2018, 09:49 Gerd WellenreutherGeneralInformationStatus report after dispatch meeting 09.30

SPB / SFX:

  • Experiments are ongoing, users collected data on Sat. and Sun.
  • There have been issues with the detector/DAQ due to operator error
  • There have been issues with the sample delivery
  • There was an issue with the X-ray / Laser interlock systems on Saturday, which was fixed the same day.
  • Beam time was partially lost due to these issues...

FXE, SCS, SQS, MID, HED:

  • Did not attend
  • Support points pointed out it will be much more difficult if the instruments do not attend this meeting to provide support in-time
  • PSPO announced the Dispatch meeting will be discontinued if the instruments will not attend (it is not considered useful with just one instrument attending on a regular basis)

Detectors:

  • Server for calibration data died, ITDM and DESY are working to revive it, S. Hauf will bring it up again.

CAS:

  • CY will have the usual meeting regarding SASE2

AE:

  • PBLMs in SASE3 being integrated.
  • SmarAct stages for SQS are being brought up
  • Vacuum group + AE working on SASE3 interlock
  468   05 Feb 2018, 13:18 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

SPB

- MIrrors installation (2 horizontal mirrors) in D.02 has started 

 -Synch motion of mirrors will be tested with fake mirrors in D.09 as soon as the control is ready.

SASE3 - CYoungman

- After SASE3 tunnels were closed it was discovered that was not pobbile to set values of the massflow (GAT loop). This required a remote intervention (firmware) that was supposed to be fast and easy  but it was not, and this required work until friday evening. Current status is: The gas attenuator secion closed and in static vacuum since the shutdown of a turbo pump was required. The system is in asafe status.The issues are being analized and solved with experts right now.

-It is important to establish a procedure to set priorities for ZZ access. The issue will be brought up in the PSO meeting

ITDM

 

-AGIPD p[roject is OK. Jolanta will start taking data already today

 

ELOG V3.1.4-7c3fd00