Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Joint Operation and Readiness Logbook, Contact: T.Haas, A. Violante, G. Wellenreuther, Page 9 of 30  Not logged in ELOG logo
ID Date Author Location Severity Subjectdown
  469   07 Feb 2018, 09:47 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

SPB/SFX

- An AGIPD crate providing power broke down and has been fixed already by Kai-Eric Ballack. This delayed the data acquisition test planned by Jola. These are being done today.

 -Synch motion of mirrors will be tested with fake mirrors in D.09 as soon as the control is ready. Work is ongoing.

-First mirron in the SPB optics hutch will be installed today. 

- New Karabo release working smoothly so far.

FXE

- CRL in the tunnel being commissioned

 -Leak close to the diamond window being fixed. If everything goes fine ready for parasitic beam on Wed next week.

VAC

-Vacuum interlock tripped twice in the last 12 hours. Issue has to be clarified with CAS.

AE

-Reconfiguration of the SmarACT controllers between rotary and linear motion is being carried out. Marcin and Mahadi are the main players here.

ITDM

-Major safety update of the cluster has to be done. ITDM proposal is to do it next week. SPB and FXE opted for the early morning (between 8 and 10). Exact date will be announced by ITDM as soon as possible.

  471   12 Feb 2018, 10:03 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

SPB

  • During operation Karabo crashed. As soon as detector is being operated the problem appears. Fixing is still ongoing.
  • 2 mirrors in D.02 are being installed.
  • Test of the mirrors movements has been performed.

FXE

  • Debug of implemented devices ongoing
  • Diamond grating in XTD9 has to be moved out of the beam way manually (no remote controls implemented due to long lead time of required beckhoff teminals). Access requested for Wednesday.
  • Vac group will check whether beckhoff terminals are available to allow the remote control of the dimaond grating

 

Vacuum

  • During the weekend the XGM in SASE3 was damaged. Details still unknown. 

AE

  •  SASE2 XGM local test ongoing
  • GAT loop update in SASE3 being done.
  • Local checks in XTD10 on Wed.

 

ITDM

  •  Slow data acquisition issue affecting imagers: solved
  • One server died over the week end. ITDM notified only today.

 

 

 

  472   14 Feb 2018, 14:21 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

SPB

  • MIddle layer karabo devices are responsible for the det. Karabo problems. Issue being addressed.
  • 2 mirrors in D.02 installed.
  • Test of the mirrors movements is done.
  • Mirrors cooling bars being installed

Vacuum

  • SASE3: 
    • Spikes of the downstream DPS gauges are responsible for the interlocks tripping. Probable cause is related to the beckhoff terminals of the DPS (different from the other gauges). Ongoing.

XPD

  • Pop-in monitor filters in XTD10 being changed
  • Exit slit imager after Mono XTD10 has ot be commissioned and scintillator has to be put out of the beam way.

 

AE

  •  It can happena that some parameters cannot be set using Karabo due to lack of writing rights. A fix has been found but we would need to update all the loops. Since the problem is just occurring from time to time, AE asks to report specific cases for whoch a solution will be found. Same things happens with the re initialization of some devices. In this case the PLC crashes.
  • Timing device in XTD 2 stopped working. Will be fixed today either by remote re start or by local intervention.

 

ITDM

  • Broken server replaced
  • Tomorrow there will be an update of the cluster between 9:00 and 10:00. DAQ will be down.
  • Reboot of the online cluster needed. To be agreed with Detector group. 1 hour downtime also in this case.

CAS

  •  In SASE3, deployment of new (2.2.1) Karabo happened yesterday and seems stable, but brittle. Analysis of the reason ongoing.
  • Today GAT final fixes plus testing will be performed
  475   19 Feb 2018, 09:56 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

SPB

  • KB chamber being pumped down
    
  • interaction with AE is ognoing concerning update pf Loop 5 and AGIPD cooling procedure ongoing
  • Smaract commissioning ongoing
  • The goal is to be ready to start commissioning with beam on 01.03.
  • Slit Karabo middle layer - integtration and final fixing being finalized by A. SIlenzi
 FXE
  • DAQ test ongoing - fixing of bugs
  • After FXE has been moved into the new topic is not possible to read tunnel vacuum pressure anymore. Being discussed with CAS
  • Permission to use parasitic beam next week requested to the radiation safety group.

XPD

  • XGM in SASE3 requires physical intervention to be fixed. Access request for tomorrow.
  • DAQ groups definition ongoing and being clarified with ITDM

AE

  • PBLM moto problem was found to be due to a wrong Karabo-PLC linking. If the tunnel will be accessible tomorrow the issue will be solved. HSinn to decide on priority.
  • Soft mono commissioning started and AE support was required. It is not clear what priority does it have. Mahadi is anyway working on that today ad 14:00. If the intervention is found to require more time one has to see.

ITDM

  •  During the FXE DAQ tests many problems were found:
    • issues with digitizers
    • issues with scan
    • issues with images acquisition. In this case the problem has been identified (Train ID was 0). KWrona is in contact with CAS to fix the bug.

CAS

  • The issue reported by SPB about no data being read from AGIPD temperature sensors has been identified by Gero (CAS) and the fixing is ongoing. 

Report of the XTD10 interventions from last week - Tuesday and Wednesday - C. Youngman 

Many thanks to those who contribute to the "SA3 'further technical coordination push" onTuesday (no-beam XTD10 closed) and Wednesday (XTD10 open) mini-shutdown, below is brief summary. The status items were not highlighted during PSPO's readiness meeting AoB section but are useful to know. Those issues that were raised are contained in the conclusion section. 

We leave the SA3 beamline with a functioning interlock, but you should additionally watch and test your component and ensure that beam operation is possible.

The principle task on Tuesday was

  • for ITDM to shutdown and update f/w of the control server CPU hosts in the balcony room, and
  • for CAS to replace the Karabo 2.1.18, running since the Oct-Nov shutdown 2017, with Karabo 2.2.1 which is already running on the SA1 installation. 
    • A number of problems during the installation were addressed and a stable deployment was finally reached early in the evening.

The principle task on Wednesday were

  • test the updated GATT Ebara pump updated f/w and its s/w counterpart
  • test that GATT Bronkhorst Mass-Flow valve f/w worked: correcting conversion errors and the incorrect setting of property r/w attributes
  • test that GATT Inficon gauge f/w did not crash the loop and correct  conversion and r/w errors as with the the Mass-Flow valves
  • perform Beckhoff-local tests on one or more the DOD motor axes as they were expected to be wrongly wired (as seen in the Jan-Dec shutdown in the VSLIT)
  • update the s/w to reflect changes in the GATT f/w
  • address difference in the s/w introduced by the move to Karabo 2.2.1

The key-point task listed above have been attained with the following caveats:

  • There is a h/w fault which prevents the second Ebara pump being fully controllable remotely, it is currently locally controlled.
  • Bronkhorst f/w and s/w is usable, the conversion is correct, but additional s/w work is required to align the s/w
  • The Inficon f/w works (it does not crash the loop), the f/w conversion error is identified but not enough time was available to modify it.
  • some s/w issues remain which are being addressed (tagging of Ebara, Bronkhorst and Inficon s/w, correct configuration of the vacuum-section..)
  • the automatic update of project and scenes was not completely successful so project and scene owners should check and correct their scenes. The auto update procedure will be improved.
  • Some data logging information was lost, but e now have regained a standard implementation (not hot-fixed) which should improve the this.
  • After measuring that the DOD axes (1 of 10) were incorrectly wired it was concluded that all were incorrectly wired (as had been the VSLIT in the Dec-Jan shutdown)
    • Benoit and Daniele managed to rewire all 10 DOD axes during the mini shutdown and test 1 axis with Karabo.
  • PES tests of multi-board digitizer s/w and f/w were continued (with measurements at the crate), these are promising as 'raw' and 'processed' data are now concurrently available.

In conclusion - good progress was made and this type of 'commissioning' mini-shutdown (anything longer than ~4 hours which includes somebody elses longer ZZ) should be performed as often as possible.

This requires

  • that the photon run coordinator team know that there is a "list of task" to be performed which are not in the ZZ list
  • that a selection of these tasks can be performed within the time budget of a mini-shutdown and that these do not compromise SA3 tunnel operation
  • that the photon run coordinators inform the SA3 technical commissioning team (contact a member of the "SA3 tech coord" CAS team setup by Sandor, e.g. Chris, Valerii or Wajid ) so that they can organize the work in time (or report that they cannot as something or someone is not available).

During the next few days a "list-of-task" will be created. This could include technical commissioning actions for SA3: PBLM, ExitSlits, very end of beamline imagers where the status needs updating, etc.

Also remember that the CAS team tries hard to satisfy as many requests as possible, but prioritization will be done, so make your case thoroughly and don't expect it to simply happen (it has to be on the radar screen). In particular h/w, f/w and related s/w tests needing access will be done first and non-critical s/w work will be left until after tunnel closure. And remember to check your projects, scenes, and macros before you need them.

 

  477   21 Feb 2018, 10:55 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

SPB

  • KB chamber being pumped down
  • Smaract commissioning ongoing
  • Coordinate motion for VAC ready to be tested (probably tomorrow). It has to be agreed with Richard Bean
  • Clean-up slits Karabo middle layer deployed and working. - The same hase to be done for the power slits.
 FXE
  • DAQ test ongoing - fixing of bugs
  • After FXE has been moved into the new topic is not possible to read tunnel vacuum pressure anymore. Still the case.

 

  • XPD
  • XGM in SASE3 fixed (A turbo broke - replaced)
  • One exit slit Imager in XTD 10 commissioned

 

AE

  • PBLM moto problem was found to be due to a wrong Karabo-PLC linking. ==> FIXED
  • Soft mono commissioning started and AE support was required. DONE

ITDM

  •  Main problems with Train ID solved. Some problems still remain for some beckhoff loops in the tunnels==> AE on that.
  • Some way to document the change of data format for devices has and will be found by IDTM
  • Data source running for FXE. Changes have to be clearly communicated. 

CAS

  • Soft fix improving the GUI deployed. No 2.2.2 ready.
    
  • ​Issue with Karabo device returning the sensors data (e.g. cooling AGIPD) is being investigated. The Bug was found also in test environment but still random.
     

SASE3 - CY

  • GATT works
  • Inficon device to be improved (loop restart needed)
  • CAS will deliver a method to deal with the configuration changes asked by the experiments, redirecting the changes to the proper platform (Firmware (AE), Karabo...)
  481   28 Feb 2018, 10:55 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

SPB:

  • Ion pumps running in the Mirror chamber. Vacuum level OK to run.
  • D.02 is now interlocked and is a clean area.
  • Mahadi and Alessandro are setting up a test system for the coupled movement. The test will probably be done between the 2 users periods.
  • 2 hours of parasitic beam can be used today to check the alignment of the CRLs. The CRLs will be then moved out of the beam to allow the FXE radiation tests tomorrow.
  • Primary limits for coupled motion not included in E-plan, safety switches are implemented but SPB prefers to have the primary limits included. CSS crate to be modified after clarification with AE/EET.
  • Test of the karabo brigde will be performed with users. It is not yet clear exactly when since this needs synchronization with several groups involved (CAS, ITDM, DET). 

FXE:

  • Radiation test tomorrow
  • LPD test measurements in thhe WE
  • Von Hamos spectrometer alignment until monday

ITDM:

  • SASE1 and 3 have the last DAQ update now. Stable in SASE1 so far.
  • Data sources arrangement being worked out. Today a 45 min session is foreseen with SPB.
  • SPB needs slow data acquisition from 2 cameras for users, apart from AGIPD.

 

VAC/Detector/XPD/CAS: nobody attended

  483   05 Mar 2018, 11:07 Adriano ViolanteXHEXPInformationStatus report after dispatch meeting 09.30

 

SPB

  • Last night the beam disappeared between 4 and 8. 
  • AGIPD scene showed many problems, both concerning Karabo and Data preview. Detector is not operable.  To solve the issue a joint effort of all the groups involved, as well as the physical presence of experts during the shift is requested. 
  • CSS has to be moved out of the beam. As of now there are problems with cabling that need to be solved
  • Smaract stages are misbehaving. More support from AE (Mahadi) is requested
  • Status of the coordinated motion test was asked. Should be ongoing but the experts were not there.

FXE:

  • Testing fast intensity monitors and LPD 
  • DAQ worked very well
  • Scan tool must me tested
  • Correlation between LPD and fast intensity monitor is problematic due to train id problems. There is a new device to be deloyed on the XGM. Today or tomorrow will be seen whether this solves the issues.
  • BKR reported that the beam tripping was due to some FXE device close to the M3, but FXE is not aware of that. Info will be asked to Harald today during the PSO meeting.

 

Advanced Electronics (P. Gessler):

 

  • MCP HV problem in SASE3 - the power supply failed. The fixing shoud be done according to the priorities, Photon run coordinator decides.

 

ITDM (K. Wrona):

  • FXE slow data DAQ issues: these will be solved splitting the LPD slow data from the rest. small update of the software needed. 
  • Simultaneous acquisition from LPD and cameras is now available and working well.

 

Detectors (J. Sztuk-Dambietz, P. Lang):

  • AGIPD will operate with the old firmware due to problems with the new one
  • No calibration data available as of today
  • AGIPD is in a safe state

 

 

  485   07 Mar 2018, 11:14 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

SPB:

  • Monday morning Karabo failed. It was not possible to operate anything. Aftrer restart it took 2 hrs. to have the tunnel loop and Lopp 5 again operable . Other issues connected to that. CAS is on it.
  • AGIPD can be operated with some workaroung concerning the control system. No final fix available yet.
  • CSS can be operated locally.
  • Coordinated motion test probably on 14.03.

FXE:

  • IPM/XGM correlation data process ongoing. 
  • DAQ worked reliably
  • Scan tool operational for almost every component. Data storage works. Test ongoing.
  • PG points aout that no MPS definitions were given and no MPS is available for FXE yet. To be checked.

SQS

 

  • Corrdination of installations in the hutch with the TUV tests for Rad. Interlock needed.

 

SCS

 

  • Nothing ton report

ITDM:

  • FXE LPD slow data separation will be done today after the meeting
  • Some devices are setting the train id as "0". CAS is informed.

SASE3

MCP HV - Crate restarted. Now ok. There was a misconfiguration of Power/Karabo settings. This meeds to be avoided increasing the communication between people performin operations on the XPD components and the technical support groups.

AE

  • uTCA crate in SASE2 for timing being prepared, as well as PLC for VAC loop
  • Replacement of a uTCA crate in the balcony room for SASE2 needed
  487   12 Mar 2018, 13:18 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

SPB (Weinhausen):

  • During the night there was an interlock issue. The fast shutter was triggering the MPS interlock system. After several calls and request of support from SPB to the photon run coordinator and the machine run coordinator the problem was found and the interlock signal bypassed. This was due to some incomplete cabling of the fast valve. While this was knwe, after the last updated the correct configuration was not set up in the controlling PLC.
  • In general one has to note that the experiments do not have access to the MPS panels and there is no well established procedure when MPS interlocks are concerned. This will be reported in the PSO meeting.

FXE (Gawelda):

  • Before the beam shutdown FXE observed that the beam was very unstable.
  • 2 ion pumps went in error and the interlock was triggered. Again in this case is not clear who is responsible for the re setting of the interlock and the pumps.
  • Servers had to be restarted due to wrong train id after the cooling water accident
  • 0.5 MHz operation of the LPD successfully tested. 

SASE2 Tunnels (Youngman)

  • It is reported that the technical coordination of the necessary activities is missing.
  • A list of activities was sent by CYoungman to TTschentscher concerning SASE2 tunnels. In total 10 working days are needed to complete these tasks. This includes 1 week implementation and 1 week commissioning. Carefully planning with DESY is needed to avoid that the necessary 10 working days are scheduled around Easter, which will result in less effective days.

 

CAS (Santos)

  • HSantos is preparing a deployment plan for Karabo whoch includes the requirements and deadlines to be fulfilled by the other support groups (ITDM, DET, AE). The idea is to have this plan presented on Friday for discussion.

 

 

  488   14 Mar 2018, 10:06 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

SPB (Weinhausen/Round/Mancuso):

  • Again on the fast valve was triggering the MPS interlock system. For XRO was not completely clear what happened. for AE everything is clear and it depends on the wrong MPS configuration with respect to missingl cables. The will discuss this offline and eventually bring back the issue. Linked to this, it is reported that the MPS panel is difficult to decipher for the experiments...

 

  • FXE (Galler):
  • 2 ion pumps went in error and the interlock was triggered. Issue clarified.

 

SASE2 Tunnels (Youngman)

  • Access schedule sorted out. Works in the SASE2 tunnels will be carried out in the period 4-19.04 plus the week before Easter. Discussion with AE on the status of the loops ongoing.

AE (Jardon)

  • It is reported by SPB (March Messerschmidt) that people in the BKR are confused about MPS signal that they are getting from XFEL. The different lables assigned to the signals have to be sorted out and communicated. Nerea and Marc will try to start this clarification offiline.
  • GATT Loop in SASE3 will be updated today
  • Check of the inficon gauges ongoing- eventually update required.

ITDM (Wrona)

  • Lots of data (14 Tb) collected during the last SPB shift.
  • Issue concerning speed of offline data transfer reported by SPB
  • For the user runs in May data will need to be deleted from the offline cluster. A procedure has to be established to clearly communicate with GLs and User groups.
  • SASE3 IT installations have been handed over to XFEL. IT setup ongoing. Network will be available in the experiments by the end of the month.
  490   19 Mar 2018, 10:24 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

No new issues to be discussed where reported by any groups.

The status and issues reported on friday are still valid. 

  491   21 Mar 2018, 10:02 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

SPB

On monday there was an issue with a detector related PLC due to misconnection of one EtherCAT cable. The issue has been solved and it "just" resulted in 3 of hours delay in  the AGIPD calibration activity.

FXE, SCS, SQS, XPD, XRO,ITDM no issues reported

AE related

uTCA in XTD 6 are installed 

VAC-Related

Marc Messerchmidt reported  abouit an entry in the DESY Logbook about a pump that triggered the interlock in the SASE1 tunnels. According to Nerea this this seems to be related to the old issue already known. VAC group is working on that. 

 CAS

CYoungman is working on the priority list for the components in SASE2 tunnels. Double checking with HSinn happening soon.

Access for Tue/Wed next week to XTD1 will be requested by CY through HS

Beam is in SPB/FXE this week due to the HERCULES project.

  493   26 Mar 2018, 13:10 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

General

Due to the triggering of the emergency power off in FXE caused by electrical works being done on Sunday, FXE and SPB lost beam and electronics was switched off. In general the efficiency of the communication between groups has to be impoved. An important first step is the publication to a easy accessible site of the OCDs phone numbers list. PSPO will organize that.

Comment by PGessler

"It was clear to all, that currently the impact on operation due to emergency power off is severe, since the Racks with the PLC CPUs as well as the MicroTCA systems will be also switched off, what is not what was defined/specified. Therefore it was agreed, that no work on the power distribution/emergency off will be done until the defined date (for FXE 16th April). That work was done there nevertheless is extremely careless. The fact, that this was done on a Sunday and also during user time makes it even much worse then that.  It has to be completely followed up and made clear, that this is not acceptable and will not be repeated again!"

 

SPB

A run of 14 hrs acquiring data was a sort of stress test for the DAQ. It worked. ITDM would like to remove the data. Should be ok.

Due to the triggering of the emergency power off also SPB lost the beam. This was sort of strange since the power off signal was triggered in FXE. AE reported that this behavior is to be expected with the current configuration. This has to be discussed.

 

FXE

DAQ is recovering from the power off. 

Tripping of the interlock caused again by control unit of ion pumps in the week end. During the shutdown the responsible units will be replaced.

In general is is agreed to prepare an overview interlcok panel in the BKR. AE is on boat, CAS to be checked.

500 kHz operation is problematic for the machine due to heavy losses. They are only able to deliver 1 bunch at this rate. FXE will discuss this directly with the PRC (this week is Jan Gruenert)

 

AE related

Follow up to the issue of re-setting pumps after interlock is triggered: VAC and EPS loops need to be updated. HSinn was pushing to have it done as soon as possible without waiting for the shutdown. This is not riskless for the experiments. This will be discussed in a small round (AE, PRC, SPB, FXE)

ITDM

Due to the power outage many devices do not have proper train id. CAS should check it. Time servers also need to be checked.

FXE needs to use digitizers for the upcoming measurements session. These were not implemented in the DAQ. ITDM/FXE/CAS meeting needed to clarify and solve the issue .

 DET

LPD calibration had a problem but should be ok now. 

More supermodules coming.

Communication with upcoming userve concerning data format and other issue has to be improved according to the DET group. SPB suggests to tackle the issue offline.

  495   28 Mar 2018, 15:22 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

SPB

  • Sample delivery installed. Tonight will be commissioned. Experiment set-up starts tomorrow night

FXE

  • Digitizers were already implemented in the DAQ but there is an issue related to the Karabo device. CAS already looking into that.

AE

  • Follow up to the issue of re-setting pumps after interlock is triggered: loops updated. 
  • SASE2 MOV loop patched
  • Imagers in XTD1 have to be tested with Karabo

ITDM

  • On monday afternoon problems with the storage servers were reported. The issue is a defective board, whoch is meanwhile been deactivated. IBM is working on that. The system seems to be working in this state.

CAS

  • The next Karabo release will be able to handle better big loops. ASilenzi points out that the next update is really important since it adresses problems like the restart of time servers issue.

Readiness Meeting Issue list

  • Item 2 (XGM SASE3): After restarting of the CPP servers the XGM turbo pumps stopped, valves closed and it required a manual intervention to restore them. ==> Firmware updated. CLOSED

Operation Meeting Issuel List

  • Item 1 (Karabo rollout process): Testing steps of a new Karabo release have to be discussed with AE-ITDM-DET ==> Meeting took place. Closed
  520   30 Apr 2018, 09:51 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

CAS (C. Youngman)

Following the Technical commissioning phase for the SASE2 tunnel components, the need of a technical coordination activity is strongly pointed out. This is in particular important to make sure that the proper final tests are performed by the components owner  before e.g. first lasing attempts.

 

SQS (T. Baumann)

Lopp 1 being brought up. First tests to be started soon. The CAS and AE contact persons should be in involved in the tests as early as possible.

 

 

 

 

  521   02 May 2018, 11:17 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

SPB

  • After re-compiling the relative karabo device, the configuration procedure of the AGIPD is now smoothand reliable.
  • PLCs update ongoing. AGIPD is in a safe state to allow the PLC update.

SQS

  • Meeting today at 11:00 with AE, EET, CAS to define the next steps of the end to end tests.

AE

  • SASE2 tunnels - Only VAC conditions are transmitted from the EPS loop to the MPS. All the other conditions were supposed to be not necessary for first lasing and were not implemented. Nevertheless this was not clear for the people working in the BKR (especcially for diagnostics) during the last days. It has to be discussed with the PRC (H. Sinn this week) whether these have to be implemented on a short time. In pronciple AE can do it if requested. Otherwise the definitions will be implemented in the next shutdown.

ITDM

  • Failure of one IBM server for online storage. Thanks to the implemented redundancy this will not affect the operation. The performances have to be checked.   IBM has been contacted.
  • On monday evening ITDM OCD received a call from BKR because of some problems with the DAQ in the tunnels. It seems that this was due to the fact that the system was not properly tested by the "users" before. Seems to be solved now.
  522   07 May 2018, 10:36 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

SPB

  • Loops 5,7,11, update and Karabo deployed.
  • Loops 12,13,8 update ongoing.

SQS

  • Loop1 cabled up. Today the formware will be uploaded.
  • Loop 2 will probably be ready on Wednesday

SCS

  • Out ov 50 valves tested 5 showed problems. Investigation ongoing to understand where is the problem (PLC, Cables, Valves)
  • In Loop 2 a problem with a crate containing Elmo controlers was found. AE on it. Next loop to be tested will be Loop 4.
  • 1 crate does not have enough power to power up all the terminals. CR already prepared. Will be solved soon.

AE

  • By the middle of the week the valves will be included in the interlock systems (SASE1 issue)
  • The EPS interlock definitions for the tunnels in SASE2 are being finalized by AE, XPO, XPD

ITDM

  • Failure of one IBM server for online storage. Fixing ongoing.

DET

  • Online preview and charge injection issues are being solved restarting the DAQ and re-deployng Karabo.
  527   23 May 2018, 12:44 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

General

  • Please remember to send the list of the tasks you planned for the next shutdown to Monica Areste by the end of the week.
  • Please remember to send the list of the alignment works needed until July to Gerd Wellenreuther.

AE

SQS loop 3 is almost ready. 1 crate is currently in the AE lab but should be installed soon. The loop 3 is needed by SQS for the motor tests with FMB Oxford next week.

SQS

  • Due to a pump that stopped working (Caverion) this morning there was water on the floor of the laser hutch and part of the experiment hutch.  Some cables (not powered and packed) saw water. These are being checked. Also lasermet boxes on the wall saw water. Lasermet is checking that.
  • For the testing SQS requested the test box to AE 

SPB

  • Final DAQ test ongoing. Slow data acquisition OK. This is needed for the users program this week. Fast data acquisition (inc. AGIPD) will be tested next week.

ITDM

  • Patch released for Slow data acquisition FXE/SPB. LPD acquisition OK. AGIPD issues being investigated.

 

  528   28 May 2018, 10:28 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

General

  • For the upcoming emergency off test in SASE1 SPB and FXE should propose  a possible date in the next shutdown to be then discussed with AE.
  • The machine is down due to the failure of a cryocompressor. Beam will be probably coming back tomorrow morning. Tomorrow morning will be also confirmed whether SPB and FXE cold use the beamtime for the user run.

SPB

  • In the week end there was a failure of the PP laser shutter. It was possible to find a very temporary solution to circumvent the problem.
  • The beam has been unstable for most of the time. No drift, mostly gitter. Reasons are unclear. The instability was also measured with the XGM in XTD2. SPB is analysing the data collected to be able to quantify the instability. 
  • DAQ tests for AGIPD were planned for tomorrow but the request is to shift them to today to take advantage of the missing beam.

FXE

Some issues were reported: LPD readout of the data, Fast digitizers mainly. The details have to be clarified with the DET and ITDM groups.  

AE

SQS loop 3 is up and running. 

SCS

  • Tests continue

SQS

  • FMB Oxford will be working on the mirror tank starting form tomorrow until next week. Acces to the hutch is limited.
  • There will be a meeting with AE to discuss the set up of the motors for testing (especially for the mirrors). SCS will also participate. 

ITDM

  • SASE3 projects updated. Performance increased.
  • Possible to move the AGIPD test for SPB to today

CAS

  • Camera device had to be reinstanciated 4 times during the week end. Investigation ongoing.
  529   30 May 2018, 10:55 Adriano ViolanteGeneralInformationStatus report after dispatch meeting 09.30

AE

  • CRLs in XTD1 being implemented
  • GATT and EPS loop in SASE3 being updated

SCS

  • Tests continue - No issues so far

SQS

  • ELMO controllers have to be configured for the mirror motors test. Slit motors have lower priority. Cables can be tested w/o being physically connected to the motors, but to configure the ELMO controllers the cables have to be connected to the real motors. Tomorrow AE is available to support these activities.
  • Basler cameras set up and working.

ITDM

  • SPB AGIPD test today or tomorrow

CAS

  • Hot fix for SPB released yesterday. This will address the issue of crushings when instantiating a new device. Has to be tested with SPB. 
  • XTD 6 will have no electricity for the racks today since Wille is completing the cabling. MTCA being shut down accordingly.
ELOG V3.1.4-7c3fd00