Instruments

• SPB:
  • When PLC loops are restarted, still many device parameters are not properly recovered. This generates a lot of work for the team. Recently an entire day was lost.
    • The procedure now foresees a notice to the relevant group before each loop update. In particular, CAS will be asked for the last version of the parameters export to be re-implemented. The relative script was also updated and some bugs were fixed.
  • Loop 4 (maybe also 3) - MKB system - needs to be updated. This will be done as soon as the last eplan export is available.  
  • XTD9 loop needs to be updated with proper encoder names. CAS takes care of the missing names.
  • AGIPD Interlock system (loop 5) shows some issues concerning valves. It is not clear whether this is due to real problems with the interlock definitions or just to the fact that the system is not yet in vacuum. Chember will be pumped today and then the final test will be done.
• FXE:
  • Preparation for the users run ongoing. PP laser treatment test ongoing.

Tunnels

• XTD10/SASE3
• XTD9/SASE1
  • Si-Mono: work has been done during the week end. The idea is to have it running without tilt stages.

Laser

• Delay control is available through KARABO but requires ca 2 days testing: ongoing.

Electronics

• Currently the work that is still needed for SASE3 is being evaluated
• Planning for the next shut down is going on

CAS

• Working on DOOCS/KARABO integration together with DESY. Ongoing. General frame being built. Then priority on the FEL imager needed for first lasing.
• A. Silenzi and S. Hauff worked on the AGIPD procedures: Cooling down procedure successfully tested.
• Work continues on reading and writing data for the GreatEyes detector: The idea is now to test the parallel operation of LPD, Gotthard and Greateyes detector.

ITDM

• The folders for the next user run are being set up next week. GPFS is now fixed.
• SPB requested 18 new cameras. This effort needs to be carefully coordinated. CAS and ITDM are working on that.

General

• No user operation.
• During the week end the accelerator was not able to deliver reliable and stable beam for the user operation.
• The M2 mirror bender stopped working on Saturday morning and had to be replaced. The mirror and blender were replaced as a whole durig the week end. Normally it would have taker weeks but a "spare" system was already set up for SASE2 and could be used on a short notice. Pumping of the M2 section is ongoing and leak test be performed today.
• The non working M2 does not show apparent problems so far, and the reason why was not working is not clear.
• Some sections of the LINAC were warmed up due to some maintenance required for the cold compressors.
• LINAC is being cooled down and ready for operation today afternoon.
• The technical support groups were not informed about the problems until saturday afternoon. The communication channels in these cases have to be improved.

​Instruments

• SPB and FXE:
  • The goal is to be able to strat the secondo users run on Thursday (Day FXE, Night SPB).

Tunnels

• XTD2,9 Ready to take beam in the afternoon (if no leak in M2 is discovered).

ITDM

• A small bug was found in the DAQ that affects only slow devices  with certain train ids
• It is proposed to fix this during the next break. Decide on Wednesday

General

• Preparation for the user's run starting tomorrow (until 7:00 Tuesday morning)

Instruments

• FXE:
  • On Monday night the DAQ seemed to be slow. This problem was caused by a misconfiguration in the DAQ which could be solved by ITDM once they were informed. In general both the Configuration understanding by the users and the communication with ITDM has to improve.
  • The Gotthard detector could not be used. The Greateyes detector is being used now and works properly.
  • PP laser is now synchronized but not commissioned yet. This is going on now (crucial point is the pulse width measure). It is not yet clear whether the PP laser will be used in the next users run. 
• SPB
  • AGIPD was moved 5 m downstream for the next experiments. Vacuum is OK. Alignment checked with the ALAS, will be checked with beam probably today evening.
  • A change in the DAQ configuration has to be (is being) done today (CAS/ITDM)

ITDM

• Upgrade switches today at 9:00 will be checked if there were problems right after this meeting.

General:

• Shutdown started.

Instruments

• SPB:
  • AGIPD prepared for exchange modules intervention
  • AE is in contact with SPB for crates issues fixing
  • The schedule for next year, especially when the experiment has to be ready before the users run has to be known as soon as possible.
• FXE
  • Starting loops update in the next days. Reason for the small delay is that FXE is checking all the default parameters to be able to restore them after the update.
  • In order to solve some DAQ issues, FXE requested to have their own topic. AE agrees, ITDM agrees, CAS is trying to find out how to do it and to do it before the next users run. Technical details have to be discussed offline with FXE.

ITDM

• in KW 51 (18-22 Dec.) the DAQ and online cluster will not be available due to recabling works in the balcony rooms.
• Update of the servers in the experiments has to be done. ITDM requested to know from CAS when the major update of Karabo is taking place to coordinate the effort and minimize the downtime. CAS will present a schedule concerning Karabo this Friday.
• 700 Tb of data are stored on the online cluster. It has to be communicated by the experiments what can be moved from there, since there is almost no space left.

Diagnostics

• Implementation of Gotthard detector in Karabo is still a problem. S.Hauf will invite the main groups involved for a meeting to find a solution.
• The data correlation with time stamps when using the Karabo DAQ has to be done carefully and contacting WP74 since there are still issues present. 

AE

• Activities on the Hirex in SASE1 will need the MOV loop to be brought down in the afternoon. An entry in the ELOG will be written.
• SPB loop 8 prepared. 
• Full list of new crates belonging to the motion loop in SASE3 tunnels has to be delivered to AE
• Full list of new crates belonging to the IPS loop in SASE3 tunnels has to be delivered to AE in order to be able to close the loop.
• Technosoft controller issues in SASE3 will be attacked once the SASE1 activities will allow it.

VAC

• VAC testing ongoing.
• 2 mirrors will be installed before Christmas
• Motion crates for the motion lopps and test of the VAC interlock will happen this week.

SPB:
- The exchange of the mc and mfpga boards has been done and some problems were found. The boards are now being debugged at CFEL.
- Sample enviroment's group is testing the liquid jet this week.
- Wait for the Loop 5 to be updated by AE

FXE:
not represented
Vacuum:
not represented
XPD:
not represented

Laser:
not represented

Detectors:
not represented

AE:

- Timing devices update done. One crate in XTD2 has a problem and cannot be operated remotely. Fixing ongoing.
- The clock, VETO and Start signals for the AGIPD could not be brought correctly from the utca in the rackroom to the patch panel in the hutch due to the excessive cable length. Workaround found using a signal replicator at the patch panel position. The problem seems to be solved.


ITDM:
 - LPD recabled with Infiniband connection. Test succesful.
 - Meeting this week to decide whether to use or not the train builder for 
AGIPD and LPD detectors
 - in 3 racks in XTD10 some network connection added last year do not work 
properly. The responsible company is comeing back next week to check the 
cabling. Interventions have to be planned accordingly since the Beckhoff 
loops are running! ==> no news.

CAS:
- not represented

SPB:
- one mfpga board was found malfunctioning and was replaced with the old one. Concerning the mc the new version can be used.
- Liquind jet test ongoing.
- Waiting for the Loop 5 to be updated by AE
- Old version of Karabo was sluggish as of yesterday.
- 2.2.1 Karabo verion being rolled out for SPB - test ongoing.

FXE:
not represented
Vacuum:
- SASE1 vacuum in the tunnels closed (CRL chamber closed).
- KB mirror chamber in D.02 (SPB optics hutch) will be opened at the beginning of February
- In SASE3 the gas supply is now decoupled from the vacuum loop
- Soft XRay mono vacuum to be closed today.
XPD:
not represented

Detectors:
not represented

AE:

-XTD 2 CRL to be tested tomorrow
- Update of loops ongoing
- Emergency off button test in FXE showed that the relative controlling PLC was not configured correctly. In addition, communication problems between TS and FXE made things more difficult. PSPO will talk to TS and decide how to proceed. In the meanwhile the test foreseen in SPB for next monday HAS BEEN CANCELLED. GWellenreuther has informed Torsten Schoen.



ITDM:
 - Meeting this week to decide whether to use or not the train builder for 
AGIPD and LPD detectors
 - in 3 racks in XTD10 some network connection added last year do not work 
properly. The responsible company solved the problem without bringing down the loops.

CAS:
- 2.2.1 Karabo was deployed in FXE experiment and tests are ongoing.

- 2.2.1. being rolled out in SPB exp and Laser

- SASE3 tunnels  tunnels will get the new Karabo version next week. SASE1 tunnels will follow (probably in the same week) 

General remarks:

• Stable beam only to be expected starting from 1.03. for SASE1 instruments commissioning
• There is no guarantee for parasitic beam delivery to the experiments. If it happens at all it  will most probably be during the last week of Feb. This has to be agreed on the fly  with the BKR and H.S/ T.T.

SPB/SFX:

• Preparing D.02 for mirrors installation (next week)
• Karabo being updated

Advanced Electronics:

• Trigger delivered by DESY should be back and stable at 10Hz. 
• ATM for timing has to be replaced in the balcony rooms. Bruno Fernandes is trying to find a way to reduce the downtime down to 30 minutes. Will be scheduled in the next days.

ITDM:

• 1 line card has to be replaced. Probably happens on Wednesday this week during the DAQ tests.
• Tuesday afternoon the online storage units will me remounted with the same path of the offline ones.
• This week a proposal for the in-house commissioning is going to be circulated.

SPB/SFX:

• Preparing D.02 for mirrors installation (next 2 weeks no access to D.02)
• Karabo being updated - Detector being tested, seems fine so far.
• DAQ tests foreseen for today
• NKB movement (Loop3) should be tested to make sure that the controls work fine before interfacing the MKB with real mirrors inside.
• AE will check the status of the CSS crate. If ready it will be mounted and tested after the MKB.

Advanced Electronics:

• ATM for timing has to be replaced in the balcony rooms.  downtime expected to be  15 minutes. Will happen Today at 16:00

CAS:

• Deploy SASE1 topic in the tunnel this week.Tomorrow at 13:oo CAS would like to make the switch. A.Silenzi will write an entry in the logbook to make sure everyone is on board with that.
• Release of the version 2.2.2. being prepared. This would mainly improve the GUI performance.

XPO

• FXE Mono local test performed and OK. To be tested through Karabo in Feb.

CAS SASE3 (C. Youngman):

• Gas attenuator controls being completed and tested.
• Soft MOno local test done and only small problems found
• EPS loop in good state - interlock test tomorrow.

SPB/SFX:

• Problems with data loggers ==> no statements about the past.
• Loop 5 upgraded
• Alle the other Loops are not at the 100% of their potential but sufficient for the users.
• Test on nkb mirror movement to be done.

XPO

• In SASE3, 4 cameras have trigger problems. AE is working on that.
• In SASE3, 4 cameras have accessibility problems. ITDM is working on that.

CAS SASE3 (C. Youngman):

• Interlock for VAC, GAT and XGM loops are tested and OK
• The rest is so far as it could go. For details refer to C. Youngman report.

ITDM:

• Broken Linecard  replaced .
• Update/switch for the gateway to the control network will happen in one late evening during this week. ITDM will write an entry in the logbook just before. 

SPB/SFX:

• Fixing of Karabo scenes ongoing
• Loop 5 need to be updated after discussion with DET group (Jolanta Stuk)
• A meeting with AE will take place today to discuss the synchronous movement of the mirrors motor. 
• The test on the NKB chamber of the indipendent movement should take place. It has to be double checked that such motors are implemented in Karabo.

CAS SASE3 (C. Youngman):

• SASE3 tunnels closing today at 14:00. All the critical tasks were done. 
• The day before the first lasing, a ZZ access is strongly requested. The request will be discussed in the PSO meeting.

ITDM:

• Tomorrow the DAQ will be available for the AGIPD. LPD to follow. The goal is to have SASE1 ready next week as a whole.

SPB

- Loops update OK

- Issue with SmarACT controllers. AE is on it (see below).

- Synch motion of mirrors motion being worked out with AE.

FXE

- Loops update OK

- DAQ updated

- CRL in the tunnel have two encoders with problems. Can be disabled and are not a problem for operation.

- A leak before the diamond window was found. Being closed now.

- Preparation for timing tool commissioning ongoing

- The new user chicane will be probably cut next week.

Laser:

- SASE 1 commissioning and upgrade moves according to plan

- SASE 2 and 3:  so far we still have green light concerning access control, laser safety installations, network and sync for installation of laser tables starting at the beginning of April.

Vacuum

- SASE1 und SASE3 vacuum systems are ready for restart of beam operation

- update of SASE1 vacuum loop on Wednesday caused many problems (all ion pumps in error state)

Optics

- Test piezo motors XTD9 today

XPD

- XTD10: K-Mono, XGM, PES, filter chamber, imagers operational except:

- Karabo tests for Exit slit imager.

- Camera cables to be exchanged for 2 imagers, ZZ access 1h.

- PES, issues with digitiser and MPOD scenes.

- XTD2 and 9: All components operational, Hirex also including Gotthard.

- Next steps

- Progress on scenes and projects implementations.

- Compatibility with new Karabo, Karabo GUI.

- Test and improve usage of DAQ.

AE

- Coordinated motion of MC2 Based Motors were implemented and presented to first users in SPB and XPO as well as to CAS

- The issue with the SmarACT motor controllers observed in the past was due to an issue in the controller. It was solved with an firmware update and requird configuration with dip switches. For this the later usage (e.g. rotary, linear, etc stages) has to be defined. The modifications for SPB is ongoing.

- AE observed, that in some cases PLC related electrical work was carried out until the very last day of open tunnel, which require a PLC firmware update and successive test. Since there is also a risk in the firmware update as it could be, that during tests issues might be observed, there is no access anymore to the actual system and thus could not be solved without ZZ or new access time. We had issues due to this, where at least temporary workarounds were possible - but it could also be different. This is a high risk, which should be know to everyone involved and decided on, if we want to continue like this in the future. AE would prefer to stop with any electrical PLC changes at least some days before tunnel closure and allow firmware updates (possible Karabo changes) and full tests by the users of the components with Karabo in order to identify and solve possible issues.

- Another issue took place, where a change request for a PLC change was issued, but instead of waiting for the finally modified designs to then do the related hardware modification, the modification on hardware were done without any new designs. This creates many problems: no CAD design according to hardware exists, the current revision state of the module is not defined, no firmware structure could be exported and generated for the current design, etc. Therefore modifications without new CAD design and consulting AE is not allowed!

ITDM

- Sase3 tunnels: cabling issues solved.

- DAQ so far stable. Has to be tested at full load now with the new Karabo.

- DAQ update for Tunnels in SASE1 and 3 ongoing. Today and next Monday will be test days.

- Gateway update done: small issue with SSH connections, easily solvable==> the procedure will be posted in the logbook

- The Maxwell cluster will need to be shut down for 2 days next week due to upgrades.

CAS

-  2.2.1 has been deployed without real problems on FXE, LAS, SPB, SA1.

-    In SASE3, it is still 2.1.18 and it will be updated early next week

-    2.2.2 release test cycle almost finished. The release will be published early next week - This release will not be mandatory, but recommended based on the new GUI benefits.

-    SASE3 Tunnel most critical tasks were done, including the gas attenuator by Valerii. It was a really complex task that Valerii went deeply and get it done for us all!

-    Sergey keeps working in Digitizer with Hamed (AE) but based on the deadline they decided to go for the old protocol.

-    Andrea (Alessandro and Steffen) has been working on the AGIPD Library to report when AGIPD will stop to acquire data

-    Gabriele started discussions to address the DAQ for LAS with ITDM.

-    XGM's DOOCS integration has been updated to address TrainID issues. We must allocate 2-3 days to test it with Beam.

SPB

- MIrrors installation (2 horizontal mirrors) in D.02 has started 

 -Synch motion of mirrors will be tested with fake mirrors in D.09 as soon as the control is ready.

SASE3 - CYoungman

- After SASE3 tunnels were closed it was discovered that was not pobbile to set values of the massflow (GAT loop). This required a remote intervention (firmware) that was supposed to be fast and easy  but it was not, and this required work until friday evening. Current status is: The gas attenuator secion closed and in static vacuum since the shutdown of a turbo pump was required. The system is in asafe status.The issues are being analized and solved with experts right now.

-It is important to establish a procedure to set priorities for ZZ access. The issue will be brought up in the PSO meeting

ITDM

-AGIPD p[roject is OK. Jolanta will start taking data already today

SPB/SFX

- An AGIPD crate providing power broke down and has been fixed already by Kai-Eric Ballack. This delayed the data acquisition test planned by Jola. These are being done today.

 -Synch motion of mirrors will be tested with fake mirrors in D.09 as soon as the control is ready. Work is ongoing.

-First mirron in the SPB optics hutch will be installed today. 

- New Karabo release working smoothly so far.

FXE

- CRL in the tunnel being commissioned

 -Leak close to the diamond window being fixed. If everything goes fine ready for parasitic beam on Wed next week.

VAC

-Vacuum interlock tripped twice in the last 12 hours. Issue has to be clarified with CAS.

AE

-Reconfiguration of the SmarACT controllers between rotary and linear motion is being carried out. Marcin and Mahadi are the main players here.

ITDM

-Major safety update of the cluster has to be done. ITDM proposal is to do it next week. SPB and FXE opted for the early morning (between 8 and 10). Exact date will be announced by ITDM as soon as possible.

General

"In the beginning of this meeting SM congratulated the whole staff of the European XFEL and in particular the commissioning team with the very important achievements 
- the first SASE3 lasing / bi-lasing at SASE3/SASE1. It happened yesterday late evening. More information will be given during our PBS meeting next week."

Photon Run Coordinator Report to Readiness Meeting

• parasitic operation in SASE3 (closed 3 undulator segments) for photon commissioning with SR-beam
  • V0 opened, vacuum open down to XHEXP-shutters
  • photon beam detected down to FEL imager, yesterday until SR absorber beyond mirrors M1/M2 and MCP
• photon systems supported tuning/search for SASE1 lasing
• Progress in SASE3: 
  • First Lasing in SASE3/XTD10 
  • simultaneous lasing SASE1 and SASE3

SPB

• During operation Karabo crashed. The problem is not clear yet. Det. loop was affetcted ==> AGIPD tests stopped!
• 2 mirrors in D.02 are being installed.
• Test of the mirrors movements is ongoing
• Motors issues are being checked by AE (Mahadi)

FXE

• Gotthard det. and digitizers back to work
• Leak close to the diamond window being fixed

Laser:

• Timing system has been upgraded - currently we can have any repetitive laser pattern for each laser, number of laser pulses in not limited to number of electron bunches, also we can have lasing when there is no x-ray (electron bunch)

•  Installation according to the plan, no major delays. No commitment to experiments for laser availability in March.

Vacuum

• SASE2:

  • XTD1 under vacuum up to XS2 shutter

• SASE3: 

  • interlock problems solved, runs without problems since yesterday

  • GasAttenuator loop needs update. when is the best time to do that? to be agreed with PRC

Optics

• issues mainly in the XPD section 

XPD

• SASE1 : photon systems supported tuning/search for SASE1 lasing
  • tests of DAQ in SASE1 ongoing
• parasitic operation in SASE3 (closed 3 undulator segments) for photon commissioning with SR-beam
  • V0 opened, vacuum open down to XHEXP-shutters
  • photon beam detected down to FEL imager, yesterday until SR absorber beyond mirrors M1/M2 and MCP
• karabo update to 2.2.x in SASE3 tunnel scheduled for next tuesday morning
• SASE3 DAQ urgently required
• issues with in-vacuum goniometer motor control of KMONO
• issues with IMGFEL to be understood - found a scintillator which works when we have FEL radiation

AE

•  The need to properly plan the activities close to the tunnels closing is pointed put.
• The need of a specific technical coordinator as in SASE3 for the SASE2 tunnels is pointed out

ITDM

•  Sase3 DAQ not ready since Karabo is not yet up-to-date
•  Slow data acquisition issue affecting cameras: being worked out.

CAS

•  In SASE3, deployment of new (2.2.1) Karabo versionwas  delayed because of many people getting the flu.
•  2.2.2 release test cycle ongoing

SPB

• During operation Karabo crashed. As soon as detector is being operated the problem appears. Fixing is still ongoing.
• 2 mirrors in D.02 are being installed.
• Test of the mirrors movements has been performed.

FXE

• Debug of implemented devices ongoing
• Diamond grating in XTD9 has to be moved out of the beam way manually (no remote controls implemented due to long lead time of required beckhoff teminals). Access requested for Wednesday.
• Vac group will check whether beckhoff terminals are available to allow the remote control of the dimaond grating

Vacuum

• During the weekend the XGM in SASE3 was damaged. Details still unknown. 

AE

•  SASE2 XGM local test ongoing
• GAT loop update in SASE3 being done.
• Local checks in XTD10 on Wed.

ITDM

•  Slow data acquisition issue affecting imagers: solved
• One server died over the week end. ITDM notified only today.

SPB

• MIddle layer karabo devices are responsible for the det. Karabo problems. Issue being addressed.
• 2 mirrors in D.02 installed.
• Test of the mirrors movements is done.
• Mirrors cooling bars being installed

Vacuum

• SASE3: 

  • Spikes of the downstream DPS gauges are responsible for the interlocks tripping. Probable cause is related to the beckhoff terminals of the DPS (different from the other gauges). Ongoing.

XPD

• Pop-in monitor filters in XTD10 being changed
• Exit slit imager after Mono XTD10 has ot be commissioned and scintillator has to be put out of the beam way.

AE

•  It can happena that some parameters cannot be set using Karabo due to lack of writing rights. A fix has been found but we would need to update all the loops. Since the problem is just occurring from time to time, AE asks to report specific cases for whoch a solution will be found. Same things happens with the re initialization of some devices. In this case the PLC crashes.
• Timing device in XTD 2 stopped working. Will be fixed today either by remote re start or by local intervention.

ITDM

• Broken server replaced
• Tomorrow there will be an update of the cluster between 9:00 and 10:00. DAQ will be down.
• Reboot of the online cluster needed. To be agreed with Detector group. 1 hour downtime also in this case.

CAS

•  In SASE3, deployment of new (2.2.1) Karabo happened yesterday and seems stable, but brittle. Analysis of the reason ongoing.
• Today GAT final fixes plus testing will be performed

Photon Run Coordinator Report to Readiness Meeting

The maintainance on Wednesday was very successful and all goals were reached (and some extras). 

Thanks to everybody involved in planning and execution! 

- Installation of Karabo 2.2.x in XTD10 went smoothly. 

- SASE1 tuning studies are ongoing. Still there are some things to be learned on compression and 

optimizations will go on Friday. Currently around 250 uJ.

Recent achievments in commissioning: 

SASE1: 

-Peter aligned CRLs in XTD2 to beam. 

-Naresh could work on Hirex

-Liuba and Ilia started pointing studies with imagers (?)

Problem: We found out that gate vales of vacuum are not connected to DESY MPS

(waek beam was hitting one closed valve behind Hirex for about 2 hours)

SASE3: 

- Gas attenuator commissioning started

- Calibration of SRA to optical center of beamline

- The undulator beam was steered 4 mm horizontally. The vertical steering requires movement of undulator center, 

which will be tried possibly on Friday

- Cross calibration of XGM to FEL imager started last night. 

SPB

- KB mirrors

        - installation of horizontal micron KBs finished (approx 8 working days were required)

        - pump carts attached, expected that one week is required before valves can be re-opened (Vacuum group needs ZZ to reconnect valves on the XTD9 side)

        - installation of vertical micron KBs in April

        - D02 will remain cleanroom during the intervening time, i.e. all companies / groups (internal and external) coming on site should be briefed. No access without permission and accompaniment

        - controls tests on elmos completed via Karabo, help from Nerea / Mahadi to get everything working as expected

- configuration of smaract motors

        - commissioning setup will be used during first beam week in March

        - Re-config of smaract controllers by Marcin / Grant / Mahadi mostly completed

- AGIPD

        - firmware update scheduled for this week will not be completed as DESY detector group firmware expert is not available

        - remain limited to 32 patterns per train

        - automatic cooling and powering procedures are not working reliably (requires investigation poss. CAS?)

        - AGIPD chiller fell into an error state after removal of a separate crate BKF00072 (SPB_IRU_LIC), loop 5 redundancy requires investigation (AE)

- Karabo

        - GUI is slow to update or does sometimes not update (request investigation by CAS)

        - devices (e.g. those reporting pressure / temperature) have to be re-started before updates are seen in Karabo (request investigation by CAS)

        - Users have questions about any changes in the implementation of the 'Karabo bridge’. Technical information on how information is broadcast from Karabo is required in order to ensure that users can adapt their monitoring software 

- data trial run

        - Robert suggested trial run for DAQ / user software plugin before the first experiment. SPB can contribute to the execution of these tests and involving users. Requires also action from CAS and ITDM teams

FXE

• Diamond grating in XTD9 can be controlled remotely now
• DAQ test ongoing
• LPD calibration to be  performed

Laser:

•  Installation according to the plan, no major delays. 

Vacuum

SASE1:     ZZ access to connect SPB valves

SASE3:     tripping of interlock seems to be understood, interlock conditions changed,

                if it happens again, the two effected gauges will be removed from interlock until April

           Gas Attenuator is operational, Raul did some tests yesterday, up to 1 mbar

           No feedback control on gas pressure, only manual setting of gas flow

           The device can only be operated by experts so far

Optics

• see PRC section 

XPD

Last wednesday tunnel access:

• „repaired“ SA1 IMGSR trigger (with AE)
• „repaired“ SA3 XGM, restarted (but intentionally without HAMP)
• better routing / fixing of purple Beckhoff loop Ethernet cables and fiber connections is needed

SASE3 vacuum interlock trips (which eventually led to XGM failure on Saturday and reoccured monday night again) were strongly investigated by VAC : now understood ?

work on cross-calibration between XGMs and Imagers (as backup intensity/position monitors when XGM is out of order) with Laurent

DAQ: work with Krzysztof and Luis to get SASE1 DAQ back in operation, and to start SASE3 DAQ (can we test today ?)

Current status of SASE delivery (max. µJ in SA1/SA3): yesterday 390 / 200, this morning 190 / 600

Request to CAS: please plan to send for "training" or "experience" some CAS people to BKR during beam operation, especially the people in CAS who do OCD.

On behalf of Natalia : report to AE on detected issues with the ELMO controller settinsome hours gs of the PBLM motors in SASE1

AE

- stuck trigger timing module in XTD2 restarted (related to SR imager)

- Gas Attenuator PLC loop updated

- PLC modules in SPB rack with SmarACT system rearranged according to updated documentation

- Two bugs in PLC Framework identified, which are fixed now in the current version, but is not deployed yet to most systems:

     - Access rights are not correctly transferred to Karabo. This leads to the fact, that in cases of very special parameters only read access is possible via Karabo (these are automatically injected parameters in Karabo). If you come to the problem of not being able to write such a parameter, please let AE know and we can set it directly to the PLC. This will be solved with the next PLC loop update.

     - A bug was identified, which could in the worst case lead to a full crash of the related PLC. This could be caused by a „re-init“ on a device on the PLC. Therefore do no re-inits on PLC devices. If you really see the need for a re-init of a certain device, please let AE know about this and we see, if this is required and how this could be done. Also this issue will be fixed with the next scheduled update of the PLC loop.

ITDM

•  Cameras issue solved.
• SASE3 DAQ testing to start
• XGM data acquisition to be tested due to karabo/DAQ possible lost of information recently debugged.

CAS

+ Karabo 2.2.2 is released

+ 3rd control pc is set up in BKR

+ SASE3 is running Karabo 2.2.1

+ Karabo 2.2.1 is tested with DAQ

+ as we moved into weeks of commissioning, CAS OCD is regularly (basically every night) involved in and provides support for partly software and partly hardware issues

+ as experiments are coming, Data Analysis integration requests (eg. on Karabo Bridge) shall be channeled to Hans (and to the newly setup DA contacts: Thomas for SPB and Cyril for FXE) directly

+ the gui slowness problem reported by SPB needs to be checked if it comes from the GUI client or from the server and shall be tested with the new Karabo hotfix 2.2.2, too.

DET

LPD canlbration analisis ongoing

LPD Long integration time acquisition being tested

AGIPD: colntrol optimized and tested. Firmware being tested, the aim is to ioncrease the acquisition speed.

AGIPD: next week calibration data to be taken. 

AGIPD: Sensors in the centra area that underwent scattered beam to be checked.

CYoungman - SASE3

 - good progress was made and this type of 'commissioning' mini-shutdown (anything longer than 6 hours) should be performed as often as possible (Wed. shutdown). Next work items would involve: PBLM, ExitSlits....

LBatchelor - XTD6

XTD6: both CRLs (MID CRL2 and HED CRL2) ready for installation (lenses installed and aligned, chambers sealed). Installation should happen next week.

SPB

• KB chamber being pumped down
  

• interaction with AE is ognoing concerning update pf Loop 5 and AGIPD cooling procedure ongoing
• Smaract commissioning ongoing
• The goal is to be ready to start commissioning with beam on 01.03.
• Slit Karabo middle layer - integtration and final fixing being finalized by A. SIlenzi

 FXE

• DAQ test ongoing - fixing of bugs
• After FXE has been moved into the new topic is not possible to read tunnel vacuum pressure anymore. Being discussed with CAS
• Permission to use parasitic beam next week requested to the radiation safety group.

​XPD

• XGM in SASE3 requires physical intervention to be fixed. Access request for tomorrow.
• DAQ groups definition ongoing and being clarified with ITDM

AE

• PBLM moto problem was found to be due to a wrong Karabo-PLC linking. If the tunnel will be accessible tomorrow the issue will be solved. HSinn to decide on priority.
• Soft mono commissioning started and AE support was required. It is not clear what priority does it have. Mahadi is anyway working on that today ad 14:00. If the intervention is found to require more time one has to see.

ITDM

•  During the FXE DAQ tests many problems were found:
  • issues with digitizers
  • issues with scan
  • issues with images acquisition. In this case the problem has been identified (Train ID was 0). KWrona is in contact with CAS to fix the bug.

CAS

• The issue reported by SPB about no data being read from AGIPD temperature sensors has been identified by Gero (CAS) and the fixing is ongoing. 

Report of the XTD10 interventions from last week - Tuesday and Wednesday - C. Youngman 

Many thanks to those who contribute to the "SA3 'further technical coordination push" onTuesday (no-beam XTD10 closed) and Wednesday (XTD10 open) mini-shutdown, below is brief summary. The status items were not highlighted during PSPO's readiness meeting AoB section but are useful to know. Those issues that were raised are contained in the conclusion section. 

We leave the SA3 beamline with a functioning interlock, but you should additionally watch and test your component and ensure that beam operation is possible.

The principle task on Tuesday was

• for ITDM to shutdown and update f/w of the control server CPU hosts in the balcony room, and
• for CAS to replace the Karabo 2.1.18, running since the Oct-Nov shutdown 2017, with Karabo 2.2.1 which is already running on the SA1 installation. 
  • A number of problems during the installation were addressed and a stable deployment was finally reached early in the evening.

The principle task on Wednesday were

• test the updated GATT Ebara pump updated f/w and its s/w counterpart
• test that GATT Bronkhorst Mass-Flow valve f/w worked: correcting conversion errors and the incorrect setting of property r/w attributes
• test that GATT Inficon gauge f/w did not crash the loop and correct  conversion and r/w errors as with the the Mass-Flow valves
• perform Beckhoff-local tests on one or more the DOD motor axes as they were expected to be wrongly wired (as seen in the Jan-Dec shutdown in the VSLIT)
• update the s/w to reflect changes in the GATT f/w
• address difference in the s/w introduced by the move to Karabo 2.2.1

The key-point task listed above have been attained with the following caveats:

• There is a h/w fault which prevents the second Ebara pump being fully controllable remotely, it is currently locally controlled.
• Bronkhorst f/w and s/w is usable, the conversion is correct, but additional s/w work is required to align the s/w
• The Inficon f/w works (it does not crash the loop), the f/w conversion error is identified but not enough time was available to modify it.
• some s/w issues remain which are being addressed (tagging of Ebara, Bronkhorst and Inficon s/w, correct configuration of the vacuum-section..)
• the automatic update of project and scenes was not completely successful so project and scene owners should check and correct their scenes. The auto update procedure will be improved.
• Some data logging information was lost, but e now have regained a standard implementation (not hot-fixed) which should improve the this.
• After measuring that the DOD axes (1 of 10) were incorrectly wired it was concluded that all were incorrectly wired (as had been the VSLIT in the Dec-Jan shutdown)
  • Benoit and Daniele managed to rewire all 10 DOD axes during the mini shutdown and test 1 axis with Karabo.
• PES tests of multi-board digitizer s/w and f/w were continued (with measurements at the crate), these are promising as 'raw' and 'processed' data are now concurrently available.

In conclusion - good progress was made and this type of 'commissioning' mini-shutdown (anything longer than ~4 hours which includes somebody elses longer ZZ) should be performed as often as possible.

This requires

• that the photon run coordinator team know that there is a "list of task" to be performed which are not in the ZZ list
• that a selection of these tasks can be performed within the time budget of a mini-shutdown and that these do not compromise SA3 tunnel operation
• that the photon run coordinators inform the SA3 technical commissioning team (contact a member of the "SA3 tech coord" CAS team setup by Sandor, e.g. Chris, Valerii or Wajid ) so that they can organize the work in time (or report that they cannot as something or someone is not available).

During the next few days a "list-of-task" will be created. This could include technical commissioning actions for SA3: PBLM, ExitSlits, very end of beamline imagers where the status needs updating, etc.

Also remember that the CAS team tries hard to satisfy as many requests as possible, but prioritization will be done, so make your case thoroughly and don't expect it to simply happen (it has to be on the radar screen). In particular h/w, f/w and related s/w tests needing access will be done first and non-critical s/w work will be left until after tunnel closure. And remember to check your projects, scenes, and macros before you need them.

SPB

• KB chamber being pumped down
• Smaract commissioning ongoing
• Coordinate motion for VAC ready to be tested (probably tomorrow). It has to be agreed with Richard Bean
• Clean-up slits Karabo middle layer deployed and working. - The same hase to be done for the power slits.

 FXE

• DAQ test ongoing - fixing of bugs
• After FXE has been moved into the new topic is not possible to read tunnel vacuum pressure anymore. Still the case.

• ​XPD

• XGM in SASE3 fixed (A turbo broke - replaced)
• One exit slit Imager in XTD 10 commissioned

AE

• PBLM moto problem was found to be due to a wrong Karabo-PLC linking. ==> FIXED
• Soft mono commissioning started and AE support was required. DONE

ITDM

•  Main problems with Train ID solved. Some problems still remain for some beckhoff loops in the tunnels==> AE on that.
• Some way to document the change of data format for devices has and will be found by IDTM
• Data source running for FXE. Changes have to be clearly communicated. 

CAS

• Soft fix improving the GUI deployed. No 2.2.2 ready.
  

• ​Issue with Karabo device returning the sensors data (e.g. cooling AGIPD) is being investigated. The Bug was found also in test environment but still random.
   

SASE3 - CY

• GATT works
• Inficon device to be improved (loop restart needed)
• CAS will deliver a method to deal with the configuration changes asked by the experiments, redirecting the changes to the proper platform (Firmware (AE), Karabo...)

SPB:

• Ion pumps running in the Mirror chamber. Vacuum level OK to run.
• D.02 is now interlocked and is a clean area.
• Mahadi and Alessandro are setting up a test system for the coupled movement. The test will probably be done between the 2 users periods.
• 2 hours of parasitic beam can be used today to check the alignment of the CRLs. The CRLs will be then moved out of the beam to allow the FXE radiation tests tomorrow.
• Primary limits for coupled motion not included in E-plan, safety switches are implemented but SPB prefers to have the primary limits included. CSS crate to be modified after clarification with AE/EET.
• Test of the karabo brigde will be performed with users. It is not yet clear exactly when since this needs synchronization with several groups involved (CAS, ITDM, DET). 

FXE:

• Radiation test tomorrow
• LPD test measurements in thhe WE
• Von Hamos spectrometer alignment until monday

ITDM:

• SASE1 and 3 have the last DAQ update now. Stable in SASE1 so far.
• Data sources arrangement being worked out. Today a 45 min session is foreseen with SPB.
• SPB needs slow data acquisition from 2 cameras for users, apart from AGIPD.

VAC/Detector/XPD/CAS: nobody attended