General remarks:

• Stable beam only to be expected starting from 1.03. for SASE1 instruments commissioning
• There is no guarantee for parasitic beam delivery to the experiments. If it happens at all it  will most probably be during the last week of Feb. This has to be agreed on the fly  with the BKR and H.S/ T.T.

SPB/SFX:

• Preparing D.02 for mirrors installation (next week)
• Karabo being updated

Advanced Electronics:

• Trigger delivered by DESY should be back and stable at 10Hz. 
• ATM for timing has to be replaced in the balcony rooms. Bruno Fernandes is trying to find a way to reduce the downtime down to 30 minutes. Will be scheduled in the next days.

ITDM:

• 1 line card has to be replaced. Probably happens on Wednesday this week during the DAQ tests.
• Tuesday afternoon the online storage units will me remounted with the same path of the offline ones.
• This week a proposal for the in-house commissioning is going to be circulated.

Hi everyone,

there was some miscommunication between us and DESY: only the Timing firmware and doocs server need to be updated, the RTM was already been replaced. This require update is similar to the one perform two weeks ago (see entry #449).

The time slot for this update is next Wednesday, 23rd January, between 16h and 17h. The update will affect all Timing Devices in SASE1. This operation should not take more than 10 minutes; during this time no timing signals will be generate (clocks/triggers/bunch patterns/etc.). Naturally, problems may occur during this update which will lead to increase down time.

If somebody sees a problem with the current schedule, please contact me.

SPB/SFX:

• Preparing D.02 for mirrors installation (next 2 weeks no access to D.02)
• Karabo being updated - Detector being tested, seems fine so far.
• DAQ tests foreseen for today
• NKB movement (Loop3) should be tested to make sure that the controls work fine before interfacing the MKB with real mirrors inside.
• AE will check the status of the CSS crate. If ready it will be mounted and tested after the MKB.

Advanced Electronics:

• ATM for timing has to be replaced in the balcony rooms.  downtime expected to be  15 minutes. Will happen Today at 16:00

CAS:

• Deploy SASE1 topic in the tunnel this week.Tomorrow at 13:oo CAS would like to make the switch. A.Silenzi will write an entry in the logbook to make sure everyone is on board with that.
• Release of the version 2.2.2. being prepared. This would mainly improve the GUI performance.

XPO

• FXE Mono local test performed and OK. To be tested through Karabo in Feb.

CAS SASE3 (C. Youngman):

• Gas attenuator controls being completed and tested.
• Soft MOno local test done and only small problems found
• EPS loop in good state - interlock test tomorrow.

Dear all,

the update to the SASE1 Timing system has been perform with no problems. The Timing board is now running firmware 1.24.0 and the doocs server was updated to version 7.8. I also updated the MCH firmware to version 2.19
 

SPB/SFX:

• Preparation for the mirror installation were ongoing as planned.
• The Karabo and server update went smooth, but scenes were broken a bit more then anticipated so we are still testing on that part.
• ITDM was working on DAQ update and Jola checked out the detector with the new Karabo successfully.

• did not attend / did not send any report

Vacuum:

• SASE1:

  • Vacuum system ready for restart

• SASE3:

  • loops were updated

  • final interlock test ongoing

  • GATT tests with Karabo

    • Vacuum possible

    • manual attenuation of the beam possible, no PID control

    • Controls of Ebara pump needs commissioning.

• SASE2:

  • XTD1: under vacuum, leak test done, all pumps running

Dear all,

please enter your access requests to the tunnels into the list provided by Winni Decking & Co.:

https://ttfinfo.desy.de/elog/XMLlist?file=/XFELelog/data/doc/Access-Requests&xsl=/elogbook/xsl/elog.xsl&picture=true

Can be also found through the usual XFEL-Logbook, and then clicking on "Access Request" on the left hand side.

Cheers, Gerd

Dear all,

the closing of the XTD10 tunnel is shifted to Wednesday (January 31st.) at 2 p.m.

Best regards,

Martin

SPB/SFX:

• Problems with data loggers ==> no statements about the past.
• Loop 5 upgraded
• Alle the other Loops are not at the 100% of their potential but sufficient for the users.
• Test on nkb mirror movement to be done.

XPO

• In SASE3, 4 cameras have trigger problems. AE is working on that.
• In SASE3, 4 cameras have accessibility problems. ITDM is working on that.

CAS SASE3 (C. Youngman):

• Interlock for VAC, GAT and XGM loops are tested and OK
• The rest is so far as it could go. For details refer to C. Youngman report.

ITDM:

• Broken Linecard  replaced .
• Update/switch for the gateway to the control network will happen in one late evening during this week. ITDM will write an entry in the logbook just before. 

Today late in the evening (~22:00), the exflgateway will be migrated to a new hardware. All users will be logged out before migration and home folders will be copied.

After migration is finished, you may experience ssh warning about ssh host key. For all centrally managed Linux this should be fixed the following morning. For all other, like Windows, or yellow desktops, you need to remove the old key and/or accept a changed one. 

Best 

Janusz

SPB/SFX:

• Fixing of Karabo scenes ongoing
• Loop 5 need to be updated after discussion with DET group (Jolanta Stuk)
• A meeting with AE will take place today to discuss the synchronous movement of the mirrors motor. 
• The test on the NKB chamber of the indipendent movement should take place. It has to be double checked that such motors are implemented in Karabo.

CAS SASE3 (C. Youngman):

• SASE3 tunnels closing today at 14:00. All the critical tasks were done. 
• The day before the first lasing, a ZZ access is strongly requested. The request will be discussed in the PSO meeting.

ITDM:

• Tomorrow the DAQ will be available for the AGIPD. LPD to follow. The goal is to have SASE1 ready next week as a whole.

The migration has finished, to avoid temporary problem with ssh you can use

ssh exflgateway -o StrictHostKeyChecking=no

until it will be resolved in the morning ( the usual update of all hosts ssh keys).

Home folder has been changed to /data/<user_name> and it is slightly bigger then before...

Let me know if there is still anything missing.

best, Janusz

SPB

- Loops update OK

- Issue with SmarACT controllers. AE is on it (see below).

- Synch motion of mirrors motion being worked out with AE.

FXE

- Loops update OK

- DAQ updated

- CRL in the tunnel have two encoders with problems. Can be disabled and are not a problem for operation.

- A leak before the diamond window was found. Being closed now.

- Preparation for timing tool commissioning ongoing

- The new user chicane will be probably cut next week.

Laser:

- SASE 1 commissioning and upgrade moves according to plan

- SASE 2 and 3:  so far we still have green light concerning access control, laser safety installations, network and sync for installation of laser tables starting at the beginning of April.

Vacuum

- SASE1 und SASE3 vacuum systems are ready for restart of beam operation

- update of SASE1 vacuum loop on Wednesday caused many problems (all ion pumps in error state)

Optics

- Test piezo motors XTD9 today

XPD

- XTD10: K-Mono, XGM, PES, filter chamber, imagers operational except:

- Karabo tests for Exit slit imager.

- Camera cables to be exchanged for 2 imagers, ZZ access 1h.

- PES, issues with digitiser and MPOD scenes.

- XTD2 and 9: All components operational, Hirex also including Gotthard.

- Next steps

- Progress on scenes and projects implementations.

- Compatibility with new Karabo, Karabo GUI.

- Test and improve usage of DAQ.

AE

- Coordinated motion of MC2 Based Motors were implemented and presented to first users in SPB and XPO as well as to CAS

- The issue with the SmarACT motor controllers observed in the past was due to an issue in the controller. It was solved with an firmware update and requird configuration with dip switches. For this the later usage (e.g. rotary, linear, etc stages) has to be defined. The modifications for SPB is ongoing.

- AE observed, that in some cases PLC related electrical work was carried out until the very last day of open tunnel, which require a PLC firmware update and successive test. Since there is also a risk in the firmware update as it could be, that during tests issues might be observed, there is no access anymore to the actual system and thus could not be solved without ZZ or new access time. We had issues due to this, where at least temporary workarounds were possible - but it could also be different. This is a high risk, which should be know to everyone involved and decided on, if we want to continue like this in the future. AE would prefer to stop with any electrical PLC changes at least some days before tunnel closure and allow firmware updates (possible Karabo changes) and full tests by the users of the components with Karabo in order to identify and solve possible issues.

- Another issue took place, where a change request for a PLC change was issued, but instead of waiting for the finally modified designs to then do the related hardware modification, the modification on hardware were done without any new designs. This creates many problems: no CAD design according to hardware exists, the current revision state of the module is not defined, no firmware structure could be exported and generated for the current design, etc. Therefore modifications without new CAD design and consulting AE is not allowed!

ITDM

- Sase3 tunnels: cabling issues solved.

- DAQ so far stable. Has to be tested at full load now with the new Karabo.

- DAQ update for Tunnels in SASE1 and 3 ongoing. Today and next Monday will be test days.

- Gateway update done: small issue with SSH connections, easily solvable==> the procedure will be posted in the logbook

- The Maxwell cluster will need to be shut down for 2 days next week due to upgrades.

CAS

-  2.2.1 has been deployed without real problems on FXE, LAS, SPB, SA1.

-    In SASE3, it is still 2.1.18 and it will be updated early next week

-    2.2.2 release test cycle almost finished. The release will be published early next week - This release will not be mandatory, but recommended based on the new GUI benefits.

-    SASE3 Tunnel most critical tasks were done, including the gas attenuator by Valerii. It was a really complex task that Valerii went deeply and get it done for us all!

-    Sergey keeps working in Digitizer with Hamed (AE) but based on the deadline they decided to go for the old protocol.

-    Andrea (Alessandro and Steffen) has been working on the AGIPD Library to report when AGIPD will stop to acquire data

-    Gabriele started discussions to address the DAQ for LAS with ITDM.

-    XGM's DOOCS integration has been updated to address TrainID issues. We must allocate 2-3 days to test it with Beam.

SPB

- MIrrors installation (2 horizontal mirrors) in D.02 has started 

 -Synch motion of mirrors will be tested with fake mirrors in D.09 as soon as the control is ready.

SASE3 - CYoungman

- After SASE3 tunnels were closed it was discovered that was not pobbile to set values of the massflow (GAT loop). This required a remote intervention (firmware) that was supposed to be fast and easy  but it was not, and this required work until friday evening. Current status is: The gas attenuator secion closed and in static vacuum since the shutdown of a turbo pump was required. The system is in asafe status.The issues are being analized and solved with experts right now.

-It is important to establish a procedure to set priorities for ZZ access. The issue will be brought up in the PSO meeting

ITDM

-AGIPD p[roject is OK. Jolanta will start taking data already today

SPB/SFX

- An AGIPD crate providing power broke down and has been fixed already by Kai-Eric Ballack. This delayed the data acquisition test planned by Jola. These are being done today.

 -Synch motion of mirrors will be tested with fake mirrors in D.09 as soon as the control is ready. Work is ongoing.

-First mirron in the SPB optics hutch will be installed today. 

- New Karabo release working smoothly so far.

FXE

- CRL in the tunnel being commissioned

 -Leak close to the diamond window being fixed. If everything goes fine ready for parasitic beam on Wed next week.

VAC

-Vacuum interlock tripped twice in the last 12 hours. Issue has to be clarified with CAS.

AE

-Reconfiguration of the SmarACT controllers between rotary and linear motion is being carried out. Marcin and Mahadi are the main players here.

ITDM

-Major safety update of the cluster has to be done. ITDM proposal is to do it next week. SPB and FXE opted for the early morning (between 8 and 10). Exact date will be announced by ITDM as soon as possible.

General

"In the beginning of this meeting SM congratulated the whole staff of the European XFEL and in particular the commissioning team with the very important achievements 
- the first SASE3 lasing / bi-lasing at SASE3/SASE1. It happened yesterday late evening. More information will be given during our PBS meeting next week."

Photon Run Coordinator Report to Readiness Meeting

• parasitic operation in SASE3 (closed 3 undulator segments) for photon commissioning with SR-beam
  • V0 opened, vacuum open down to XHEXP-shutters
  • photon beam detected down to FEL imager, yesterday until SR absorber beyond mirrors M1/M2 and MCP
• photon systems supported tuning/search for SASE1 lasing
• Progress in SASE3: 
  • First Lasing in SASE3/XTD10 
  • simultaneous lasing SASE1 and SASE3

SPB

• During operation Karabo crashed. The problem is not clear yet. Det. loop was affetcted ==> AGIPD tests stopped!
• 2 mirrors in D.02 are being installed.
• Test of the mirrors movements is ongoing
• Motors issues are being checked by AE (Mahadi)

FXE

• Gotthard det. and digitizers back to work
• Leak close to the diamond window being fixed

Laser:

• Timing system has been upgraded - currently we can have any repetitive laser pattern for each laser, number of laser pulses in not limited to number of electron bunches, also we can have lasing when there is no x-ray (electron bunch)

•  Installation according to the plan, no major delays. No commitment to experiments for laser availability in March.

Vacuum

• SASE2:

  • XTD1 under vacuum up to XS2 shutter

• SASE3: 

  • interlock problems solved, runs without problems since yesterday

  • GasAttenuator loop needs update. when is the best time to do that? to be agreed with PRC

Optics

• issues mainly in the XPD section 

XPD

• SASE1 : photon systems supported tuning/search for SASE1 lasing
  • tests of DAQ in SASE1 ongoing
• parasitic operation in SASE3 (closed 3 undulator segments) for photon commissioning with SR-beam
  • V0 opened, vacuum open down to XHEXP-shutters
  • photon beam detected down to FEL imager, yesterday until SR absorber beyond mirrors M1/M2 and MCP
• karabo update to 2.2.x in SASE3 tunnel scheduled for next tuesday morning
• SASE3 DAQ urgently required
• issues with in-vacuum goniometer motor control of KMONO
• issues with IMGFEL to be understood - found a scintillator which works when we have FEL radiation

AE

•  The need to properly plan the activities close to the tunnels closing is pointed put.
• The need of a specific technical coordinator as in SASE3 for the SASE2 tunnels is pointed out

ITDM

•  Sase3 DAQ not ready since Karabo is not yet up-to-date
•  Slow data acquisition issue affecting cameras: being worked out.

CAS

•  In SASE3, deployment of new (2.2.1) Karabo versionwas  delayed because of many people getting the flu.
•  2.2.2 release test cycle ongoing

SPB

• During operation Karabo crashed. As soon as detector is being operated the problem appears. Fixing is still ongoing.
• 2 mirrors in D.02 are being installed.
• Test of the mirrors movements has been performed.

FXE

• Debug of implemented devices ongoing
• Diamond grating in XTD9 has to be moved out of the beam way manually (no remote controls implemented due to long lead time of required beckhoff teminals). Access requested for Wednesday.
• Vac group will check whether beckhoff terminals are available to allow the remote control of the dimaond grating

Vacuum

• During the weekend the XGM in SASE3 was damaged. Details still unknown. 

AE

•  SASE2 XGM local test ongoing
• GAT loop update in SASE3 being done.
• Local checks in XTD10 on Wed.

ITDM

•  Slow data acquisition issue affecting imagers: solved
• One server died over the week end. ITDM notified only today.

SPB

• MIddle layer karabo devices are responsible for the det. Karabo problems. Issue being addressed.
• 2 mirrors in D.02 installed.
• Test of the mirrors movements is done.
• Mirrors cooling bars being installed

Vacuum

• SASE3: 

  • Spikes of the downstream DPS gauges are responsible for the interlocks tripping. Probable cause is related to the beckhoff terminals of the DPS (different from the other gauges). Ongoing.

XPD

• Pop-in monitor filters in XTD10 being changed
• Exit slit imager after Mono XTD10 has ot be commissioned and scintillator has to be put out of the beam way.

AE

•  It can happena that some parameters cannot be set using Karabo due to lack of writing rights. A fix has been found but we would need to update all the loops. Since the problem is just occurring from time to time, AE asks to report specific cases for whoch a solution will be found. Same things happens with the re initialization of some devices. In this case the PLC crashes.
• Timing device in XTD 2 stopped working. Will be fixed today either by remote re start or by local intervention.

ITDM

• Broken server replaced
• Tomorrow there will be an update of the cluster between 9:00 and 10:00. DAQ will be down.
• Reboot of the online cluster needed. To be agreed with Detector group. 1 hour downtime also in this case.

CAS

•  In SASE3, deployment of new (2.2.1) Karabo happened yesterday and seems stable, but brittle. Analysis of the reason ongoing.
• Today GAT final fixes plus testing will be performed

Photon Run Coordinator Report to Readiness Meeting

The maintainance on Wednesday was very successful and all goals were reached (and some extras). 

Thanks to everybody involved in planning and execution! 

- Installation of Karabo 2.2.x in XTD10 went smoothly. 

- SASE1 tuning studies are ongoing. Still there are some things to be learned on compression and 

optimizations will go on Friday. Currently around 250 uJ.

Recent achievments in commissioning: 

SASE1: 

-Peter aligned CRLs in XTD2 to beam. 

-Naresh could work on Hirex

-Liuba and Ilia started pointing studies with imagers (?)

Problem: We found out that gate vales of vacuum are not connected to DESY MPS

(waek beam was hitting one closed valve behind Hirex for about 2 hours)

SASE3: 

- Gas attenuator commissioning started

- Calibration of SRA to optical center of beamline

- The undulator beam was steered 4 mm horizontally. The vertical steering requires movement of undulator center, 

which will be tried possibly on Friday

- Cross calibration of XGM to FEL imager started last night. 

SPB

- KB mirrors

        - installation of horizontal micron KBs finished (approx 8 working days were required)

        - pump carts attached, expected that one week is required before valves can be re-opened (Vacuum group needs ZZ to reconnect valves on the XTD9 side)

        - installation of vertical micron KBs in April

        - D02 will remain cleanroom during the intervening time, i.e. all companies / groups (internal and external) coming on site should be briefed. No access without permission and accompaniment

        - controls tests on elmos completed via Karabo, help from Nerea / Mahadi to get everything working as expected

- configuration of smaract motors

        - commissioning setup will be used during first beam week in March

        - Re-config of smaract controllers by Marcin / Grant / Mahadi mostly completed

- AGIPD

        - firmware update scheduled for this week will not be completed as DESY detector group firmware expert is not available

        - remain limited to 32 patterns per train

        - automatic cooling and powering procedures are not working reliably (requires investigation poss. CAS?)

        - AGIPD chiller fell into an error state after removal of a separate crate BKF00072 (SPB_IRU_LIC), loop 5 redundancy requires investigation (AE)

- Karabo

        - GUI is slow to update or does sometimes not update (request investigation by CAS)

        - devices (e.g. those reporting pressure / temperature) have to be re-started before updates are seen in Karabo (request investigation by CAS)

        - Users have questions about any changes in the implementation of the 'Karabo bridge’. Technical information on how information is broadcast from Karabo is required in order to ensure that users can adapt their monitoring software 

- data trial run

        - Robert suggested trial run for DAQ / user software plugin before the first experiment. SPB can contribute to the execution of these tests and involving users. Requires also action from CAS and ITDM teams

FXE

• Diamond grating in XTD9 can be controlled remotely now
• DAQ test ongoing
• LPD calibration to be  performed

Laser:

•  Installation according to the plan, no major delays. 

Vacuum

SASE1:     ZZ access to connect SPB valves

SASE3:     tripping of interlock seems to be understood, interlock conditions changed,

                if it happens again, the two effected gauges will be removed from interlock until April

           Gas Attenuator is operational, Raul did some tests yesterday, up to 1 mbar

           No feedback control on gas pressure, only manual setting of gas flow

           The device can only be operated by experts so far

Optics

• see PRC section 

XPD

Last wednesday tunnel access:

• „repaired“ SA1 IMGSR trigger (with AE)
• „repaired“ SA3 XGM, restarted (but intentionally without HAMP)
• better routing / fixing of purple Beckhoff loop Ethernet cables and fiber connections is needed

SASE3 vacuum interlock trips (which eventually led to XGM failure on Saturday and reoccured monday night again) were strongly investigated by VAC : now understood ?

work on cross-calibration between XGMs and Imagers (as backup intensity/position monitors when XGM is out of order) with Laurent

DAQ: work with Krzysztof and Luis to get SASE1 DAQ back in operation, and to start SASE3 DAQ (can we test today ?)

Current status of SASE delivery (max. µJ in SA1/SA3): yesterday 390 / 200, this morning 190 / 600

Request to CAS: please plan to send for "training" or "experience" some CAS people to BKR during beam operation, especially the people in CAS who do OCD.

On behalf of Natalia : report to AE on detected issues with the ELMO controller settinsome hours gs of the PBLM motors in SASE1

AE

- stuck trigger timing module in XTD2 restarted (related to SR imager)

- Gas Attenuator PLC loop updated

- PLC modules in SPB rack with SmarACT system rearranged according to updated documentation

- Two bugs in PLC Framework identified, which are fixed now in the current version, but is not deployed yet to most systems:

     - Access rights are not correctly transferred to Karabo. This leads to the fact, that in cases of very special parameters only read access is possible via Karabo (these are automatically injected parameters in Karabo). If you come to the problem of not being able to write such a parameter, please let AE know and we can set it directly to the PLC. This will be solved with the next PLC loop update.

     - A bug was identified, which could in the worst case lead to a full crash of the related PLC. This could be caused by a „re-init“ on a device on the PLC. Therefore do no re-inits on PLC devices. If you really see the need for a re-init of a certain device, please let AE know about this and we see, if this is required and how this could be done. Also this issue will be fixed with the next scheduled update of the PLC loop.

ITDM

•  Cameras issue solved.
• SASE3 DAQ testing to start
• XGM data acquisition to be tested due to karabo/DAQ possible lost of information recently debugged.

CAS

+ Karabo 2.2.2 is released

+ 3rd control pc is set up in BKR

+ SASE3 is running Karabo 2.2.1

+ Karabo 2.2.1 is tested with DAQ

+ as we moved into weeks of commissioning, CAS OCD is regularly (basically every night) involved in and provides support for partly software and partly hardware issues

+ as experiments are coming, Data Analysis integration requests (eg. on Karabo Bridge) shall be channeled to Hans (and to the newly setup DA contacts: Thomas for SPB and Cyril for FXE) directly

+ the gui slowness problem reported by SPB needs to be checked if it comes from the GUI client or from the server and shall be tested with the new Karabo hotfix 2.2.2, too.

DET

LPD canlbration analisis ongoing

LPD Long integration time acquisition being tested

AGIPD: colntrol optimized and tested. Firmware being tested, the aim is to ioncrease the acquisition speed.

AGIPD: next week calibration data to be taken. 

AGIPD: Sensors in the centra area that underwent scattered beam to be checked.

CYoungman - SASE3

 - good progress was made and this type of 'commissioning' mini-shutdown (anything longer than 6 hours) should be performed as often as possible (Wed. shutdown). Next work items would involve: PBLM, ExitSlits....

LBatchelor - XTD6

XTD6: both CRLs (MID CRL2 and HED CRL2) ready for installation (lenses installed and aligned, chambers sealed). Installation should happen next week.

Here is a information from Sandor on CAS OCD Numbers
(this info is copied from the SASE1 commissioning logbook): 

during the day: 98053   (8:00 - 16:00)

overnight: 98054  (11:00 - 8:00 next day) 

during the weekend it is #53 or #54  (Saturday #53 8:00 - 8:00 next day, Sunday #54 8:00- 8:00 next day)

SPB

• KB chamber being pumped down
  

• interaction with AE is ognoing concerning update pf Loop 5 and AGIPD cooling procedure ongoing
• Smaract commissioning ongoing
• The goal is to be ready to start commissioning with beam on 01.03.
• Slit Karabo middle layer - integtration and final fixing being finalized by A. SIlenzi

 FXE

• DAQ test ongoing - fixing of bugs
• After FXE has been moved into the new topic is not possible to read tunnel vacuum pressure anymore. Being discussed with CAS
• Permission to use parasitic beam next week requested to the radiation safety group.

​XPD

• XGM in SASE3 requires physical intervention to be fixed. Access request for tomorrow.
• DAQ groups definition ongoing and being clarified with ITDM

AE

• PBLM moto problem was found to be due to a wrong Karabo-PLC linking. If the tunnel will be accessible tomorrow the issue will be solved. HSinn to decide on priority.
• Soft mono commissioning started and AE support was required. It is not clear what priority does it have. Mahadi is anyway working on that today ad 14:00. If the intervention is found to require more time one has to see.

ITDM

•  During the FXE DAQ tests many problems were found:
  • issues with digitizers
  • issues with scan
  • issues with images acquisition. In this case the problem has been identified (Train ID was 0). KWrona is in contact with CAS to fix the bug.

CAS

• The issue reported by SPB about no data being read from AGIPD temperature sensors has been identified by Gero (CAS) and the fixing is ongoing. 

Report of the XTD10 interventions from last week - Tuesday and Wednesday - C. Youngman 

Many thanks to those who contribute to the "SA3 'further technical coordination push" onTuesday (no-beam XTD10 closed) and Wednesday (XTD10 open) mini-shutdown, below is brief summary. The status items were not highlighted during PSPO's readiness meeting AoB section but are useful to know. Those issues that were raised are contained in the conclusion section. 

We leave the SA3 beamline with a functioning interlock, but you should additionally watch and test your component and ensure that beam operation is possible.

The principle task on Tuesday was

• for ITDM to shutdown and update f/w of the control server CPU hosts in the balcony room, and
• for CAS to replace the Karabo 2.1.18, running since the Oct-Nov shutdown 2017, with Karabo 2.2.1 which is already running on the SA1 installation. 
  • A number of problems during the installation were addressed and a stable deployment was finally reached early in the evening.

The principle task on Wednesday were

• test the updated GATT Ebara pump updated f/w and its s/w counterpart
• test that GATT Bronkhorst Mass-Flow valve f/w worked: correcting conversion errors and the incorrect setting of property r/w attributes
• test that GATT Inficon gauge f/w did not crash the loop and correct  conversion and r/w errors as with the the Mass-Flow valves
• perform Beckhoff-local tests on one or more the DOD motor axes as they were expected to be wrongly wired (as seen in the Jan-Dec shutdown in the VSLIT)
• update the s/w to reflect changes in the GATT f/w
• address difference in the s/w introduced by the move to Karabo 2.2.1

The key-point task listed above have been attained with the following caveats:

• There is a h/w fault which prevents the second Ebara pump being fully controllable remotely, it is currently locally controlled.
• Bronkhorst f/w and s/w is usable, the conversion is correct, but additional s/w work is required to align the s/w
• The Inficon f/w works (it does not crash the loop), the f/w conversion error is identified but not enough time was available to modify it.
• some s/w issues remain which are being addressed (tagging of Ebara, Bronkhorst and Inficon s/w, correct configuration of the vacuum-section..)
• the automatic update of project and scenes was not completely successful so project and scene owners should check and correct their scenes. The auto update procedure will be improved.
• Some data logging information was lost, but e now have regained a standard implementation (not hot-fixed) which should improve the this.
• After measuring that the DOD axes (1 of 10) were incorrectly wired it was concluded that all were incorrectly wired (as had been the VSLIT in the Dec-Jan shutdown)
  • Benoit and Daniele managed to rewire all 10 DOD axes during the mini shutdown and test 1 axis with Karabo.
• PES tests of multi-board digitizer s/w and f/w were continued (with measurements at the crate), these are promising as 'raw' and 'processed' data are now concurrently available.

In conclusion - good progress was made and this type of 'commissioning' mini-shutdown (anything longer than ~4 hours which includes somebody elses longer ZZ) should be performed as often as possible.

This requires

• that the photon run coordinator team know that there is a "list of task" to be performed which are not in the ZZ list
• that a selection of these tasks can be performed within the time budget of a mini-shutdown and that these do not compromise SA3 tunnel operation
• that the photon run coordinators inform the SA3 technical commissioning team (contact a member of the "SA3 tech coord" CAS team setup by Sandor, e.g. Chris, Valerii or Wajid ) so that they can organize the work in time (or report that they cannot as something or someone is not available).

During the next few days a "list-of-task" will be created. This could include technical commissioning actions for SA3: PBLM, ExitSlits, very end of beamline imagers where the status needs updating, etc.

Also remember that the CAS team tries hard to satisfy as many requests as possible, but prioritization will be done, so make your case thoroughly and don't expect it to simply happen (it has to be on the radar screen). In particular h/w, f/w and related s/w tests needing access will be done first and non-critical s/w work will be left until after tunnel closure. And remember to check your projects, scenes, and macros before you need them.