Dear Tobias,

Just to clarify that the last information that we got from SPB was the message below. From this information and the technical evaluation that we did the issue is not strong enough to classify Karabo 2.1.18 as "Currently it is not operational. An operational control system is needed soon". This statement is too strong and does not contain technical fundamental. 

Anyway, we already mentioned in the meeting that since Friday we have been working to solve the problem and we already have alternatives. We will publish a patch (Karabo 2.1.18.x) today or tomorrow.

Finally, I talked offline with Adrian and we agreed about some topics. Especially to review the "mandatory" word in the release process.

Hugo

From: "Marc Messerschmidt" <marc.messerschmidt@desy.de>
To: "Hugo Santos" <hugo.santos@xfel.eu>, "chen xu" <chen.xu@xfel.eu>, "cyril danilevski" <cyril.danilevski@xfel.eu>, "Marc Messerschmidt" <marc.messerschmidt@xfel.eu>, "Jolanta Sztuk-Dambietz" <jolanta.sztuk@xfel.eu>, "Britta Weinhausen" <britta.weinhausen@xfel.eu>, "Alessandro Silenzi" <alessandro.silenzi@xfel.eu>
Cc: "John Wiggins" <john.wiggins@xfel.eu>
Sent: Friday, 13 October, 2017 20:47:41
Subject: AW: GUI Responsiveness in SPB

I saw some issues today as well when instantiating devices, but nothing as bad as yesterday. The gui delay also seemed functional and went only up top around 30s.

Marc 

Dear all,

I updated the schedule for the tunnel access in the upcoming weeks based on the discussions in the PSO- and the Operation Board-meetings:

https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules

Cheers, Gerd

General

• SASE1 Instruments are asked to comment on progress with KARABO 2.1.18
• Tunnels XTD9/10 will be closed on 25 Oct at 1700

Instruments

• FXE (A. Galler):
  • KARABO 2.1.18 appears to be working ok. The device instantiation problem reported earlier in the week is no longer there. However, not all equipment could be tested yet
  • Work currently focusses on preparing for the next User Run and in particular on preparing the sample environment
• SPB (A. Mancuso)
  • A situation similar to the on in FXE is observed. Full proof of functionality of KARABO will only be possible once AGIPD is fully assembled again which is next week at the earliest
  • Currently, work is going on inserting the AGIPD cables into drag chains so that the detector can be moved on the CSS. This work should finish today

Tunnels (J. Eidam, R. Villanueva, T. Maltezopoulos)

• Leaky vacuum pipes were successfully welded
• Absorber section is closed and under vacuum
• MCP detector is connected
• DESY finished work on the upstream section in the dump
• The gas attenuator has very good vacuum (10^-9)
• Differential pumping is ready from the HW side
• Cabling for the gas attenuator section is still going on
• Alignment was done in view of the small apertures in the gas section
• Local tests can start now (This is 3 days behind the schedule made at the beginning of the week)
• PES is installed but will only act as a pipe.

Laser (M Lederer)

• NOPA Beam is now going to FXE
• Next week it will be brought to SPB
• The KARABO version used is several versions back with respect to the one in the instruments and there are still a few minor problems
• On Monday work on programming the laser burst patterns together with the respective people at DESY shall start
• Continue testing
• There appears to be a shortage of conversion crystals for the instruments. New ones have been ordered but are not there yet.

Detectors (P. Lang)

• AGIPD HW work is on track and finishes thie week. Software work starts next week
• LPD control system works ok with KARABO 2.1.18. 
• Some small issues with LPD calibrations

ITDM (K. Wrona)

• Two updates were done for the DAQ of LPD
• Some issues were found with the RC
• It was tried to install a new version. This was already done for AGIPD

AE (T. Freyermuth, B. Baranasic, J. Tolkiehn)

• SASE1 Tunnel:
  • Vacuum loop was updated without problems
  • The motion loop was updated a few times because there were problems with some motors. The work continues today
  • EPS loop was updated
  • On Monday/Tuesday the SPB loop will be updated to account for the terminal changes from 24V -> 48V
• SASE1 Instruments:
  • Loop 5 with the redundancy module is now ok
  • Loops 2, 4, 7 were updated
  • Next come loops 1 and 12
  • All modified modules (24V -> 48V) are installed but a few more might need to be changed
• SASE3 Tunnel:
  • Tried to get the vacuum loop up
  • But there are still many mistakes and inconsistencies with names
  • A big amount of work is still needed for the gas attenuator

CAS (S. Brockhauser)

• KARABO 2.1.18 was deployed
• Good progress was made with the Gotthard and GreatEyes Detectors
• For GreatEyes a specific driver on a specific computer will be used
• The problem with extra delays in the GUI client was resolved
• Scantool:
  • A plan of what to implement exists. This needs to be checked with the instruments
  • A first part of this tool is actually already implemented
  • A. Galler points out that he sees the problems predominantly in the integration with the rest of the environment
• DOOCS2KARABO
  • An example for pipelined data was sent to DESY
  • There is no showstopper seen, but the work is progressing according to priorities which are 1 Laser, 2 Undulators, 3 DOOCS2KARABO
  • Diagnostics points out that the will need both the scantool and DOOCS2KARABO for their commissioning period from 1 - 7 Nov. CAS should please provide information so that the tools can be tried

FXE:

• Pump-probe beam is now in the instrument hutch
• Currently working on setting up the remainder of beam steering and compression
• Gotthardt is working. Tests are going on a and some issues with the DAQ still need to be solved
• The sample stack needs to be moved up stream for the next user period

SPB

• Still working on AGIPD. Many cables needed to be disconnected and are being re-connected now
• AE finished all the scheduled modifications on the crates and are doing some more that were originally not scheduled
• A few details with the interlock need fixing
• The newest version of Beckhoff_Devices needs to be deployed
• The previously observed slowness of the GUI is probably fixed but needs more real life exposure. Final test are being done
• The full infrastructure should be back and operational Tuesday/Wednesday

Tunnels

• Work is going on on the gas attenuator
• Interlocks are ready for the WP74 DPS and the XGM
• Detailed steps to completion in XTD10 were re-iterated by C. Youngman. Additional coordination off line after the meeting
• L. Samoylova mentioned that the mirror encoders in XTD2 are currently in error. B. Baranasic will have a look

AE

• In the new version of KARABO, the rights for reading and writing parameters from and to the PLC are now being observed, differently from before.
• This causes problems. P. Gessler mentions that he is very concerned that such a major change is introduced so briefly before the next user period. This puts AE under great pressure and leaves almost no time for testing
• All the SASE1 loops were updated because of the new "feature" in KARABO
• A. Silenzi mentions that he can implement a workaround for this "feature" so that loops need no updating. However, this requires a new KARABO release

CAS

• KARABO2DOOCS: Meeting today with the DESY control people at 1430 in BKR
• ScanTool: Meeting foreseen Tuesday/Wednesday with the instruments
• The GUI slowness necessiated a hotfix which was verified within CAS. Now waiting for feedback from instruments

General

• After discussion between XFEL Vacuum (J. Eidam) and DESY XFEL Run Coor (Matthias Scholz) it is agreed that XTD10 will only be closed on Thursday and that XFEL will search the tunnel between 15:00 and 17:00. (This information became available only after the meeting)
• This gives some extra time to finish activities in XTD10

Instruments

• FXE
  • Currently A. Parenti and FXE are hunting a spurious data loss in Gotthards
  • Otherwise the software is surprisingly stable
• SPB
  • Slow progress towards getting the Detector going again
  • The task to ease the acquistion needs help from the DESY developers

Tunnels

• XTD10:
  • A lot of progress was made by the team working in XTD10: Thank you very much!
  • The complete tunnel is under vacuum
  • Also the missing pieces between XGM/MCP and the rest were inserted 
  • Cleanup is done
  • Denis and Raul are still working on local tests of the gas attenuator system
  • Testing is somewhat slowed down because the GUI client no longer allows active manipulation of components at the moment. So the ikarabo interface is used
  • Work also continues on getting the mov1 loop going
  • Local tests are done on all imgers except on the exit slit imager
• XTD9
  • ​The FXE Mono is not finished. It needs a restart of the motion loop
  • AE will check when this is possible, but there are a lot of constraints from users and from resources
  • Since there has been a change in the interlock system, SPB needs to be in place when the shutter to XTD9 is opened. There is a risk of triggering the interlock and shutting down the machine.

AE

• Almost everything that was planned could be achieved in XTD10
• Some of the remaining work can be finished when the tunnel is closed.
  • Work is going on to finish the controls
• Even the interface to MPS that was originally not foreseen is now available

CAS

• The workaround that allows to modify parameters even though the protection does not allow this, is now in place. This should help with the trouble observed by the Vacuum Group.
• A new bug in the PLC was observed in this context. Changing a parameter whose name has changed leads to a crash. 

ITDM

• Currently the MAXWELL cluster is unavailable.  This is a serious software/hardware issued. The manufacturer is actually on site to fix the issue today

Instruments

• SPB:
  • When PLC loops are restarted, still many device parameters are not properly recovered. This generates a lot of work for the team. Recently an entire day was lost.
    • Answer from AE: The parameters are extracted by CAS using KARABO. It is possible that not all necessary values are returned. AE is also investigating whether there are some bugs in the firmware procedure. It is pointed out that the change from 24V to 48V led to a huge amount of changes. 
  • Injector motion is now working along all three axes
  • AGIPD automatic power up procedure is now working. Tests continue
• FXE:
  • The spurious data losses with the Gotthard Detector were further investigated. They are not resolved but they do not limit operation with 30 bunches

Tunnels

• XTD10/SASE3
  • All vacuum sections are connected, locally tested and ready
  • Part of the interlock system is also ok. A global test of the entire integrated system still needs to be performed
  • The biggest challenge was the gas attenuator section with 7 turbo pumps. All pumps were locally test and integrated into the control system. The vacuum is very good (10-9) Now they are put into a  safe state.
  • R. Villanueva would like to be informed in case whenever the interlock in XTD10 is broken so he can inspect the system
  • XGM is connected to the overall vacuum and tested. The interlock is working and it is also connected to DOOCS
  • The two imagers requested for first lasing (SR/FEL) are available
  • Approximately one shift would be needed to take care of a few remaining tasks before first lasing
• XTD9/SASE1
  • The HiRex is fully operational
  • The Si-Mono needs work but this was de-prioritized as it is not needed for the next users

Laser

• Full specs were reached for both the SPB and FXE beams. The laser is in the respective instrument laser hutches
• The laser was covered in order to reduce effects of any remaining air drafts
• Differential mode compensation is available. Common mode compensation is not
• Work still continues on the 4 agree-upon bunch patterns. Another meeting is set up for today
• Delay control is available through KARABO but requires ca 2 days testing

Detectors

• For AGIPD both  for turning on power and cooling automatic procedures were implemented and tested
• LPD was moved to Karabo 2.18. 
• One charge injection run was done and the system operated for 2 days without interruts

Electronics

• Currently the work that is still needed for SASE3 is being evaluated
• Planning for the next shut down is going on

CAS

• Currently planning next OCD period
• Very good progress was made in SASE3
• Working on DOOCS/KARABO integration together with DESY
• Work on the laser is progressing
• A. Silenzi and S. Hauff worked on the AGIPD procedures
• Work continues on reading and writing data for the GreatEyes detector
• As reported by the detector group, the stability of the DAQ is much improved

ITDM

• A major problem caused the Maxwell cluster to be down for 3 days. IBM Technicians had to be called
• In this context it became clear that the communication with the users must be optimized
• Now the system is ok
• The folders for the next user run are being set up next week. This was delayed due to the technical problems
• For the experiment log books the users will now be automatically set up
• The update of the DAQ for AGIPD is somewhat delayed due to the long time taken for the recabling
• SPB requested 18 new cameras. This effort needs to be carefully coordinated.

Hi

Logbooks for the first two upcoming proposals in FXE and SPB instruments have been set up and all missing users in the past 6 proposal have been corrected. From now on, user registration is disabled, logbooks for next proposal will be set up automatically once the proposal info is migrated from UPEX to MdCnix. Any subsequent changes (like a new user added in MdCnix to a given proposal) has to be done on request either by admin of particular logbook or ITDM.

Standard setup of beamtime logbooks is the following

• Admin list contains ITDM staff, instrument support group (as given by relevant instruments), PI and Main proposer as given in UPEX
• User access is given ITDM staff, instrument support group and all participants of a given beamtime.

All subsequent customisation, including adding extra users, should be made by logbook admins.

Regarding logbooks for the past proposals in September, not all was corrected according to the above defaults, especially there may be wrong email addresses put at that time by users during registration -this can be fixed as well, taking info from UPEX.

Also HELP logbook was updated.

This change affects also XFEL internal usage of ELOG, as from now on, a new user has to be added by a relevant admin.

Cheers, 

Janusz
 

General

• The rack layouts and rack placement were finalized during the PRR in August. The result is the basis of the network planning. The network is currently being installed and will most likely be finished by the end of the year. Changes to the layout that affect the network planning are no longer possible. 
• The TC/XHEXP1 meetings shall be combined into one bi-weekly meeting starting on 9 Nov. A separater new invitation shall be sent

Instruments

• SPB
  • Currently preparing for the next user period
  • A lot of work still needs to be done for bringing the laser to the interaction point. This mostly concerns the beam pipe
  • Apparently there was an interlock problem related to SPB components in XTD9. SPB components were taken out of the EPS loop without SPB being informed
    • Comment from T. Freyermuth: The condition of SPB devices was preventing beam operation and noone of SPB could be reached
• FXE
  • A lot of progess was made together with CAS
  • This afternoon a DAQ stress test with several detectors is planned
  • The encoders on the CRL lens stack were disabled as this complicates the operation at the moment

Tunnels

• XTD9 was closed yesterday. Beam could arrive this weekend
• About one shift worth of work remains in XTD10 before readiness for lasing
• KMONO measurements took place on Wed/Thurs from 3PM - 3AM
• Some DAQ and KARABO issues surfaced
• But it was possible to record donut radiation patterns
• Now commissioning of HIREX is being prepared
• XGM requires some minor re-commissioning

Laser

• Beam is in the ILHs. 
• Still problems dealing with the capricious AC system
• The promised specs of the laser beam are met
• Synchronization is still to local timing. Synchronization to the machine timing only comes next week and no time remains for testing before users

Detectors

• LPD:
  • 15/16 super modules are operational
  • This week calibration data from charge injection were taken
  • The detector is ready for users
• AGIPD:
  • Detector is fully working again after a big rearrangement of cables
  • It was found the the clocking-control cable is too long and needs to be re-routed during the winter shutdown. The detector will be fine for the next users
  • Work is ongoing on the firmware in order to allow 30 frames/train rather than only 15

Electronics

• SPB:
  • Updated the tunnel loop for SPB
  • Loop 12 is up-to-date
  • Loop4: The mirror mounts were tested locally
  • The is no feed back on interlock behaviour in loop 5. If there should be problems individual conditions can be disabled
  • For loop 7 zoom and focus and mirror mounts to be tested
  • Same applies to loop 2
• XTD9:
  • want to update EPS loop to include removed SPB components today
  • Vacuum loop to be updated next week
• XTD10
  • Some ion pumps show an error condition in KARABO. J. Tolkiehn is investigating

ITDM

• User handling for log books has changed. Please consult the help log book for details or consult J. Szuba
• The meta data catalogue was updated so that instruments can now annotate with their own credentials
• Folders for the next two user proposals are created, also in the online environment
• A new version of the DAQ software needs to be deployed in order to fix a bug in slow data daq

CAS

• A number of issues need to be resolved with Diagnostics as already mentioned earlier
• The Gotthardt Detector is now working in FXE
• The promised reduced scope for the scantool has been achieved. It will be made available to the users asap, most likely today

4.11. from 08:00 until 5.11. 08:00 - Jan Gruenert by email (work mobile defect)

5.11. from 08:00 until 6.11. 08:00 - Naresh Kujala 9-6840 

Dear all,

I updated the TAS to include the upcoming user runs up to and including the winter shutdown. As you can see, there will only be access to the XTDs in cases of urgency. In these cases, please contact Martin Dommach, Harald Sinn or Thomas Tschentscher.

https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules&listViewLinkBack=true

Cheers, Gerd

General

• Recomissioning of the FEL has been bumpy and up to this point only very weak lasing could be achieved. 
• So far SPB had only little beam and FXE had no beam at all. Both instruments state that the commissioning time for the up coming user run is insufficient

Instruments

• FXE:
  • First SW and DAQ stress test on Friday went well.
  • Some problems appeared with the slow data that should be fixed by now
  • K. Wrona states that these problem originated from missing permissions due to change of userid
• SPB 
  • Entire instruments needed re-alignment with beam since the CSS was moved during the shutdown
  • Very low intensity and not very stable beams were available on the Weekend. The beam could not be properly focussed
  • The bender for M2 cannot reach the flat condition. Is this the temperature problem again?
  • One pump was overheating
  • AGIPD tests with new bunch patterns started this morning
  • Significantly more time needed before user operation
  • There were some problems with the interlock system that trigger beam aborts

Tunnel

• Commissioning program was very limited in the last few days
• KMONO got some first interesting results
  • Rings and Kicks could be seen
  • Some wrong undulator settings were identified

Detectors

• Firmware update was done to record all 30 bunches. However this still has problems
• Need beam for calibrations
• The planned update by ITDM of the DAQ was not yet done

Advanced Electronics

• The mentioned interlock issues in SPB require an update to loop 7
• In loop 4 need to reset the "all valves open" signal by hand if it trips
• The SPB Master loop needs updating both for MPS and timing

Software

• Tests of the scantool took place with hardware. These tests continue today
• A new data model is being worked on for the scan tool but this is not available yet
• SPB states that at this point they will not make use of the scan tool as they first have to consolidate the instrument
• FXE is involved in the CAS tests

ITDM

• As mentioned before the DAQ version is still old and needs an update. This contains many improvements
• IBM discovered a bug in GPFS and published a patch. The bug could lead to data corruption
• Decision: DAQ update and GPFS patch will be installed today in the morning.

General

• There is currently no beam less than 24h before user operation is supposed to start in SPB
• The affects everybody (Instruments, Detector, Laser 

General

• User operation is delayed by 48h due to rocky startup of FEL.
• FEL still has not reached acceptable levels of stability and power

Instruments

• SPB:
  • Instrument was brought back to a somewhat running state
  • There are still problems with motors in the sample chamber
  • Alignment with beam is ongoing at this time
• FXE
  • New scan tool was tested
  • Currently working on user-specific alignment tasks
  • Laser was routed to the sample position
  • The beam is still drifting around

Tunnels

• FEL had trouble to find lasing
• There was a controled access on Wednesday to fix various problems. However, further problems appeared
• It was decided to roll back the changes made for a new injector laser, but this did not improve the situation
• At some point 400 uJ were reached and lost again
• There are many problems with the undulator system
  • Incorrect values in lookup tables
  • Difficult operation of the entire system
• FXE should be able to start up tonight
• SPB would follow Saturday morning since time is needed for alignment during the day today
• Shifts for photon diagnostics were largely cancelled due to FEL problems
• KMONO gave some interesting results pointing to the problems in the undulator system
• Next week FEL Imager and KMONO will be installed in SASE2

Laser

• Both SASE1 instruments have laser beam with local timing. 
• Tests with machine timing start today at lunchtime

Detectors

• AGIPD is in best possible state. 
• Firmware and DAQ were upgraded
• Some commissioning time with beam is needed today
• LPD had a cooling leak  and a power problem last night
• At 6 pm yesterday, this was still not fixed

AE

• Continuing small activities for user operation

ITDM

• A small bug was found in the DAQ that affects only slow devices  with certain train ids
• It is proposed to fix this during the next break. Decide on this Monday

CAS

• Dedicated squads for the setups of SPB/FXE, DOOCS integration, Scan Tool closed now
• Tools delivered but with significantly reduced scope
• All necessary things for DOOCS Karabo integration were delivered. Now waiting for DESY

General

• No user operation.
• During the week end the accelerator was not able to deliver reliable and stable beam for the user operation.
• The M2 mirror bender stopped working on Saturday morning and had to be replaced. The mirror and blender were replaced as a whole durig the week end. Normally it would have taker weeks but a "spare" system was already set up for SASE2 and could be used on a short notice. Pumping of the M2 section is ongoing and leak test be performed today.
• The non working M2 does not show apparent problems so far, and the reason why was not working is not clear.
• Some sections of the LINAC were warmed up due to some maintenance required for the cold compressors.
• LINAC is being cooled down and ready for operation today afternoon.
• The technical support groups were not informed about the problems until saturday afternoon. The communication channels in these cases have to be improved.

​Instruments

• SPB and FXE:
  • The goal is to be able to strat the secondo users run on Thursday (Day FXE, Night SPB).

Tunnels

• XTD2,9 Ready to take beam in the afternoon (if no leak in M2 is discovered).

ITDM

• A small bug was found in the DAQ that affects only slow devices  with certain train ids
• It is proposed to fix this during the next break. Decide on Wednesday

Dear all,

I received updates from DESY (M. Hüning) about how the access to the southern tunnels is being restricted in the next months, due to interlock tests etc., and included it in the TAS. Please check, if you have work to be done in these tunnels:

https://docs.xfel.eu/share/page/site/PSC/wiki-page?title=Tunnel_access_schedules

Cheers, Gerd

Instruments

• SPB:
  • Waiting for beam to come in a usable condition (500 uJ and pointing within aperture of optical elements)
• FXE
  • Similar

AE

• There was an interrupt of the vacuum loop in XTD2 due to a faulty pump controller. This was fixed by ZZ
• Rotational SmarACT stage and slits in the sample chamber for SPB are being worked on

CAS

• Due to change of beam schedule, now working on implementing more devices in DOOCS-KARABO for Jan Grünert

ITDM

• Will upgrade DAQ software today. Note: Still based on KARABO 2.1.16

General

• Beam is back with good intensity (up to 1 mJ) 
• Next user period starts on  23 Nov
• Time between now and then should be used to optimize FEL, beam lines and Instruments

Instruments

• FXE:
  • Measurements of pulse intensity were done using an XGM from DESY in the hutch
  • A  pulse intensity of ca 40 uJ was found. This is in rough agreement with the expectations
  • Spectrometer was aligned
  • GreatEyes and Gotthardt detectors are working fine
  • LPD still to be checked
• SPB:
  • Using beam to do alignment
  • Not such a good focus (too big)
  • Plans are to continue with instrument commissioning today and Saturday
  • Work is currently being done by Mahadi on the SmarACT rotary stages
  • FXE points out that most likely SPB operated with the FXE CRLs inserted into the beam
  • Note: The standard "switching script" from Harald should be used to make sure parameters and devices are properly adjusted when beam is switched from one instrument to the other
  • Detector calibration on Sunday

Tunnels

• Last Friday there was a Bender failure on mirror M2
• The mirror was removed from the tunnel during the weekend and the SASE2 spare was inserted 
• In the process one Beckhoff controller was found broken
• In the removal process a further problem was caused in one of the Beckhoff loops
• This problem could be fixed from outside the tunnel 
• After this 20h were spent to redo Beam-Based Alignment in 7 iterations
• The new orbit deviates from the old by up to 80 um.
• After using the new orbit, the FEL lased quickly with good intensity
• The replaced mirror M2 could be re-aligned 
• On Thursday beam was available to FXE
• Remark from J. Grünert: Instruments should make sure that most up-to-date DOOCS panel is loaded to see proper XGM info
• Update of DAQ caused DAQ in tunnels to be broken. This is now fixed according to K. Wrona
• HIREX commissiong is going in parallel 

Detectors

• AGIPD:
  • Before the bender failure a few X-Rays could be taken on AGIPD
  • It looks like 30 X-Ray pulse can be taken now
  • Additional flat field calibration is needed now
  • On Sunday a full shift is foreseen for commissioning with beam
• LPD:
  • One quadrant was disassembled to find the cooling leak.
  • Leak now appears to be fixed
  • No sign of dead spots on detector

Laser

• We are operating in shifts:  early / late, although experiments have been cancelled, performing shift change and other excercises for commissioning.
• Operating the laser with machine timing was so far hampered by the fact that the transmitted laser patterns from the machine were limited to the actual number of x-ray pulses, i. e. mostly non-deterministic 1 or 0. Optical alignment and characterization is not possible under those conditions. Therefore, on the weekend we have switched to local timing to give guys some power.
• Following this experience, we have decided to attempt local generation of laser patterns under machine timing in order to be independent of the machine and not have to switch back and forth between local and machine timing. This has been implemented and is under test today and over night. We still observe spurious long term drifts, which are under investigation.  However, if finally successful, this can only be a make shift solution for the coming weeks. Mid to long term we need proper implementation by DESY, allowing pattern changes on short notice and independent of the machine. This is in preparation (time line ca. mid 2018).
• Currently, beams are sent to FXE and SPB with 30 pulses each, 800nm broadband, should be compressible to 15fs. This is under machine timing but with locally generated patterns.
• There are other curiosities concerning machine timing, which are related to the increased T0 arrival time jitter compared with our local timing. Debugging is ongoing. We are also testing various features under above conditions (machine timing, local pattern):  phase shifter, trigger shifter, shift change. Time line: depending on outcome, daily updates will be provided.

AE

• When the breakdown of the interlock occured in conjunction with the broken Beckhoff terminal it became obvious that crucial emergency phone numbers are not available
• Better emergency procedures are needed
• The special EPS operation mentioned to align the mirrors should be written down so that it can be implemented an no override of the interlock system is needed
• The list of shutdown activities compiled by PSPO contains a lot of work for AE. This is now being discussed. 

ITDM

• Some problems occured this week with DAQ of slow data. This should have been fixed yesterday

CAS

• Doing 24/7 OCD support 
• During switch between instrument CAS comes in to provide support
• The cancellation of user operation last weekend was not properly communicated so that people came in unnecessarily
• Next week additional work for WP74 is being done

General

• Intensity and availability of beam was good over the weekend
• Large drifts and jitter were observed that are significantly higher than previously
• Beam has two horizontal lobes as if it is too large for the mirrors

Instruments

• SPB:
  • Many tasks were achieved during the weekend, e. g. instrument alignment, detector calibration
  • Issue with encoders whose cables are close to motor cables persists. These encoders are being disabled
  • Rotational SmarACT stages still do not work and are needed for this week's user experiment
• FXE
  • At shift start on Saturday after reloading beam parameters there was no beam in the hutch.
  • Beam had to be brought back by hand. This was a large effort
  • This situation did not repeat on Sunday
  • LPD detector had problems: Only one super module correctly recorded data. Comment from S. Hauf: FXE should have called the detector expert
  • PP laser synchronisation does not work properly yet: Increments when adjusting timing are too coarse. Scan range is limited to 18ns

Detector

• Detector group was not informed about the LPD issues in FXE. 
• AGIPD calibrations were successfully taken on Sunday

ITDM

• Still work is needed for slow data DAQ
• DAQ behaves differently in SPB and FXE. In FXE it appears overloaded and in SPB it works fine
• Comment from CAS: 
  • Many changes were made in the KARABO framework to allow asynchronous operation
  • These changes have to be also pulled through to DAQ. This will only be done during the winter shutdown
  • Until then, DAQ is very vulnerable to any delay in the system

CAS

• No further comments

AE

• Currently working on problems with rotational stages in SPB

General

• User experiments resume tomorrow morning
• Beam should be coming back late this morning or early this afternoon
• After the Operation Coordinaton Meeting H. Sinn, L. Samoylova and the instruments will align the mirrors
• Beam to the instruments should be available directly after this

Instruments

• SPB:
  • The last night with beam on Monday was used to take flat field calibrations with AGIPD
  • The timing for overlap with the optical laser was adjusted
  • 5 out of 6 SmarACT rotational stages are now operations. Some problems remain and AE is talking to the manufacturer
• FXE
  • Request for use of the beam after 9 PM
  • Can be given to SPB starting at 5 AM tomorrow for final setup 

Detectors

• Connection to the ONDA system was set up for the detectors
• Significant latency develops quickly an saturates at approximately 2 mins

ITDM

• Simultaneous use of the DAQ system by both instruments should be done carefullly

AE

• no further comment

CAS

• no further comment