Group Selection Page HELP DOC Controls Group Data Analysis Group ITDM WP76 DET Vacuum XRO EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Photon Commissioning Team Operation PSPO XO TS
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Joint Operation and Readiness Logbook, Contact: T.Haas, A. Violante, G. Wellenreuther, Page 15 of 30  Not logged in ELOG logo
ID Date Author Location Severity Subjectdown
  438   08 Jan 2018, 13:47 Monica ArestéGeneralInformationStatus and plans after Readiness Meeting

PSPO:

- G. Wellenreuther inform that DESY is commissioning a new gun in the injector that could take longer than expected. Harald Sinn is in a meeting today to disccuss this issue, any change in the scheduled will be reported.

 

SPB:

- Lost motor positions in the tunnel, CRL in defined state. Good state in general no major problems expected.

- Detector was clabled again.

- Loop updates still pending, SPB request to have loops ready during this week.

 

FXE: No one attended

 

Vacuum:

- SASE1:

  • Some works in CRL for XTD1.
  • Working in FXE grating chamber, necessary to update Vacuum loop.

- SASE3:

  • M1 and M2 mirrors were installed before X-mas. Mirrors installation in K-mono to be finished next week.
  • Created new loop this affects Vacuum loop, update necessary.
  • XGM loop need to be updated.
  • Motion loop 1 is working, some works in MCP motors on going.

 

Diagnostics:

- Technical commissioning of MCP on going together with the Russian collegues.

- MCP SASE2 will be transported to XTD6 on Wednesday afternoon.

 

AE:

- Working to implement redundancy into FXE loops.

- To agree a date with FXE to work in the grating chamber at the end of XTD10.

- Motion loop for SASE1 will be interrupted this afternoon at 14:00 to add some terminals for mirror 2.

 

Software:

- Deployment of Karabo 2.2.0 will start this Wednesday in FXE.

- Next dates for Karabo deployment are: 15th January for the Tunnels,  22nd January for SPB.

 

TS:

- Torsten Schoen inform that it is necessary to carry out an 'Emergency off button' test during the Shutdown.

- SPB agreed to perfom the test the 22nd January in the morning.

- For FXE the proposal is to perfom the test the 17th January, to be confirmed with AE and FXE.

 

 

 

 

 

 

 

 

 

  448   12 Jan 2018, 11:10 Gerd WellenreutherGeneralInformationStatus and plans after Readiness Meeting
SPB:
- AGIPD was tested with old mc board to verify that it was working fine
after the in-vacuum intervention in Dec 2017. The detector is working
and also the vacuum is ok.
- The exchange of the mc and mfpga boards is ongoing and will continue
next week (according to planning)

FXE:
- Diffraction Grating is being installed by JJ-XRay. End to end tests to 
follow.
- Karabo being updated to the 2.2.1. version.

Vacuum:
SASE1:
- CRL XTD2 closed yesterday, seems to be leak tight
- PLC VAC loop update done yesterday
SASE3:
- soft mono chamber still open, XRO is installing mirrors
- MCP connected to beamline again, pumped down yesterday
- VAC - GATT loop separation ongoing, loop restart next Monday

XPD:
SASE1:
- rebooted vacuum loop yesterday, XGM vacuum gymnastics
SASE3:
- MCP technical comm.:  motor tests, some rewiring & enabling control of HV
- Imagers: all imagers in motion Loop 1 and 2 - some small mistakes
- Photonic Science camera issue (16bit) is solved
SASE2:
- MCP transported into tunnel XTD6
- now ALL vacuum chambers of XPD are in the TUNNELS (few more for the hall)

Laser:
- the timing specification has been extended, 6 laser patterns available
for SASE1/2/3 and the laser lab. 4 others are reserver for SASE4/5. In
the next months desy will upgrade doocs servers and firmware.
- SASE1: pp-laser upgrade and remaining commissioning progress as per
plan (finish end of March). No commitments to experiments till then.
- SASE3 and 2: Plenums are being installed. Plans for laser table
installations: currently still for April.

Detectors:
- did not attend

AE:
SASE3
- Gas attenuator is in separate loop and loop running
- MOV loop 1 updated (incl. MCP related change)
- Plan to update EPS loop today
- VAC loop update planned for Monday
- MicroTCA crate for PES replaced - Timing back for this crate and also
for XGM and KMONO
General 
- Timing changes - Machine switched to 1Hz and they reset the train IDs to avoid soon issues with the machine DAQ system

ITDM:
 - LPD recabled with Infiniband connection. Test ongoing.
 - Meeting next week to decide whether to use or not the train builder for 
AGIPD and LPD detectors
 - in 3 racks in XTD10 some network connection added last year do not work 
properly. The responsible company is comeing back next week to check the 
cabling. Interventions have to be planned accordingly since the Beckhoff 
loops are running!

CAS:
- Karabo 2.2.1 has been created and its roll out for hw tests on real
field has been started
- We have started at FXE. Until now only a single problem has been found
with LPD FEM.
- Laser Laboratory has also been updated without any problem detected
until now
- Next Monday Lasers group's PPL installation will be upgraded
- Next week, SPB will be upgraded also step-by-step
- Finally, SASE1 will also be upgraded.

  455   22 Jan 2018, 10:36 Gerd WellenreutherGeneralInformationStatus and plans after Readiness Meeting

SPB/SFX:

  • 2nd AGIPD intervention will be finished today.
  • SE worked on a reliable procedure for nozzle exchange and trained the instrument scientists
  • SmarAct motors are in error, Mahadi / AE is informed. These motors are needed for user operation / commissioning.
  • loop 5 update still outstanding
  • Karabo update for loop 1-4 was done, seems to be ok. Full update is planned for beginning of next week.

FXE:

  • JJ X-rays finalized installation of the last components at FXE:
    • Diamond grating (in XTD9)
    • Spectrum analyzers
    • Timing tool
    • repositioning of the sample manipulator and working on better cabling
    • minor work on cables of FXE CRL to allow full movement along the beam direction
    • Johann spectrometer
  • FXE got the information from CAS that the Karabo update was successful and it’s ready for testing
  • FXE decided not not pursue the further commissioning of the new equipment due to the emergency power off tests
  • FXE is working on a more universal sample environment allowing faster and more reliable changes from solid to liquid experiments.

Vacuum:

SASE1:

  • vacuum system closed,
  • PLC loop update done,
  • ready for restart

SASE2:

  • XTD1 all devices in the tunnel and aligned

SASE3:

  • Soft Mono chamber closed yesterday, pumpdown, leaktest later today
  • GasAttenuator comissioning ongoing
  • Karabo scene developement

XPD:

  • SASE3 MCP detector technical commissioning:
    • HV tested OK (MPOD operational), today ADC/signal test
    • motors: rewiring done --> correct directions and limit switches
    • motors were intermediately ok, but are not stable (now there are again issues)
    • several PLC / karabo issues were sorted out, ok
  • SASE3 XGM:
    • test with Kr gas supply yesterday/today
    • test with gas plus HV
  • SASE3 PES:
    • ordered grounding works (cabling) to be done similar to what was done for the XGM
  • SASE2 XGM:
    • vacuum incident: vacuum operation of the XGM in XTD6 was unauthorized interrupted for some time, The rack had been powered down without prior information to XPD.
    • Reminder to all that rack near the XGMs shall be powered down only after informing and coordinating with XPD.

Laser:

 

  • SASE1 PP-laser commissioning and upgrade is continuing according to our plan.
  • Karabo upgrade to 2.2.1 was rather uneventful and successful.
  • Hutch readiness milestones for laser hutches in SASE 3 and 2 seem to consolidate:  15. March. If this continues to hold, we will start our Phase II installation of PP-lasers in E.04 and A.04 with laser tables at the start of April. Laser tables for the ILHs will be installed at the same time.

Detectors: Did not attend.

Advanced Electronics:

  • Replacement of the microTCA for the PES was done
  • microTCA update of the timing system was done
  • local test of the CRL can be done after the cables and the hardware have been fixed by the Vacuum group
  • All loops of FXE updated (firmware etc.)

ITDM:

  • Network ports for SASE2 in the racks have been fixed
  • DAQ in SASE1 needs fixing of hardware, foreseen for CW 4
  • Test of DAQ with new Karabo release is on its way, should be done by Wednesday 24.1.

CAS:

 

  • Karabo 2.2.1 has been deployed on FXE, LAS-LAB, LAS-PPL, and 3 SPB loops without any real problems
  • migration continues next week on SPB
  • BKR will be equiped with a 3rd Karabo Control PCs (we work with Tim already on it)

 

  140   12 Apr 2017, 12:52 Tobias HaasGeneralInformationStatus and plans after 09:30 meeting

 Tunnel Closed.

Mirrors:

Status:

  • No information on status of mirrors and PBLM since Optics group was not at the meeting

Vacuum Loop:

Status:

  • All vacuum sections were successfully tested in XTD2 yesterday (work ended very late)
  • DPS was tested successfully and all interlocks and remote controls were working
  • The protection switch on the ion pumps can still not be actuated remotely 
  • XGMs in XTD2 and XTD9 fully in the interlock 
  • V0 valve and absorber were moved and interlock tested. Communication with DESY was also tested and is ok.

EPS Loop:

Status:

  • No explicit information today (see remark above)

Motion Loop:

Status:

  • No explicit information today (see remark above)

Imagers

Status:

  • All imagers in XTD2 are ok
  • Trigger is not working on one of three imagers. 
  • Testing proceeded in XTD9 yesterday
  • One camera in one pop-in can not be reached (Network problem?)

Karabo:

Status:

  • Running stably
  • Work required now:
  • Photonics Camera driver
  • Clean up the project database
  • Clean up master equipment list

 

Tasks for today:

 

Note: All loops should be left running and no changes to Karabo.

  • Proceed with remote testing
  • Check out adequacy of scenes
  • Monitor stability and responsiveness of GUI Server and Log Servers 
  • Set up monitoring of temperatures and pressures overnight (A. Silenzi)
  • Cleanup Karabo

Tasks for tomorrow:

  • Tunnels should re-open tomorrow
  • Continue tests from remote and check stability and robustness of systems

Other topics

  • Tunnels open over the Easter weekend and also during the day on Tuesday 18 April
  • There will be a SASE Readiness Meeting at 09:00 on Thursday in XHQ E1.173

 

  381   11 Sep 2017, 10:32 Tobias HaasGeneralInformationStatus and plans after 09:30 meeting

General

  • ​More or less continuous beam delivery over the weekend
  • Beam was lost 2 times. Took almost 2h to recover in the second case
  • The stability of the machine was poor. 
  • SPB cannot achieve a good focus and FXE reports sync problems as the timining jumps by 220ns (1 bucket) from train to train

SPB

  • Liquid jet could be operated with water for an entire shift
  • Images were acquired both with powder samples as well as with the water jet
  • A lot of flat field data was taken for AGIPD calibration
  • One camera had a problem and CAS was called in
  • There is unexpected behaviour with limit switches. Suspicion from CAS: A SW flag might be incorrectly set. A. Silenzi and B. Weinhausen will investigate)

FXE

  • As stated above, the timing jumps in machine operation render pump-probe experiments impossible. A way out might be 4.5MHz operation which has other issues
  • Need a lot more experience with the new scan tool
  • Request is made for training on the configurator tool: ITDM reports that they have set up a script to set the many parameters from stored values
  • There is a fundamental problem that the scan tools does not see some parameters available in DOOCs. Hence scanning is not really possible right now.

AE

  • There are at least two arms in the XTD2 CRL in error. This requires access. Possibly bundle with the ZZ request of W. Freund
  • Two loops in SPB still require update (loops5/12)
  • It is not clear why many configuration parameters have to be put back by hand after a loop update. N. Jardon and B. Weinhausen will check

ITDM

  • Many tests over the weekend for DAQ of slow data with SPB
  • Problems were observed because train IDs were zero
  • Also time stamps showed values of many hundred hours ago
  • CAS suspects that this might be due to wrong configuration of some devices (use_timeserver flag)
  387   20 Sep 2017, 11:15 Tobias HaasGeneralInformationStatus and plans after 09:30 meeting

General

  • First user experiments ended on Monday evening/Tuesday morning
  • They are considered a great success and overall the instruments worked better than expected
  • The S1S/S3R meeting on Friday happens at 13:00 this week due to SAC

SPB

  • Karabo is freezing up much less frequently than previously
  • The latency of data being available for online analysis seems to be increasing
  • Todos:
    • Update the laser loop (11) today
  • Please keep in mind that updating the PLC loops requires a lot of hand work from the instrument afterwards and should not be done during beam time

FXE

  • FXE was not represented
  • The parallel operation of Gotthard and LPD was discussed. This is currently not possible. But this restriction was put deliberatly in order not to compromise LPD operation. It can be lifted whenever requested. However, the incoming user group will only need LPD. Hence this should be postponed for one week

AE

  • Preparations are ongoing for work on SASE3 tunnel during October shutdown
  • Prepartions are on done to connect the EPS in SPB to the DESY MPS system

CAS

  • The second stage of the SPB-CAS and SPB-FXE projects has been started
  • They include additional functionality that is required for user operation in November and also for the operation with the optical laser
  • The next Karabo release is being prepared
  • Next thing on the list is to implement the slow data acquisition for the tunnels
  233   15 May 2017, 11:02 Tobias HaasGeneralInformationStatus and plans after 09:00 meeting in BKR

 Issues observed by PCT over the weekend (from H. Sinn entry in the PCT log)

- The interlock of the vacuum valves worked as expected. However, we had two times the gas section around the XGM tripping the beam, because the gate valves around the XGM were closing. The reason for these trips will be investigated (probably noise on one of the involved pressure gauges). In the future it would be good to change the Vacuum-to-MPS interlock such that V0 always closes, if any of the other gate vales closes. Then the accelerator permission would come automatically come back after the trip. However re-booting of the vacuum loop needs to be planned (trips the DESY beam permission and potentially shuts down the turbo pumps). 

- The SR Imager may loose steps when moving larger distances (speed too high?)

- Several general problems of Karabo were observed, which make live difficult: For example, the 'V0 closed' and 'B4C in' indication on our main screen may just lock, even when the state of the device is changing (was observed mostly on GUI server1). It means that the status displayed on a scene can be in general not be trusted. In many cases we observed that connecting freshly opened scenes to devices take unacceptably long times (many minutes or never).  The policy of saving projects and sub-projects leads to overwriting changes, if more people work on projects and projects stay open for longer time.  

- The fact that the PLC does actually not store values through a reboot causes many problems. It basically means that motor positions are lost (set to zero) at every reboot and can be only recovered, if homing or absolute encoders exist. Also that positions of motors cannot be reset to their theoretical values means that in practice the state before the PLC reboot cannot be recovered by resetting the values.

- The imagers, in particular the SR-imager, caused a lot of problems because they were often crashing and require advanced and complicated procedures to make them run again (e.g. setting after re-instantiating the imagers are lost and come up with wrong pre-sets). The SR-imager does auto-scaling on the intensity, also when this is disabled in the software. This make the imager only useful for qualitative studies (e.g. not for gain curve or flux measurements).

General

  • Parameters of motors get lost after reboot of the PLC
  • Setting trigger delays can currently only be done with special authorisation from DOOCS. 
  • Suggested solution from AE: Hardwire the correct defaults in the firmware
  • A better procedure is needed to communicate the parameters between hardware experts and AE
  • L. Samoylova suggests that CAS person on call contacts BKR once per day to establish contact and get an overall impression
  • The support of CAS during the weekend was greatly appreciated

Vacuum

  • No calls to experts over the weekend
  • Issue with the XGM vacuum (spurious triggers of the interlock) needs to be fixed 
  • Interlock logic should be changed so that V0 always closes if one of the gate valves closes

Imagers

  • SR Imager crashed frequently and was hard to bring back
  • Auto-scaling of SR-imager cannot be switched off. This needs fixing with high priority

XGM

  • Commissioning starts today
  • See above about vacuum issues

PLC

  • No calls over the weekend to the experts
  • Firmware for MC2 lib (TECHNOSOFT motors) is prepared and waiting for tests

Karabo

  • CAS was called a few times on the weekend
  • Running more than one camera at the same time appears  to cause crashes. Possibly network bandwidth is insufficient
  • A procedure can be set up to read out the motor parameters at a well defined point in time for storing them in the firmware 
  • Setting trigger delays should be made to work from Karabo

Work for next days

  • Karabo test with MC2 Lib in the lab. As soon as this is successful it will continue in XTD9. Will be done on the SPB attenuator as N. Gerassimova is not available for PBLM tests due to a beam time
  • Fix the Photonics camera driver so that auto-scaling can be turned off

 

 
  109   06 Apr 2017, 11:27 Tobias HaasGeneralInformationStatus and Schedule after 09:30 meeting

 Tunnel Open.

Mirrors:

Status:

  • Vacuum will be closed on M1
  • M2 installation tomorrow or latest on Monday

Vacuum Loop:

Status:

  • Loop is up
  • XGM was integrated but tests needed on the interlocks. Hence valves to DPS now in manual mode (overrides interlock)
  • Interface to MPS has been successfully tested
  • Need to test fast valve connection to VAC and to MPS (Status re cabling was unclear this morning)
  • A few pumps still  have communication problems (to be discussed between AE and CAS)

EPS Loop:

Status:

  • AE did most of the missing wiring
  • Description of EPS interlock still missing. It is planned to start with just one imager in for first beam commissioning
  • One fiber connection from Balcony room to DESY still to be done by DESY

Motion Loop:

Status:

  • Problem on ELMO motors with linear drive persists. Needs additional testing

Imagers

Status:

  • Both motors working on FEL imager
  • Work should now concentrate on SR imager

Karabo:

Status:

  • Problem in TCP implementation identified that is suspected to cause the long delays observed e. g. with the imagers. Now needs extensive testing
  • Still no data recording achieved
  • Stability still needs monitoring

 

 

Tasks for today:

  • Work on GUI for the vacuum loop (J. Eidam, V. Bondar)
  • Test XGM interlocks (N. Jardon, M. Planas, T. Matsopoulos)
  • Continue tests with PBLM in the tunnels (M. Jidda)
  • Test motion system of the imagers in the tunnels (A. Koch and W. Ehsan)
  • Monitor stability and responsiveness of GUI Server and Log Servers (A. Silenzi)
  • Set up monitoring of temperatures and pressures overnight (A. Silenzi)
  • Push DESY to install fiber connection from Balcony rooms to MPS (P. Gessler)

Tasks for tomorrow:

  • Put XGM into the vacuum interlock
  • Perform careful testing of all interlock conditions for the vacuum

Other topics

  • Regular SASE1 readiness meeting at 09:00 tomorrow in XHQ E1.173
  • Need to perform tests with EPS interlock conditions
  • Need to test fast valve connection to VAC and to MPS
  • Gas system for diagnostics needs to be flushed
  338   19 Jul 2017, 10:11 Tobias HaasGeneralInformationStatus and Schedule after 09:30 meeting

General

  • The latency observed by SPB in the GUI client could be reproduced by CAS. Also a  potential reason was identified. As soon as this has been sufficiently tested it will be released
  • DAQ tests in FXE with LPD worked for the first time yesterday for 1/16 of the detector
  • FXE and SPB will show 1-2 slides about progress and ongoing work during the TC meeting on Friday morning

XTDs

  • Fast valve in XTD9 still has issues with noise and will probably need to remain disabled

FXE

  • Interlock for loop 1 was deployed. Still need to do loop 2. Work per loop requires ca. 3-4 h.

SPB

  • Firmware for the AGIPD hv power supply was updated. The spikes during ramping are gone
  • Next items to get going are the SMARAGD motors
  • Loop 7 needs to be brought back. Crate 51 has been fixed.
  • Work on in vacuum interlock in SPB will need to be carefully timed and coordinated after finishing FXE. Due to impending beam probably not before next week
  365   21 Aug 2017, 16:26 Tobias HaasGeneralInformationStatus and Schedule after 09:30 meeting

General

  • Access to tunnel XTD10 ends today around midday and beam is expected back for the instruments on Thursday

SPB

  • Good progress was made over the weekend with AGIPD. On Saturday first dark images were recorded
  • Today the detector hybrids are being exchanged (1.0 -> 1.1)
  • The injector motion system was taken into operation
  • The SmarACT stages can currently not be tested since some parts are disassembled for final AGIPD installation

FXE

  • Some loose ends were tied up for LPD
  • JJXray was here last week and did some more installations, e. g. I0 monitors and alignment of the sample stack
  • This week Gotthard integration will proceed

Tunnels

  • The vacuum loop is now running for XTD10 with the full design firmware
  • Approximately 40 ion pumps were locally test and are no under PLC control
  • Almost all valves were locally tested and are also under PLC control
  • XGM is connected to its own PLC currently (integrating Vacuum and gas supply)

CAS

  • A disucssion on the details of Gotthard integration will happen with FXE after this meeting
  369   23 Aug 2017, 10:20 Tobias HaasGeneralInformationStatus and Schedule after 09:30 meeting

CAS

  • Finishing tests for KARABO 2.1.15. Deployment should start today during the middle of the day for SPB
  • SPB asks for additional slow data to be included in the DAQ. This requires tests after 2.1.15 is deployed
  • For the moment 2.1.15 will only be deployed for SPB. Once it is installed on all control servers, switch from 2.1.13 can take place
  • The switch can be reversed in case of problems
  • AGIPD control server will remain on current software version for the moment

FXE

  • FXE was unfortunately not represented
  • AE needs to perform updates on loops 9 and 7 

Tunnels

  • Beam should be coming back today
  • XTD9 will be searched today at 1400
  • In XTD10 7/10 imagers were succefully tested and integrated. The rest will have to be done in October

AE

  • Need to test one motor for SPB/CSS
  • Yesterday 4 encoders in SPB were fixed but one additional problem was identified with the microscope stage in the sample chamber`
  • N. Jardon needs to do further updates of PLC loops for SPB. This will be done after KARABO has been upgraded, probably tomorrow

CAS

  • KARABO 2.1.15 should contain crucial fixes to associate data from tunnel devices with detector images
  • Initially this will be possible train-by-train
  • Pulse-by-pulse association, e. g. as needed for XGM, will require further work
  166   25 Apr 2017, 10:49 Adriano ViolanteGeneralInformationStatus and Plans after the 9:30 meeting

XTDs Info:

Tunnel XTD2 will be accessible this Thursday, 27.04. between 9 and 12. Dosimeter and General radiation training required. Access requests should go to T.Haas.

XTD10 will be closed starting from this Thursday, 27.04. at 12:00

Provided that the authorities give the "go ahead", DESY plans to put beam in XTD2 on Thursday's evening.

 

Karabo:

  • System running  but performance of the GUI still sluggish
  • There appears to be a resource leak. Second server will be set up tomorrow as workaround. Experts are working on it.
  • In parallel experts are working on a definitive solution
  • Deployment today on a new beckhoff device for the decodification of PLC error messages.

Vacuum:

  • Systematic tests of ion pumps started again

PBLM/Motion Loop: 

  • There is a resource problem when trying to read out the cameras. This problem will be reconsidered once the general issue with the GUI server is solved.
  • ASilenzi will ask Natalia for acceptance test definition for PBLM
  • Motion loop will be down until 10:30 for update. An entry will be written when the loop is again up. 

SPB Tunnel components

  • The Renishaw encoders can be read and positions are reliable. An error message is coming from the encoder and is probably due to a wrong voltage level delivered to the encoder. The encoders can be operated in this condition.
  • T. Freyermuth is in contact with the encoder company tu understand the problem and work on a fix
  • The same problem also affects FXE components
  • The cameras operated at 1Hz deliver delayed images. 1/3 Hz operation (almost live mode) is OK - probably related to GUI memory issues

FXE

  • Encoders of Loop1 have the same error message as SPB - the encoder positions are reliable - local components test can go on (e.g. OGT1)
  • Encoders of loop2 are not powered - AE to investigate

 

Tasks for today:

  • Identify a fix/workaround for the GUI server resource problem
  • Deployment of a beckhoff device for the decodification of the error messages.
  • Find a solution for the Renishaw encoder problem SPB Tunnel/ FXE Loop1
  • Investigation of the FXE Loop2 encoders power
  • Continue testing of ion pumps in XTD9
  • Test of gas section interlock in XTD9

Tasks for tomorrow:

  • Setup of the second server for karabo GUI
  174   26 Apr 2017, 11:55 Adriano ViolanteGeneralInformationStatus and Plans after the 9:30 meeting

 

XTDs Info:

Tunnel XTD2 will be accessible this Thursday (TUNNEL OPEN, NO ZZ), 27.04. between 9 and 12. Dosimeter and General radiation training required. Access requests should go to T.Haas.

XTD10 will be closed starting from this Thursday, 27.04. at 12:00

Provided that the authorities give the "go ahead", DESY plans to put beam in XTD2 on Thursday evening.

Access to XSDU2 being clarified - separate entry will be posted.

Karabo:

  • System running  but performance of the GUI still sluggish - CAS was not able to reproduce the problem, still under investigation
  • Second server has been set up as workaround.
  • In parallel experts are working on a definitive solution
  • Deployment today on a new beckhoff device for the decodification of PLC and interlock error messages. 

Vacuum:

  • Systematic tests of ion pumps ongoing. in XTD 9 two controllers/beckhoff terminal for pumps were wrongly connected (exchanged). To reconnect the controllers in the right orders the loop has to be interrupted. This will be done after the vacuum test on the XGM is done.

PBLM/Motion Loop: 

  • There is a resource problem when trying to read out the cameras. This problem will be reconsidered once the general issue with the GUI server is solved.
  • ASilenzi will discuss offilen with Natalia the acceptance test definition for PBLM
  • List of errors and relative solution concerning ELMO absolute encoder implementation being worked out by AE/CAS

SPB Tunnel components

  • Error message fore the Renishaw encoders is coming from wrond specifics of the interpolator between encoder and input terminal. This is due to wrong datasheet provided by the company. This is not a problem for reading of the encoders and their reliability. Error signal is currently ingnored
  • The same problem also affects FXE components
  • The cameras operated at 1Hz deliver delayed images. 1/3 Hz operation (almost live mode) is OK - probably related to GUI memory issues

FXE

  • Encoders of Loop1 have the same error message as SPB - the encoder positions are reliable - local components test can go on (e.g. OGT1)
  • Encoders of loop2 are not powered - AE to investigate today

 

Tasks for today:

  • XGM vacuum test and solution implementation of pump restart in Karabo
  • GUI server resource problem ongoing
  • Deployment of a beckhoff device for the decodification of the error messages.
  • Find a solution for the Renishaw encoder problem SPB Tunnel/ FXE Loop1
  • Investigation of the FXE Loop2 encoders power
  • Continue testing of ion pumps in XTD9
  • Vacuum signal alarms to be checked by AE,Harlad, Janni
  • Implement and test the CRLs in XTD2 in the Beckhof loop for test.

Tasks for tomorrow:

  • Vacuum signal alarms to be checked by AE,Harlad, Janni
  • Implement and test the CRLs in XTD2 in the Beckhof loop for test.
  • Checking of the absober for first lasing (inc. filter chamber). 
  142   13 Apr 2017, 12:07 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

 Tunnel Closed until approx 1300, Open over the Easter Weekend until Tuesday 1500.

Vacuum:

  • All valves and pumps in XTD2 are working and can be operated remotely
  • The vacuum system including DPS and XGM is interlocked. Interlocks have been tested and are working properly
  • The fast valve and the absorber at the interface to the electron beam vacuum are working and interlocked. The communication with DESY has been successfully tested
  • Some issue exist when switching turbo pumps on/off in Karabo. Then erratic behaviour is observed. Doing the same remotely communicating via TCP directly works ok
  • More testing needs to be done in XTD9

Mirrors, PBLMs, SRA, Attenuator

  • M1 and M2 are installed and under vacuum. M3 will be installed after easter
  • 3 out of 5 motors can be operated in M1 and M2. The mirrors have been moved into a safe position
  • PBLM motors (ELMO driver) can be operated (started and stopped) but operation is still problematic (motors stop in wrong position, movement not linear)
  • On the SRA the connection to two motors is interchanged
  • On the attenuator certain motors occasionally get stuck
  • Slits have been moved out so the beam line is safe for first operation

Imagers:

  •  
  • All imagers tested, motors and cameras, motion loop, EPS loop, for 3 imagers XTD2, and 3 imagers XTD9.
  • All blocking issues concerning tunnel closure solved.
  • Some remaining points that can be treated remotely: Trigger, software delays, others.
  • The Photonics Camera driver is now working in Karabo.
  • Cameras can currently be read out at 3 Hz which is too slow but ok for first beam commissioning

XGM:

  •  
  • XGM inserted into vacuum loop and interlock (in XTD2 and XTD9)
  •  
  • Grounding completed in XTD2+XTD9 (power cycle of rack was needed)
  • Gases ready to be used in XTD2
  • XGM @ XTD2 ready for beam         (need DOOCS middle-layer servers activated) 

FXE

  • Testing finished for all devices in loop1
  • Now waiting for loops 2 and beyond
  •  

SPB

  • SPB tunnel loop deployed. Testing can start next week
  • For the Optics hutch some Beckhoff crates are still missing 
  •  

PLC

  • Fixes to MC2 library (ELMO and TECHNOSOFT motors) will deployed next week and then tested in XTD9
  • FXE loop 2 was modified and loops 3&4 are deployed
  • SPB loop 1 to be deployed today. Working on loop 2

 

KARABO

  • Slow response appears to be solved
  • There are other not so severe bugs on the backlog
  • Currently all high priority components are supported
  • No requires cleanup and day-one component list
  • Monitor stability and robustness

 

Tasks for today:

Note: All loops should be left running and no changes to Karabo.

  • Fix the issue with the disconnected vacuum loop after tunnel reopens

Tasks for the weekend:

  • Relax and look for Easter Eggs
  • AE and CAS will provide contacts on a good will/best effort basis in case an intervention should be necessary

 

 

  148   18 Apr 2017, 13:06 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

XTD Tunnels open until 15:00. Later XTD2 and XTD4 are closed, XTD9/10 remain open

Vacuum Loop:

Status:

  • One broken Beckhoff terminal was exchanged before the weekend. This was the first failure of this type in 2 years
  • After this the system ran without hickup over the Easter weekend
  • The fix applied for ion pumps that avoids triggering an interlock condition when there is a communication failure on the serial output should be also applied now to other vacuum device, e. g. the turbo pumps

 

EPS Loop:

Status:

  • Requires an update to be done asap so that N. Gerassimova can continue tests with the PBLMs afterwards

Motion Loop:

Status:

  • Movement of the PBLM motors (ELMO controller) is not satisfactory yet. Motors start and stop but the movement is uneven and stops not always requested
  • There is no test set up in the lab. So tests have to be done in the tunnels (XTD9)

PBLMs:

  • All systems in XTD2 were tested and cameras calibrated including some at the beginning of XTD9
  • Work continues on remaining systems in XTD9
  • System with motor movement is still unsatisfactory (see above)

Imagers

Status:

  • 2 Imagers in XTD2 have no trigger signal. Suspicion is that this might be configuration problem. P. Gessler will investigate
  • One pop-in (245) in XTD9 cannot be reached with IP. Suspicion is incorrect network configuration -> K. Fillipakopoulos

SPB Tunnel components

  • Signal pins of the Attenuator crate were tested. DC voltage is seen there at different levels on different pins. This looks problematic -> P. Gessler

Karabo:

Status:

  • Ran stably over the weekend 

Tasks for today:

Note: All loops should be left running and no changes to Karabo.

  • Take equipment and junk out of tunnels
  • Check trigger cabling for imagers in XTD2
  • Check PBLM motor movement and continue testing in XTD9

Other topics

  • Controlled access to tunnels is possible after 1500. Coordination with T. Haas and the DESY run coordination

 

  152   19 Apr 2017, 11:49 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

Tunnels XTD2 and XTD4 are closed, XTD9/10 remain open

Vacuum:

  • Running stably
  • Work continues on M3 in XTD9 and on the vacuum in XTD10 

EPS Loop:

  • Input from undulator still missing. This requires  fixing a cable in balcony rooms and then testing

PBLM/Motion Loop:

  • Work on the PBLM motors (ELMO controller) continues.
  • It appears that the uneven movement is due to improper setting of motor parameters

Imagers

  • Trigger problem reported yesterday was due to a cabling issue. Apparently during work on the relevant rack cables were unplugged and then wrongly put back
  • Network issue with pop-in (245) in XTD9 solved

SPB Tunnel components

  • Crate with "problem on signal pins" was brought to the lab and checked. Everything was ok. Problem was due to spurious measurement.

Karabo:

  • PSLIT was tested successfully yesterday
  • Behaviour of Karabo when a loop goes down needs to be made more graceful. 
  • Cleanup continues

Tasks for today:

Note: All loops should be left running and no changes to Karabo.

  • Prepare mirror M3 installation
  • Continue testing of PBLMs in XTD9
  • Continue testing of SPB tunnel loop

Other topics

  • None
     

 

  153   20 Apr 2017, 10:25 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

 Tunnels XTD2 and XTD4 are closed, XTD9/10 remain open

Vacuum:

  • PLC/Karabo Running stably
  • Local tests of ion pumps in XTD9 being done by J. Eidam
  • Work continues on M3 in XTD9 and on the vacuum in XTD10 
  • DPS in XTD9 should be integrated into the vacuum loop. This requires a cycling of the loop. Timing should be coordinated with WP74 because of XGM in XTD2. Unfortunately nobody from WP74 attended the meeting. Hence it was decided to perform the work tomorrow morning.

EPS Loop:

  • Checks for the signal from the undulators and for the fast valve will be done with DESY MPS today

PBLM/Motion Loop:

  • Work on the PBLM motors (ELMO controller) continues.
  • Yesterday it was possible to align the screens 
  • There is a resource problem when trying to read out the cameras. For this reason an additional server needs to be set up dedicated to acquiring the images from the cameras.

SPB Tunnel components

  • Crate that was checked in the lab yesterday was moved back into the tunnel
  • The unstable support of the imager was fixed
  • B. Weinhausen and M. Messerschmidt are testing
  • All modules necessary for loops 1 & 2 were received from Poland
  • Waiting for the "Freigabe" of the cables for SPB Optics

FXE

  • Loops 1,2 and 4 are waiting for input from EETF
  • Loops 3&5 are running
  • No visible testing activity from FXE team

Karabo:

  • Cleanup continues

Tasks for today:

Note: All loops should be left running and no changes to Karabo.

  • Prepare mirror M3 installation
  • Continue testing of PBLMs in XTD9
  • Continue local tests of ion pumps in XTD9
  • Continue testing of SPB tunnel loop

Tasks for tomorrow:

  • Cycle vacuum loop for inclusion of DPS in XTD9

Other topics

  • Weekly SASE1 Readiness meeting tomorrow at 09:00 in XHQ 1.173
  • L. Samoylova requests access to XTD2 to install another webcam
  • Magnet current tests will likely continue through Wednesday in XTD2. Maintenance day to be shifted accordingly probably to Thursday/Friday. More information later
  165   24 Apr 2017, 11:08 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

 

Tunnels XTD2 and XTD4 are closed, XTD9/10 remain open

Karabo:

  • Bad crash of GUI server occured on Friday.
  • System running over the weekend but performance of the GUI was sluggish
  • There appears to be a resource leak. Experts are working on it.
  • Fix is urgently needed for continued testing

Vacuum:

  • Systematic tests of ion pumps start again since V. Bondar is back
  • Fix for the interlock of the gas section in XTD9 to be deployed today.
  • Gas system tests to be done starting tomorrow

PBLM/Motion Loop: 

  • There is a resource problem when trying to read out the cameras. This problem will be reconsidered once the general issue with the GUI server is solved.

SPB Tunnel components

  • The Renishaw encoders can not be read out via the PLC
  • The problem appears to be that the signal level is not TTL. 
  • T. Freyermuth is working on a fix
  • Work can continue once the encoder problem is solved
  • The same problem also affects FXE components
FXE
  • FXE team not represented

 

Tasks for today:

  • Re-deploy vacuum loop for the tests of the gas section tomorrow
  • Identify a fix/workaround for the GUI server resource problem
  • Find a solution for the Renishaw encoder problem
  • Restart testing of ion pumps in XTD9

Tasks for tomorrow:

  • Test of gas section interlock

Other topics

  • J. Grünert requests to put the XGM in XTD10 under PLC/Karabo control
  • This would require extensive work by several groups (ITDM, AE, CAS) and cannot be done at the moment in view of established priorities

 

  183   27 Apr 2017, 15:11 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

 XTDs Info:

Tunnel XTD2/4 will be accessible today until 1500. Dosimeter and General radiation training required. 

XTD10 will be closed starting this afternoon

Vacuum:

 

  • DPS with interlocks was tested successfully yesterday evening but...
  • ... Complete failure of gas sections in both XTD and XTD9 some time tonight. Valves were closed and turbo pumps were off. Reason is still being investigated
  •  
  • Systematic tests of ion pumps in XTD9 done for 3 vacuum sections. Currently only the pumps are tested. Tests of the interlock will follow
     

Karabo:

  • The problem with the GUI server has unfortunately not re-occured. Hence it can currently not be debugged.
  • Second GUI server is available for fall back
  • Remote reset of TP controllers has been implemented and will be deployed in the next release

PLC

  • A problem was found in the MC2 library affecting the ELMO controller.  This only affected the systems deployed in the tunnel. 
  • The non-linear behaviour of the PBLM motors was reproduced independently of PLC and KARABO. Suggestion: Could this happen when the motor has to work against vacuum pressure? Evidence: It does not occur in the lab (no vacuum!)
  • A video session with the manufacturer is schedule for next week to look at the problem

PBLM/Motion Loop: 

  • There is a resource problem when trying to read out the cameras. This problem will be reconsidered once the general issue with the GUI server is solved.
  • ASilenzi will discuss offilen with Natalia the acceptance test definition for PBLM
  • List of errors and relative solution concerning ELMO absolute encoder implementation being worked out by AE/CAS

EPS

  • Logic of EPS was agreed between AE and H. Sinn:
    • Currently only covers devices up to XS3
    • Vacuum ok requires all valves to be out of the way
    • Any screen down  forces single bunch mode
    • All imagers in safe position allows full beam mode
  • Meeting next week @ DESY to discuss technical details with MPS group

SPB Tunnel components

  • Renishaw encoder can be read out reliably after fix for error signal line
  • SPB would like to work on the pulse picker next and is waiting for it to be integrated

FXE

  • FXE guys would like to help with tests of Hard X-Ray Mono 

Tasks for today:

  • Perform various maintenance tasks in XTD2, e. g. integrate CRLs, exchange photo tubes, exchange gases
  • Investigate why gas sections switched off yesterday
  • Continue test of vacuum components in XTD9

 

  241   17 May 2017, 11:55 Tobias HaasGeneralInformationStatus and Plans after 09:30 meeting

 Interlock in XTD10 is broken today and tunnel is open until 15:00

General:

  • Unfortunately, info on access to XTD10 came too late for Vacuum group to organise the work in XTD10
  • Technical issues and coordination between AE/CAS and PCT/Instruments continues to happen via SASE1 Readiness Log

Vacuum:

  • Issue of spurious beam aborts due to short term vacuum spikes in XGM is solved (respective gauges taken out of interlock?)
  • Change to interlock logic was requested by H. Sinn: V0 always closes if one gate valve closes) The reason is that after V0 is closed the accelerator has beam permission and can continue
  • This logic will now be implemented in the next update by AE

Imagers:

  • Problems with several photonics cameras for data collection exist. The data transfer is sensitive to packet losses. Hence dedicated servers need to be set up to avoid loss of data.
  • ITDM has provided one additional server in balcony room. Eventually a dedicated server should be set up in the tunnel
  • Maybe the way the camera sends the data could also be optimised
  • Auto-scaling switch problem has not been tackled yet and is considered second priority after solving general readout problem

PLC:

  • Fix for MC2 lib for TECHNOSOFT motors is ready. Tests together with N. Gerassimova can start today after motion loop update 
  • SPB can perform a parallel test on the PSLITs
  • Motion loop and vacuum loop updates are scheduled for 12:00. 

KARABO:

  • A bug was found where device clients drop messages and hence the GUI looses the state of the device
  • There is a fix that needs to be deployed.  This should happen in parallel to the cycling of the loops between 12:00 and 14:00

Next Steps:

  • Cycling of vacuum and motion loop at 12:00. T. Freyermuth informs the Photon Commissioning team
  • Update of Karabo betweem 12:00 and 14:00
  • Tests of PBLM with updated MC2 lib today
  • Tests of PSLITS with updated MC2 lib by SPB

 

ELOG V3.1.4-7c3fd00