Group Selection Page HELP Controls Group Data Analysis Group ITDM WP76 DET Vacuum EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Operation PSPO XO TS Migrated2Zulip
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Technical integration and coordination logbook, Contact: A. Violante, G. Wellenreuther, Page 23 of 31  Not logged in ELOG logo
New entries since:Thu Jan 1 01:00:00 1970
ID Date Author Location Severity Subject
  163   23 Sep 2020, 11:05 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 23.09.2020
General Announcement:
- XO is anticipating in one week the delivery table preparations to gain more time to spot possible problems related to beam delivery. The cw42 table was sent to the 
instruments last Monday.

CTRL:
- CTRL confirms but updates on the dataloggers and time servers were done successfully.
- LAS brought some issues to CTRL that are under investigations.

DA:
- Nothing to report.

EEE:
- EEE conducted yesterday the SA1/SA2 ATT interlock logic modification. Summary can be found in these links:
https://in.xfel.eu/elog/SASE1+technical+commissioning/1982
https://in.xfel.eu/elog/SASE2+technical+commissioning/830

VAC:
- VAC reminds in general that EuXFEL staff shall check their access rights in the DACHS database. To have trainings up to date is not enough. 
In case your rights are expired, please contact Martin Dommach via e-mail. 

XPD:
- FD week had a good start with GATT bleaching studies. Today there is the FD K-mono 4-Bounce ongoing.
- Machine switched back to 14 GeV on Monday; XGM/SA1 gas was exchanged back; graphite screen in SA1 is inserted.

DET:
- Nothing to report.

ITDM: 
- The SASE2 online data storage was diagnosed and reconfigured.

XRO:
- A. Trapp adds on the solid attenuators interlock modification for SA1/SA2: from now it is not possible to remove the diamonds if the silicon is in. 
For more info please check the e-log or contact M. Vannoni: 
https://in.xfel.eu/elog/SASE1+technical+commissioning/1982
https://in.xfel.eu/elog/SASE2+technical+commissioning/830
- Yesterday there was a ZZ in XTD9 for SPB to inspect BPLM: seems to be OK but minor issues to be resolved for the winter shutdown.

LAS:
- SA1 in maintenance: no risk for FXE during the weekend. It must be operational tomorrow morning. 
- SA2: issue with ADC cards - the NOPA is lost. Reported to CTRL.
- SA3: no issues.

UNSYS:
- ZZ in SA2/Cell31 is scheduled for tomorrow (24.09) morning at 09:00AM.

SPB:
- Involved in the update of attenuator. 
- Helping the stability task force activities this week.

FXE:
- FXE informs the second Gotthard is back: Karabo can't start or reset. CTRL suggests that when there is an urgent case one shall call the OCD. Otherwise sending a CTRL 
ticket is most suitable.
- Last week issue with digitizer: A new card was installed but has different sampling frequency. EEE is aware and is looking into it.
- FXE comments it is hard for the instrument staff to attend the two Graphana trainings due to night shifts/compensation, etc. FXE asks on possibility of additional 
trainings. 
Steffen H. says one can organize an extra training. A blue week is more suitable for the instrument staff. The extra training will be organized for the coming days/weeks. 

MID:
- Train-ID issue is progressing.
- MID asks for help from technical and engineering staff to find parts with M20 holes adaptors in order to lift granite stone.
** Post meeting update: VAC group helps MID.

HED:
- Not present.

SCS:
- Nothing to report.

SQS:
- Nothing to report.
  162   21 Sep 2020, 16:06 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 21.09.2020
General Announcement:
- Last week issue with Oracle database upgrade was fixed by effort during the night. People entered tunnel by ZZ after this communication issue was fixed.

CTRL:
- It is planned to happen a Data loggers update today. 
- Time server update: related to a bug which happened twice in five years. It will be carried out today afternoon (after XPD beamtime) or tomorrow morning.
- A. Galler asks on updates on pulse pattern decoder: Steffen H. says it is ready to be deployed and tested.

DA:
- DA received only one OCD call last week: no specific issues during the week.

EEE:
- XO informs that the ATT interlock PLC update will be done tomorrow (22.09) morning.

VAC:
- OCD call on Friday from MID related to the cryocooler of monochromator: it was clear issue was related to the power supply. TS was involved to solve the problem by 
exchanging cryocooler. 
VAC informs the OCD number to be dialed is 9-4900 and not 4900.

XPD:
- It was observed problems with SA2/XGM spinning motor gauges.

DET:
- Nothing special: quiet week.

ITDM: 
- There is a problem with SASE2 online data storage. It happens data were not migrated from Schenefeld to Desy or it was very slow which in turn affected MID. Partially 
solved by making system live. 
- ITDM needs to diagnose the GPFS filesystem in SASE2 in order to understand the issues we experienced over the weekend. This may lead to some instabilities or even 
unavailability of the SASE2 online data storage. 
- XO suggests ITDM to coordinate separately with MID and HED.

XRO:
- Nothing to report.

LAS:
- SA3 had power drops and today LAS makes tests regarding Daniel Rivas info.
- SA1 currently replacing laser diode and updating uTCA system.
- SA2 nothing to report.

UNSYS:
- Terminals for SA2/cell31 have arrived and are ready to be installed in next ZZ access.
- Problem with air coil in SA3/cell12 this morning will be taken care.

SPB:
- Commissioning last week using 5 keV beam.

FXE:
- Mono commissioning.

MID:
- Recovered vacuum issue on cryocooler on SAT morning with help from TS. Beam was back on Saturday morning (+-10AM).
- Timing tests were running on Friday by EEE. MID waits for results to be analyzed. Train-ID issue seems to be progressing and many people work on it.

HED:
- User beamtime was very successful. Stability was very good.
- Pulse on demand test aimed to be able to have single PP shot synchronized with FEL. Today from 10AM CTRL and LAS will temporarily change bunch pattern (communicated to 
the PRC). 
No need for X-ray beam to the hutch.

SCS:
- No special issues to report.

SQS:
- Two weeks ago the monochromator was used. X-ray beam was twinkling and not reproducible. Seems to be connected to higher heat load when using 300 pulses. 
SQS says that this needs to be addressed when beam is back again.
  161   16 Sep 2020, 10:20 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 16.09.2020
General Announcement:
- Yesterday evening a ZZ in XTD10 was planned but it turned unsuccessful due to no access in the turnstiles. D3 solve the problem in the middle of the night and since 
then ZZ is possible again.
- Eric Boyd mention on the SQS shutter: a XTD10 ZZ was planned for 8:30AM. He has currently no news so far.

CTRL:
- XGM Pulse pattern decoder issue is under investigation.
- Vacuum issues (giving unknown state in Karabo): also under investigation.
- Next Monday CTRL plans to update Karabo login system. Groups shall inform CTRL if there is any issue against this.
- Last Influx training will be next Friday An e-mail to participants will be sent. 

DA:
- No issues to be reported.

EEE:
- SA1/ Solid Attenuator Interlock problems: EEE is investigating and news will follow. FXE found an issue within the motion loop last night and XRO also helps. 
It is the Interlock on the attenuator itself and not in the EPS.

VAC:
- Nothing to report.

XPD:
- XGM signals were monitored when SA1 went to 5keV for a short time yesterday night. No issues were observed.

DET:
- SCS made an OCD call on the DSSC which has been fixed.
- Agipd issue: under investigation together with ITDM (a ticket was opened to ITDM). This is not a calibration issue. 

ITDM: 
- ITDM will follow on the Maxwell issue with Agipd. 
- CTRL and ITDM working and progressing on the bunch patter issue.

XRO:
- Issue with SA1 solid attenuator: same behavior can be expected also in SA2.
- Mirror inspection in XTD2: it shows no big damage on it. A full service will be made later. Next Monday inspection on XTD10 mirror to understand situation.
- Meeting to investigate possible upgrades to drive motors faster will take place. Participation of CTRL, DA and instruments.

LAS:
- Nothing to report.

UNSYS:
- Suren K. informs Beckhoff Hardware for cell#31/SA2 was received and is under test. As soon UNSYS is ready for a ZZ it will inform PRCs for scheduling a date. 
Mostly likely ZZs will occur on Tuesday and not Monday due to continuation of 11.5 GeV studies. 
- Communication problem with one undulator on Monday was quickly fixed.

SPB:
- Working on nano KB mirrors.
- 5 keV last night: gives right trajectory. It looks like the beam performance was sufficient for SPB alignment. Fine tuning has to come.

FXE:
- Affected by the shutter problem during the tentative ZZ access yesterday.
- Solid Attenuator issue in discussion with EEE.
- Sampling rate of ADC has changed. Peter Z. contacted EEE and it has been accessed.

MID:
- Not present.

HED:
- User experiment ongoing.
- Some stages worked intermittently and has to be investigated (related to crystal alignments).
- Pulse picker is not behaving correctly. It may be a Hardware issue and has to be investigated. Then HED will communicate to EEE.

SCS:
- PP laser was down last night and the OCD was contacted. There is the suspicion the crystal is damaged and the OCD informed it will be fixed this morning. 
Daniel Kane will try to get some info inside LAS and report back t SCS.

SQS:
- It has users this week and shutter becomes a serious issue. In Karabo the shutter state changed but it is disconnected. It is not clear if the ZZ team is progressing 
right now.
- Problem is that when trying to close the shutter via JDDD interface it went to an intermediate state but shutter did not close. 
This cause interlock not opening the hutch and the beam could not be sent to the hutch. No beam since 5PM yesterday. Also locally operated in the panel it does not work. 
The JDDD interface worked nicely the whole last week. Eric Boyd asks if problem appeared at the first operation. Tommaso M. says they did a lot of times prior having this 
issue.
- Waiting for updates from CTRL mentioned.
  160   14 Sep 2020, 15:34 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 14.09.2020
General Announcement:
- None.

CTRL:
- CTRL will deploy an update on time server configurations for SA1 and SA3. Bunch time decoders will be down during few minutes.
- SPB and SQS reported during the weekend they do not have pulses per train correctly presented. This relates to the update on server configurations. CTRL is looking into 
it with SPB today.

DA:
- Minor OCD calls during the weekend with no severe issues.

EEE:
- EEE works with SPB on configurations of motors (in general with several other instruments).
- Looking into XPD issues.

VAC:
- It notices quite often one has to restart C++ servers due to communications issues. CTRL and EEE are investigating: it does lose connection and then does not properly 
restart. 
PLC continues running in the background. CTRL recommends restarting CPP server as workaround. 

XPD:
- XGM in SA3 shows not accurate number of trains per pulse. First pulses of a train were missing. It will be followed up with CTRL and SQS.
- There is an agreement in how to enable the 5keV operation. Instruments shall be aware of ahead planning when changing photon energies (band region of resonances which 
requires exchange of gases). 
In general SA1 and SA3 instruments are aware.

DET:
- Working on calibration issues.
- Problem from SCS with Karabo device going in unknown mode has been under investigation.

ITDM: 
- Comment to DET: it has been understood issue with Maxwell nodes last week - jobs running and certain nodes were in bad state. It was a particularity of the 
configuration. This affected the calibration. 
- Bunch pattern issue: we were communicated around 2AM on an issue that data recording was not the same as the scene. ITDM asks for communication of major issues must be 
done in earlier times when experts are around. 
XO will talk with CTRL and ITDM, as well as SQS.
- exfelgateway and Karabo installation: we will move today the installation. Link will redirect to the next location. No changes in how to start Karabo GUIs.
- Tomorrow a maintenance affecting Oracle databases will take place from 7AM to 1PM. For example, DACHS/DARF, UPEX will be down. 

XRO:
- Nothing to report.

LAS:
- Nothing critical to operation to be reported.

UNSYS:
- Beckhoff terminals for the cell31/SA1 are ordered. Components are to arrive.
- Problems with SA1/cell7 yesterday have been fixed.

SPB:
- Hardware exchanged late Friday and during weekend.
- Bunch pattern recording issue was discussed with CTRL last week during the day. It is of importance to correlate the data with number of bunches.

FXE:
- Minor issues with components motors: when pressed step up /step down in the motor, the Karabo interpret that we pressed twice. It is not critical but annoying. Issues 
are related to MC2 motors. 
CTRL will get in touch with EEE in an offline discussion. Issue has a different nature compared to the HED problems with motors.
- Tests on Monochromator show energy drifts. For long range scans one has to correct manually the calibration. FXE will report to CTRL today or tomorrow.
- Friday beam instability due to horizontal jitter: FXE took some data and will communicate. 

MID:
- Number of bunch train issue was also observed.
- Train IDs going to AGIPB are correct and verified.

HED:
- CRL must be investigated (motors). It moves one way but not for backwards.
- We made a ticket for Mono1: problem came up again during the weekend.
- EEE wants to make uTCA installations (after HED request) on next Tuesday. HED and EEE will discuss a suitable time together.

SCS:
- Issue with DSSC mentioned by DET.
- Nothing else to report.

SQS:
- Issue in past weeks: shutter does not respond but it seems to be working now. F. Wolff-Fabris will ask the Desy colleagues for an update on the situation.
  159   09 Sep 2020, 10:10 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 09.09.2020
General Announcement:
- XO reminds the groups to please inform staff to check for self-rescuer training date in the DACHS system. In case this is expired please contact Michael Prollius or SRP 
group.
- Martin Dommach informs fthe access rights to the photon tunnel and accelerator has also expired for several people in August. Please check that.

CTRL:
- Yesterday evening XPD informed on an issue with Karabo GUI for exflgateway. It has been under work. LAS has a work around. CTRL encourages to do not work until it is 
fixed (likely in the next 30 minutes).

DA:
- Nothing to report.

EEE:
- Nothing to report.

VAC:
- Nothing to report.

XPD:
- All is fine. XPD asks CTRL to please send instructions to bypass the Karabo GUI issue mentioned by CTRL. CTRL says it will be fixed in next 30 min.

DET:
- OCD call yesterday has been solved. 

ITDM: 
- Video conferencing system is on the HED control room and under test.

XRO:
- Maintenance in SA1/M3 mirror for Tx spindle took place on Monday as a ZZ. Mirror/spindle seems fine and we did maintenance without affecting mirror position or 
settings. 
XRO waits for spare parts to be delivered for additional maintenance.

LAS:
- SA1 and SA3 lasers are in operation; SA2 laser is in maintenance.

UNSYS:
- Problem with SA2/cell31 is serious: the complete bus terminals are damaged in the rack. Currently SASE2 works up to cell 31.
- New set of terminals is needed from Bekhoff to replace the full instance of the rack. Suren K. will inform on updates/status and when parts arrive for asking tunnel 
access. 
The old ZZ request is still valid. Order will be placed soon and Beckhoff promises delivery in one day after receiving order. 

SPB:
- Minor Problem with one motor but it is under investigation. 

FXE:
- Problem with a motor: EEE is informed and today they will check it.
- Andreas G. asks if FXE sees changes on mirror positions due to Monday maintenance. Martin K. will inform the group to verify during the night shift.

MID:
- Not present.

HED:
- M3 re-alignment is very good. HED get the first Mono aligned and continues today with preparations/alignment. 
- Thomas Preston says issues with a motor stages is under investigation (it worked in the past).

SCS:
- Yesterday morning machine had tuned beam to SCS photon energies. Somewhere this has been lost and SCS and BKR had to do it again on the afternoon. PRC will investigate 
with RCs.
- Smaller issue: For 2x already there is an issue with pulses that DSSC send to online read (sometimes we get only 8 pulses). 
DA states it is related to the calibration pipeline when this is reset (default is 8). 
One has to change/correct manually in the config manager. DET asks SCS to place a ticket for the support. 
SCS plans to use DSSC for user experiment this week. It is not critical issue but it would be nice to fixed for once.

SQS:
- Preparing for user's time on next week. SQS has commissioned the Monochromator with grating for the first time. 
  158   07 Sep 2020, 14:37 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 07.09.2020
General Announcement:
- XO thanks instruments and support groups for using the E-logs while reporting activities. Please place names and groups in the entries to make a follow-up easier.

CTRL:
- SA3 vacuum loop is recovered.
- Today afternoon we want to move SA1 gui's to a more powerful server. If someone has an issue please contact CTRL.

DA:
- Not present.

EEE:
- Tests for MID to take place this afternoon.
- Cabling activities are ongoing.

VAC:
- Nothing to report.

XPD:
- Nothing to report.

DET:
- Nothing to report.

ITDM: 
- The video conference system needs to be tested in the control hutches. ITDM wants to set procedures with WOCO and also mounting it in experimental hutches. 
Instruments that are willing to help with the test can contact ITDM. The idea is to test in a Linux machine and test with remote users. SQS and HED are initially 
interested. 

XRO:
- Not present due to M3/SA2 re-alignment.

LAS:
- SA2 updates must be done by the end of today.
- SA1 and SA3 must be operational by the end of the day.

UNSYS:
- Requested ZZ to go to tunnel to fix communication issues with SA2/cell31. PRC arranged with RC to take place this morning.

SPB:
- Preparation for a couple of experiments next weeks.

FXE:
- Nothing to report.

MID:
- All fine at MID: checks with EEE to be done this afternoon and on Wednesday.

HED:
- Preparing M3 and other internal activities for user run next week.

SCS:
- Users will have beam time this week.
- SCS asks on the time window: Andreas G. says it is typically 400us but one can find in the delivery tables. 
If instruments request for more, please communicate to XO and OB will discuss it together with RCs.

SQS:
- Preparing next beam times.
- Shutter remote control: waiting for an update.
- Absorber in SA3 is currently in an unknown state. Nerea J. will check with Maurizio V.
  157   02 Sep 2020, 13:33 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 02.09.2020
General Announcement:
- If instruments find the machine is not performing as you expect when comparing to previous weeks, please contact PRC that he may help you to address it. 
This is also valid for changes of beam parameters if not previously reported in the operation tables. 

CTRL:
- CTRL is supporting the ongoing Laser installations. 

DA:
- Nothing to report.

EEE:
- Fast ADC in HED: this is solved. The only limitation is if the system is restarted the ADC is misconfigured. In this case please inform EEE for loading the 
configurations.
- SCS switch issue is also fixed.

VAC:
- Working on the M3/SA2 mirror. Mechanical problems were fixed by XRO. Leak test ongoing and closure of the tunnel afterwards. Beam can be back to XTD6 this afternoon.

XPD:
- Nothing to report.

DET:
- Nothing to report.

ITDM: 
- No big announcements at this moment.

XRO:
- M3 mirror: mechanical axis was disconnected and mirror was not moving. XRO and VAC fixed the problem. Hopefully beam can be injected to XTD6 this afternoon. 
- It was chosen not open the full chamber to make the repair in 2 days' time. As beam is there XRO will re-align mirror. Cooling system is disconnected.
- After closing tunnels, it will allow beam in MID certainly and to HED we will look after the re-alignment of the mirror (to be scheduled). Maurizio V. is open to 
clarifications/discussions.
- Ulf asks on the plans for re-alignment of the beam: Maurizio says either after the Self-seeding on Friday or on Monday.

LAS:
- Upgrades are ongoing in all lasers: a bit behind schedule.
- SA1: ADC has to be serviced by EEE; SA2: delays due to microTCA.
- SA1 and SA3 shall be available tomorrow afternoon.
- Tests with HED laser pattern on demand: LAS demands to be included in discussions for October use of PP-laser. Synchronization must be developed to run properly.  LAS 
can't guarantee it will work from the first try.
- Cw37: SCS needs laser, as well as MID has preparations. LAS states both lasers shall be back in operation on THU afternoon shall be available.

UNSYS:
- Nothing to report.

SPB:
- Getting ready for test experiments and commissioning.

FXE:
- Nothing to report.

MID:
- Setting up for user experiments.

HED:
- Waiting for M3.

SCS:
- SCS/XGM presents issues with interlocks being activated due to pressure levels. This required intervention from expert. 
If this happens in the middle of the night, SCS proposes to develop an automated way to reset it or to be trained by XPD experts. XO, SCS and XPD will follow up. 
- Extra-foam: SCS asks on the possibility for access to remote users. DA says is under discussion between DA and ITDM to extend the service but no decision has been made. 
It will anyway need access to online clusters.  

SQS:
- Not present.
  156   31 Aug 2020, 11:31 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 31.08.2020
General Announcement:
- XO reminds every day at 15:00 there is an informal BKR chat where one might get interesting news and ideas. If you would like to join, the link appears in the BKR e-
log.
- K. Wrona asks instruments if there are things to be improved regarding remote user communication or process, please send suggestions and/or comments to him/ITDM.

CTRL:
- Electronics team is installing new digitizer with LAS group.

DA:
- Nothing to report: OCD was quiet during last week.

EEE:
- Fast ADC system issues: problem with HED hutch. Signals were not properly given due to wrong configurations. It has been solved.
- All XPD systems had same issue: last Karabo update had a default address wrongly set and was the cause for reading wrong numbers. 
This was solved with help of CTRL but one crate remains to have the ADC card re-started, probably today. 
- SCS auto scanner: suspicion links to the loop that runs the motor is not fast enough.
- SCS and SQS have cabling installations planned for this week.
- Theo M. asks which ADC had a train-ID issue. Patrick G. answers that looks the XTD10, crate 3.2. It has been taken care already.

VAC:
- PRC contacted VAC on Thursday with XGM in XTD1: faulty pump that survived the weekend. VAC will exchange it today.
- HED problems with M3: VAC and XRO are working on it now and it probably to exchange an spindle or mechanical structure.
- SCS GATT stopped working on Saturday: power glitch caused a long shutdown of cooling water that switched OFF pumps and GATT.

XPD:
- Restarted XGM; also SCS XGM had a faulty gauge.

DET:
- Nothing major: Detectors were working during the weekend.

ITDM: 
- Not aware of any major issue.

XRO:
- M3 issue: mirror looks fine but the mechanical structure to move the mirror horizontally failed. Mirror surface looks mostly fine, only one InGa drop is seen. 
XRO and VAC are in tunnel to try to make it a fix now. There may be also a problem with Platinum coating if drops of InGa are on it.

LAS:
- SA1 laser will be down for the entire week for exchanging parts.
- SA2 laser uTCA update today: shall be back on Tue/Wed;
- SA3 laser issues with Amphos are being exchanged/fixed. Probably by WED afternoon this laser is back.
- Upgrade of control PCs ongoing this week.
- LAS states SA3 laser is planned to be available tonight.

UNSYS:
- Yesterday night a problem in one cell in SA1: fixed today in the morning and is fine.

SPB:
- No major issues during the week.

FXE:
- Continuing with commissioning this week. 
- Helium supply was exchanged yesterday during the weekend. 
- FXE also says they had remote users and process/communication worked nicely.

MID:
- Would like to remind about the bunch train-IDs. MID need feedback to inform users who have experiment in two weeks.
	
HED:
- Stopped operation On Friday night due to M3 issues: photon beam can not be directed to HED.
- Problems with ADCs and controls last week: help was received.

SCS:
- Not present.
- Remote experiment also seems to have worked.

SQS:
- Remote shutter control seems that worked once but no reasons/correlations were observed.
- Experiment with remote users worked nicely.
  155   26 Aug 2020, 13:49 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 26.08.2020
General Announcement:
-  XO is looking forward to receive today the Delivery and Operator tables from the instruments.

CTRL:
- CTRL has carried out the time server deployment with newest version for devices and upper channels. 
- Nothing else severe to report.

DA:
- Working with HED on recording data - ongoing today.
- K. Wrona states that should be treated as experimental issue. An offline discussion will take place in defining how to interpret and run in the proper way.

EEE:
- The implementation of SA3 pre-absorber into the Interlock system was done, tested and it is working.
- 

VAC:
- Systems are running well.

XPD:
- Graphite filter in SA1: SPB has checked and found out the graphite filter is not damaged. The crack related to an attenuator. 
XPD will find an agreement/compromise for operation at higher energies when filter is retracted due to the wave-front distortions for the hard X-ray in SA1 and SA2. 
XPD needs more info from instruments. Discussion will follow.
- XGM resonances: a clarification is made that no matter which gas it is there is a resonance. Exchanging gases requires XPD to make an intervention for about 1 hour.
This has to be taken into account when, e.g. SCS and SQS require such changes.

DET:
- Nothing to report.

ITDM: 
- Nothing to report.

XRO:
- The Karabo GUI for SA3 is redesigned due to the presence of the pre-absorber. XRO will be happy in hearing comments and suggestions.

LAS:
- All Laser working accordingly to the specifications.

UNSYS:
- All is fine.

SPB:
- Operation going fine.
- Timing team found 2 issues: 1. Pulse pattern recording device seems not be synchronized with train IDs of other devices; 
2. Bunch arrival timing monitor has 25% repeated data (they have the same time stamp but different train IDs). 
K. Wrona says this may indicate there is no data. Robert Schaffer states the bunch arrival had no changes, so it seems to be another issue.

FXE:
- Starting user experiment and all going fine; pump probe signal seems good and FXE thanks LAS for fixing it yesterday; Digitizer issue was resolved by CTRL yesterday.
- Bunch arrival monitor is also repeated showing same numbers for the different trains.

MID:
- All fine.

HED:
- DAQ tests ongoing.
- The Shot on demand for laser stopped working at 3:00AM today (BBP signals). It seems to be a PPU problem. Nerea J. will contact T. Preston to look into it.
- Trying to get the A0 monitor working. After restart uTCA it solved one out of 2 problems. HED need someone to look into it onsite at the instrument.

SCS:
- Issue with pop-in imager last night: not allowing interlock. It has been under work now and is a similar issue as the SQS pop-in last week. This time it is the SCS-
XTD10 Pop-In IMG-PI (type I).
- Reducing SA3 bunches number were affecting SA1.

SQS:
- Nothing to report. All good so far.
  154   24 Aug 2020, 11:39 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 24.08.2020
General Announcement:
- The safety rules require the use of masks when moving around as well as the limitation on the number of allowed people per room. 
XO asks people to stick to rules of 1 person per office as well as using masks when working closely. 

CTRL:
- Few minor issues during the weekend. Major one related to SQS optical spectrometer which did not reach 10 Hz.
- Today an upgrade in the archiving system will take place. The update of timing servers for all SASEs will take this afternoon. 
The property “bunch pattern table” will not be filled anymore.

DA:
- Few OCDs calls were all manageable. DA reminds instruments and groups to let system online to be monitored.

EEE:
- One OCD call during the weekend.
- Cabling with Detector group to happen.
- EEE asks if the SA3 interlock/pre-absorber will be tested today.

VAC:
- Nothing to report.

XPD:
- There was a problem with XTD2/SA1 graphite filter accordingly to Operation E-log entry. Maybe it got damaged between 20. and 21. This will be further investigated 
between XPD and SPB/SFX.

DET:
- 1 OCD call which was easily solved.

ITDM: 
- Friday the Scratch system (for temporary data) was out of space and data were removed (70Tb). It may be a problem again and ITDM would like to remind people to keep 
data only for short time. 
There is 1.5 Petabytes storage with currently only 60Terabytes free space.
- An e-mail about this issue was sent to a distribution list stating that from 01/09 data will be removed. ITDM asks people to clean their data in the proposals 
directories. 

XRO:
- Preparing for ZZ accesses in XTD2 and in XTD10.

LAS:
- SA1 laser is temporarily fixed with stable operation during the weekend. It required changes in software. This PP-laser is working and further exchanges are postponed. 
- LAS reminds that OCD calls regarding timing synchronization between laser pattern and beam must be addressed with CTRL OCDs.
- Jan G. offers assistance with 5Hz operation on diagnostic cameras. A. Galler suggests to include also EEE and CTRL in discussions.

UNSYS:
- Nothing to report.

SPB:
- Graphite issue: inserted on Tuesday for 15 keV and was in the beam for 4 days until Saturday. J. Gruenert says this is not wrong. An e-log entry was done by Romain 
Letrun.
- 1MHz images in camera worked during the weekend.

FXE:
- Issues: 1. Electron bunch arrival monitor recording did not work; 2. When SASE3 changes to many bunches, then FXE sees decreased intensity; 3. PP-laser seems not 
suitable for our operation. 
- For #1, ITDM will have a look in it; For #2, this will be discussed with machine; For #3, further discussions will happen in separate meeting.

MID:
- No issues: Split delay line is under commissioning. It was quite successful week.

HED:
- Successful week.
- The shot on demand feature was tested with EEE and CTRL.

SCS:
- Issue with saving sample position.

SQS:
- SA1 and SA3 interactions: FXE suffers when we have many pulses. M. Meyer proposes to have discussion with machine. 
A. Galler proposes to discuss during the machine meeting at 10AM and asks for additional info per e-mail.
  153   19 Aug 2020, 12:08 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 18.05.2020
General Announcement:
- A. Galler reminds the audience on the daily informal BKR chat taking place at 15:00: link was sent by e-mail. 

CTRL:
- Tests on the HED bunch patter / 5Hz were done yesterday;
- Five devices related to the timing server will be re-started on Monday. This update of timing server shall be transparent.
- Other requests will be discussed separated in another rounds with respective involved groups.
- For Laser switch between SCS/SQS please call LAS OCD for troubleshooting (experts mean faster solutions). 

DA:
- DA reminds the group on its Redmine ticketing system that was implemented in February and helps on the planning and scheduling of activities. Instruments are encouraged 
to use the DA ticket system.

EEE:
- Initial test with HED 5 Hz pulse on demand went successfully yesterday.
- Missing crate in HED will be installed.
- SCS installation of cables will be done. 
- The special trigger for overlapping bunch in SQS was fixed this morning. CTRL was asked to prepare another parameter in Karabo. 
This shall be OK and tomorrow it shall be fine to use the adjusting the timing. S. Hauf points a device has to be adjusted. 
- A. Galler informs the tentative date for the SEPS update will be next Monday. 

VAC:
- ZZ done on Monday to check status of SA3 devices.

XPD:
- X-ray PES undergoing tests at Petra-III / Desy.
- A SQS pop-in could not be driven out of the limit switch this night. This was solved in the morning (back to work) and it was related to a problem with motor counts. 

DET:
- Preparation for user run at SQS: still some data to be taken with DSSC but it has been under work.

ITDM: 
- Together with CTRL and DA, it was set dedicated server for logging in to get more insight in the experiment. 
- In the main page of user proposal there is a permanent Zoom link to be used for communication with users. It stays for 2 weeks: SQS is working and other two experiments 
will be set today.
- In addition each experiment will have a dedicated zoom room.

XRO:
- SA1 M1 continues stay in place. By the other side, XRO would like to ask for a ZZ to complete the chiller level.
- Interlock tests in SA3 did not happened (changing of Interlock from GATT to pre-shutter) Z. Ansari informs that from her side it can take place on Monday 24th.

LAS:
- SA1 laser: the front-end is switching off in regular base (3x since Monday). There is not enough power for experiment. 
Meeting with manufacture take place today at 10 to build strategy to investigate and decide next steps. LAS will inform next steps. 
PP-laser is expected to be working for this and coming weeks. 
- SA3 Amphos: it can be operated. A final fix will be done in the in next blue weeks or during winter shutdown. 
- SA2 laser is fine.

UNSYS:
- Nothing to report.

SPB:
- Working on CRL alignment and also testing of camera. 
- Some alignment activities were interrupted due to the Laser issue. At 20% lower energy, it is not enough. Impact on commissioning if laser is not back may affect user 
experiments later. 

FXE:
- Nothing to report.

MID:
- Commissioning of the split delay line: lower branch is successfully done.

HED:
- Setting up for experiment; few issues with diodes.

SCS:
- Nothing to report.
- XO reminds the protocol to increase bunch numbers out of what is agreed on the delivery tables: 1. try to discuss with other experiment first; 2. call the PRC.

SQS:
- The zoom account was tested last night.
- Meeting with DET today. 
- All are going fine.
  152   14 Aug 2020, 10:40 Andreas GallerGeneralInformationNotes XO Integration Meeting 17.08.2020
General Announcement:
- An informal Run coordinators' BKR chat to exchange ideas happens every day at 15:00. 
It is a forum in case technical and scientific people wish to make formal requests. XO will send an e-mail with Zoom link.
- XO would like to ask instruments to pay attention to the parameters of the Delivery and Operators table, especially regarding the bunch limits for the North branch.
Ideally we shall discuss one week before beam delivery.
- H. Sinn notices that if SPB move some motors, this is temporarily cutting SA3 beam due to MPS. SQS has not observed this effect. Harald will further investigate. 
Adrian M. says SCS impacts SPB in different ways.
- A. Galler mentions that SRP/task force will distribute updates related to the currently raising Covid issues.

CTRL:
- One group of motors at the same SCS/PLC was not accepting changes. A re-start with servers in small loops must help.
- Timing servers (switching off archive): CTRL wants to perform today or tomorrow morning the installation of the new version. Nobody seems against it.

DA:
- Nothing to report.

EEE:
- EEE understand the team request regarding the 5 Hz trigger will be done tomorrow.
- EEE waits for confirmation of SEPS update, possibly happening today or tomorrow. XO mentions Z. Ansari will be able to confirm today after lunch time.

VAC:
- Nothing to report.

XPD:
- Not present.

DET:
- XO inquires on the DSSC activities in SCS: DET says it may be delayed a bit due to other activities; DET got a ticket regarding operation; DA believes the DSSC was 
running and used.

ITDM: 
- Comment on DSSC: it was used but we shall not forget that on the first day there was not a preparation and we could expect hiccups.
- A faulty memory module must be replaced and the exflgateway will be shut down shortly for this activity at around 12:00. An e-mail will be sent but nobody seems against 
to it. 

XRO:
- Nothing to report.

LAS:
- SA3 AMPHOS photodiodes still has problems. System is partially working and can be operated. LAS knows beam size and pointing do not change but not if loses power. 
AMPHOS is contacted. 
The consequence is that switching ON and OFF takes more time because it is done manually. Further measurements will be done and SA 3 instruments will be updated 
accordingly.
- LAS informs its OCD team is not responsible for synchronization issues. 
- SA1 and SA2 lasers are fine.

UNSYS:
- Small issues with SA3 PLC crashes: SA3 is operated without first cells. A re-start of the servers is needed, probably today or tomorrow. UNSYS will inform SCS and SQS 
when this is fixed. 

SPB:
- Nothing to report.

FXE:
- FXE says that SQS will need to perform some tests: this will be discussed in separate round.

MID:
- All fine.

HED:
- Data recording on Saturday night was not saved. Shift crew realized at the end of the shift that it was not saved - main data for the shift. 
- ITDM investigated the issue after ticket arrived yesterday. It confirms data was not recorded and can't see why this happens as ticket arrived late. Even the folder of 
the data was not recorded. 
For the future: there is an assumption to look at the data every few minutes. ITDM will share procedures. Further discussions on flexibility for different systems/setups 
have to be done.
- HED says the 5Hz test must be tomorrow by the morning. XO states that currently this is only a test then we will see what happens. HED has this understanding.
- HED has recorded several hundreds of microns in horizontal jitter. XRO says that it is important to work together for investigating the jitter. 
HED will send the data to XRO and/or the coordinator of stability task force.

SCS:
- Not present.

SQS:
- Preparing next week user operation; still some problems with Zoom connection: SQS and ITDM will discuss the issue.
  151   12 Aug 2020, 10:52 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 12.08.2020
General Announcement:
- Andreas G. thanks all instruments that have so far sent back to XO the cw35 Beam Delivery tables and reminds the missing ones to do so until Thursday (tomorrow).
- Jan G., as PRC, informs the access to SQS shutter will probably happen on next week. In case of possibility during this week he will directly inform the respective persons.
- Steve A. mentions on the timing related issues: it has been investigated with the help of instruments.
- XO asks groups for any time feedback on issues related to Covid rules, e.g. amount of masks. 
- Jan G. informs several members of XPD team (and also CTRL and ITDM personnel) will be working at PetraIII while performing beamtime, from Thursday until mid-next week. 

CTRL:
- Activities on GATT: Follow-up of Karabo update shows incompatibility with new version. CTRL, Raul and XO rolled back to the previous version and it works again.
- At around 8:00pm a notification service in SASE3 was sent: watchdogs went in unexpected state.

DA:
- Nothing special to report.

EEE:
- Today we bring back the crate for MID/STL and we start with HED requested changes.
- XO thanks Nerea on yesterday's work of Interlock conditions for the solid attenuators in the tunnels. 
To protect the silicon screen first one has to insert the diamond screens. Nerea J. says this is in the motion loops and not EPS.

VAC:
- Raul V. thanks for the quick reaction of CTRL and XO to solve the code of GATT (which is 2.5years old). 
If we have a chance during the next winter shutdown a change on the software system will be planned to permit the use of new Karabo versions.
- VAC has requested a couple of ZZ's for next days/weeks: on SQS shutter and other devices inspections.

XPD:
- No incidents since Monday to be reported. However, last Saturday there was a downtime on the XTD1/XGM due to a high voltage setting. 
Probable cause was a wrong command at the DOOCS server. XPD believes it was a onetime incident and will look into it if it happens again.

DET:
- Working with Jungfrau in SPB; DSSC in SQS/SCS.
- Supporting other groups' activities.

ITDM: 
- The DAQ update has been finished: so far it looks good.
- ITDM is ready to act but waits for more clarifications on the SRP requested work on Interlock. 

XRO:
- Not present - group has helped with solid attenuators activities.

LAS:
- Everything is running and interlock is set.

UNSYS:
- Nothing to report.

SPB:
- Detector program ongoing with Junfgrau and AGIPD.

FXE:
- A ZZ was done to switch off the M3 cooling. The jitter has then reduced from 295u (RMS) to about 211u. FXE considers this only moderate jitter and will proceed with commissioning.
- Feedback system is fixed with parameters configurations – we are following it up to find when this was changed (if so).

MID:
- Issues with feedback Macro are observed and Robert S. investigates together with MID.

HED:
- Not present.

SCS:
- Not present.

SQS:
- Nothing to report.
  
  150   11 Aug 2020, 11:01 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 10.08.2020
General Announcement:
- Beam delivery starts this week. XO reminds the reason to send the Beam Delivery table is to provide machine with parameters. Please take in mind that we shall not fill 
out tables during Friday's UOM. 

CTRL:
- Two configurations changes planned for today if agreed: 
1. In SA3 machine changes the 10Hz and may affect the archiving. This means time serving in Karabo has to be changed during the day today; 
2. CTRL updated last week most of Karabo devices in instruments, but few tunnel instruments remain and shall be done today - few time down and then re-starts.
- HED issues with VAC/SA3 have been investigated together with EEE.
- InfluxDB update was done and OK.
- LAS comments a laser pattern is required in order to compare laser status between different runs. Follow-up discussion with beamlines, LAS, CTRL is needed.
- AG asks if SA2 and SA3 are aware of the 5Hz operation mode. Tomasz from LAS says all servers see the bits are changing. 
- Steffen concludes that CTRL will proceed with updates today and by next Monday CTRL will switch on the archive again with the solution we will have by then. 

DA:
- Nothing to report.

EEE:
- Taking out crate of MID; making changes on the request of HED.

VAC:
- Nothing to report - all running.

XPD:
- Nothing to report.

DET:
- Not present.

ITDM: 
- DAQ recent bugs were mostly fixed: today FXE and HED will be fixed. Afterwards all are done.

XRO:
- Nothing to report.

LAS:
- SA3 laser had a probably on Saturday: warming up devices. LAS may be able to fix today (Sunday's effort did not work).

UNSYS:
- Issues in SA2 with cells #1 and #33 have been fixed by ZZ on last Wednesday.
- Also hardware problem in SA3 cell#14 was also fixed.
- Software development in response to MXL complaints is under work and needs a maintenance and/or shutdown time. 

SPB:
- Nothing to report.

FXE:
- Meeting with EEE to look in the digitizer - issue could be solved, it is now running stably.
- Used Beam feedback to stablish the beam position was not working reliably: spontaneous jumps were observed. FXE will look together with CTRL on Wednesday. 
One idea is to pick beam position from imager. No other instruments have this observation.

MID:
- Synchro will arrive today and thus SA2 laser will not be available.
- Train matching offset between AGIPD and XGM reported two weeks ago: MID is asking for an update. SA will check today and give information on Wednesday.

HED:
- HED had problems with MC2 axis in Beckhoff motors during last week and asks to have a follow up from EEE. Events of losing parameters are happening quite often.
- Karen A. mentions they added manually parameters and they had to reset again. HED-LOOP1 will not be reset today (Steffen). SA2 loops will have to be checked. 
- Steffen and Marijan add the issue is now understood by sacrificing one of the HED PLCs. One has to fix the code of the framework and this can't be solved by Wednesday.  

SCS:
- Motors of the DSSC support were also lost. They have been fixed.
- Issue with pump is also solved.
- New installed devices during shutdown (pressure gauges) were tested on Friday.

SQS:
- Not present.
  149   05 Aug 2020, 09:02 Andreas GallerGeneralInformationNotes XO Integration Meeting 05.08.2020

General Announcement:

  • .

CTRL:

  • SA3 vac loop
    • devices lose connection to the PLCs every now and then (every few days)
  • karabo fix for small movement error on MC2 motors
    • for the tunnel topics CTRL suggests to do that Thursday morning
  • InfluxDB

DA:

  • no issues
  • upcoming commissioning
    • da infrastructure up and ready

EEE:

  • cw36, cable installations require

VAC:

  • no issues, normal activities

XPD:

  •  

DET:

  • no issues

ITDM:

  • continuing with Monday tasks

XRO:

  •  

LAS:

  • increas priotity on karabo integration for lasermet interlock
  • SH: for SA1 and SA2 much of the interlock data is

UNSYS: 

  • today ZZ --> cell 33 should be fixed today as well as cell1

SPB:

  • nothing outstanding
    • DAQ testing
    • VAC intervention

FXE:

  • FXE and XRO is switching off M3 cooling
  • no update on the digitizer issue

MID:

  • no issue

HED:

  • MC2 motor timeout problem, karabo fix seems to work
    • there are other time out errors that ar not addressed by this
    • SH: suggests a zoom session for demonstration of these
    • TP: e.g. stop button gives time

SCS:

  • no issues
  • installation of girder
  • bestec is working on hRIXS
  • recommissioning of Mono

SQS:

  • laser interlock issue
    • Lasermet is visiting today

  148   03 Aug 2020, 09:23 Andreas GallerGeneralInformationNotes XO Integration Meeting 03.08.2020

General Announcement:

  • .

CTRL:

  • few issues on SA3 vacuum server, over the weekend.
    • twice some devices were not running,
    • when restarting Beckhoff loops from the GUI please remember that it takes time until they are back
  • device servers with - in their name. restarting with the service manager cannot cope with this --> fix is underway
  • scheduling:
    • Beckhoff: small movement error fix is underway and it is suggested to update karabo Beckhoff servers later this week.
    • influxDB data logging
      • current version does not allow easy correlation data from two devices in Grafan (web front-end) an update to the next higher version would cure that
        • suggest to update Wednesday morning early
  •  

DA:

  • no issues

EEE:

  • utca OCD calls
    • nothing serious
  • PLC no OCD calls
    • some updates are planned for FXE, MID SCS on Beckhoff

VAC:

  • no issues

XPD:

  • no issues

DET:

  • comm AGIPD detectors
    • detectors are stable, but issues with online processing

ITDM:

  • new version of DAQ had been tested
    • should be deployed this week
  • 1 OCD call for recording data with ADQdigitizer
    • requires coord between CTRL and ITDM and EEE
    • this operation mode had been tested
  • 1 OCD call JUNGFRAU SPB in burst mode --> did not work
    • SH: was the receiver crashing?
    • KW: not clear, nothing was working in that config
    • SH: the problem had been identified at FXE --> fix should be deployed at SPB as well

XRO:

  • update:
    • follwoing up the issue with the attenuator damage in SAx
  •  

LAS:

  • all three laser are running
    • some problems with shutters
      • SQS: shutter in ILH, cooling water refilled --> but interlocks could not be set
        • XO to coordinate discussion with Pouneh

UNSYS: 

  • no issues

SPB:

  • karabo sessions lost connections to GUI server on exflcon026
  • JUNGFRAU receiver crashing
  • DAQ took long time to change state
    • even switching to ignore after run take a long time
    • this relates to JUNGFRAU
  • GOTTHARD specref device crasing multiple times
    • restarting had to be done multiple times
  • optics interlock hutch was observed to be broken on Thursady night

FXE:

  • digitizers at some point stopped
    • connection to boards and triggers
    • BF: this has to be investigated!
  • beam stability
    • mirror cooling
  • EXAFS within 700 eV had been measured
  • PP Laser was very stable

MID:

  • VAC incident in CRL2 --> which closed V0 --> VAC solved the issues
  • due to high pulse energies small damage to attenuator and instrument component had been
  • DAQ update scheduling
  •  

HED:

  • beam is jittering (when collimated 100 um are observed)
  • CRL scene optics hutch is mixed up for one or two motors --> Thomas Preston investigate

SCS:

  • no issues

SQS:

  • interlock / shutter issue
  147   29 Jul 2020, 08:59 Andreas GallerGeneralInformationNotes XO Integration Meeting 29.07.2020

General Announcement:

  • .

CTRL:

  • INfluxDB migration is running smoothly, tomorrow the last topics will be switched to influx only
  • some Basler / Andor cameras not working at 10 Hz is related to the data network --> depends

DA:

  • n

EEE:

  • Company Wille is on-site for hardware installations
    • hRIXS,
    • HED cable installations
    •  

VAC:

  • no issues

XPD:

  • i

DET:

  • commissioning shifts with AGIPD
  • pn CCD at SQS also on commissioning

ITDM: 

  • issue from Monday wrt crippled DAQ when having no sow data in a datasource
    • the fix reported on Monday only works partially --> earliest estimate for fixing is now next week
  •  

XRO:

  • s

LAS:

  • n

UNSYS: 

  • no issues

SPB:

  • OCD for Basler cameras
  • OCD for MC2 stages (problem with encoders, EEE is informed)

FXE:

  • Major issue with the machine wrt to big brother
  • JUngFRAU seems to be more affected by the DAQ glitch
  • GOTTHARD detector should be re-integrated into the DAQ
    • K. Wrona clarifies that only a reconfig of datasources is needed

MID:

  • beam looks unstable
    • horizontal jitter is higher than usual

HED:

  • no issues

SCS:

  • no issues
    • Daniele: is the soft-mono solved?
    • TM comments: the pre mirror is in place piezos are working

SQS:

  • no issues
  • pnCCD commissioning
  146   27 Jul 2020, 09:05 Andreas GallerGeneralInformationNotes XO Integration Meeting 27.07.2020

General Announcement:

  • XO discusses the need for sharing information.

CTRL:

  • support calls
    • small movements cause errors on MC2 motors, fis is going to be tested today and it will be communicated when ti is going to beployed
  • swithcing to influxDB only logging, if not heard otherwise then this should happen this afternoon (Monday)
    • SCS, SPB, HED, MID
  • switching to influxDB in SA1, SA2 and SA3 to follow as well
  • notification service updated such, that only more serious messafe are being send out

 

DA:

  • no issues

EEE:

  • cable installations in this week at HED, should start from tomorrow, 1.5 days (Jörn)
  • few OCD calls,
    • soft mono in SASE3, motor not working
    • mirror
    • FXE motor runs into emergency stop --> fixed in the latest PC framework, but FXE is running an earlier version
    •  

VAC:

  • no issues

XPD:

  • i

DET:

  • Thursday, OCD was not scheduled, despite some calls

ITDM: 

  • bug for big detectors in DAQ had been addressed and should be deployed soon
    • this bug seems to also affect some slow detectors
      • only happens when there is no slow data added to the aggregator
  • data reduction effort
    • one outcome: record bunch pattern in every run
      • instruments are asked to include the datasource XXX_timing
      • SH comments: in the future the bunch pattern information will be made available in the pipeline

XRO:

  • some recommissioning last week
  • sometimes mirrors are not moving

LAS:

  • no issues

UNSYS: 

  • c

SPB:

  • good run for the first wek
  • trouble with detector, not being able to record darks -> fixed next day
    • issue with a device that checks correct datasources
  • FXE imager EPS interlock issue

FXE:

  • FXE imager EPS interlock issue

MID:

  • successful week
  • a couple of OCD calls
    • CTRL, EEE, DET, everything solved
  • AGIPD trainID offset by 1 wrt to the XGM
  • karabo update --> changes are incompatible with existing scenes
    • e.g. number of digits
    • SH comments that it would be appreciated if those issue were reported to CTRL

HED:

  • no issues
  • MC2 motor update, is that going to be done today?
    • SH: yes and if possible for HED, then 11:30 - 13:30 would be the preferred time window.

SCS:

  • exit slits did not move --> EEE OCD could help
    • SCS requests tthat components are tested before tunnels are closed
  • Navitar didn't work
    • focussing lens lost position
  • when component software is updated/upgraded, SCS would liek to see a test
  • NG comments: motor parameters are sometimes wrong
  • If things need to be modified, test beforehand

SQS:

  • no issues

  145   22 Jul 2020, 09:22 Andreas GallerGeneralInformationXO integration meeting 22.07.2020

General Announcement:

  • Default beam positions are being implemented for each SASE at the FEL imager to reduce re-alignment offers for the instrumetns after shutdowns and facility development weeks

CTRL:

  • minor OCD calls
    • 6541, 6542
  • few MC2 motors not working -> target velocity was set to 0
  • in SA1 the bunch pattern changes @10 Hz --> data logging system (with timers) gets overloaded ...
    • if this was to become a normal mode of operation, the system would need to be adpated --> as for now bunch pattterns are not logged anymore
  • remote user access to karabo
    • soo to be tested with SQS
  • inlfuxDB
    • FXE 95% migrated, probably 100% at the end of the day
    • LAS SA1 100% migrated
    • MID, SCS shall reply when migration is possible (causes a short down time of datalogging)
    • SPB, HED shall reply s.a.

 

DA:

  • nothing to report

EEE:

  • issue with encoders in SPB --> some errors had been disabled --> checks for cable lengths (OCD call)
  • SQS interloop comunication working? EEE, yes, need to investigate
  • N. Jardon reminds about the default parameter procedure
  • pre shutter in SA3 works commence when Zunaira, Martin and Maurizio

VAC:

  • nothing to report

XPD:

  • intervention Monday in SA3, PES is operational

DET:

  • no issues

ITDM: 

  • last week new DAQ deplyoed in HED, FXE and SPB and tunnels, the three other instruments had been delayed
    • MID today, SQS yesterday
  • scratch space in gpfs --> running out of space --> data needs to be removed
    • procedure not yet agreed upon
    • all involved parties should identify data that can be removed from scratch
    • 100 TB are left
  • internal proposals for commissioning time needed
    • in the future please prepare those in advance

XRO:

  • during the weekend, XRO was recommissioning of the beam transport
    • some qctivities were completed on Tuesday, M3 repositioned from damaged spot
    • recommissioning is completed --> however small problems are to be expected over the frst few days, please contact XRO

LAS:

  • no issues

UNSYS: 

  • cell 33 in SA2 communication crippled, ZZ planned for next monday

SPB:

  • reasonably succesful first night with beam, instrument aligned with alignment laser
  • tunnel EPS system --> the FXE_XTD9_popin blocked SPB to 1 pulse
    • MPS signals from SPB might be masked by the machine -> needs to be checked
  • 1 OCD call to EEE
  • dMigration to influxDB can be done

FXE:

  • re align beam to FXE pop in
  • mono re alignment
  • issue with FastValva --> naming convention on the PLC level had been changed, now only capital letters are allowed --> Bernard is looking into this
  • tunnel project using step function with motors throws an error on the slot
    • CTRL is workig on a fix already, it happens for very small steps
    • J. Nardon: was also reported by SQS
  • all TView devices had to be restarted as they were out of sync

MID:

  • alignment went smooth, until diagnostic endstation
    • data loggers are fine today to migrate to influxDB
      • Steffen aims at afternoon
  • pre shutter
    • for CRL2 not possible to laign as the pre shutter always moved in
      • XRO looks into it

HED:

  • beamline aligned
    • beam profile excellent in fornt of hutch
      • spatial jitter present, and horizontal movement
    • mirror feedback macro not working
  • XGM investigation together twith Theo
  • IPM didodes are not read out --> comment by Peter, check the timers
  •  

SCS:

  • no issues

SQS:

  • beam from around noon, beamline aligned, set points on imagers need to be re found

 

 

  144   20 Jul 2020, 14:18 Frederik Wolff-FabrisGeneralInformationNotes XO Integration Meeting 20.07.2020
General Announcement:
- Regarding Operation, VAC and PRC had a workaround to restore the North branch beam permission on Sunday. 
- XTD9 Turnstiles were not working this morning for ZZ access planned by FXE. 
During the meeting we heard the information that Michael Prollius / SRP has fixed it by rebooting the computer. 

CTRL:
- Since Wednesday CTRL had one OCD call regarding the SA3/GATT gauges and controller configuration.
- SQS server - issues with interactions. Work ongoing.
- INFLUX roll out: test on CAS monitor topic is successful. For the double loggers, there will be an impact of 5-10 minutes down time when login. 
This will happen on FXE (2x10min without data): it is OK for FXE and for LAS today. IF that is successful, CTRL will contact other instruments.

DA:
- Nothing to report

EEE:
- It has been working on the follow-up of HED topics.
- EEE OCD had a call on the SA3/GATT gauge controller.

VAC:
- Severe trouble with SA3 GATT: damage on the gauge controllers was a result of series of problems.
- Bearing of a downstream booster pump make vibration and developed two leaks; then pressure went bad; 
vacuum gauges showed wrong numbers and resulting in electronic damage in the controller cards.
- The booster pump was exchanged on Friday; on Sunday a leak test found a broken vacuum welding and part was removed. 
Currently ZM3 at Desy is fixing it. Expected to be ready for tunnel installation by 10AM.
- Sunday from 13:00: the GATT was in UHV mode to allow beam permission and lasing in SA1 and SA3 up to Monday 6AM.
- Currently XTD10 is open for GATT repair and PES exchange of turbo pump.
- CTRL mailing service worked quite well: an alarm e-mail of GATT fault was sent every 12 hours.

XPD:
- SA3/XGM valve was also OFF on Friday. Martin Dommach will contact Theo while in tunnel.

DET:
- Business as usual.

ITDM: 
- Nothing to report.

XRO:
- Not present due to the night shift for beamline transport alignment activities.
- F. Wolff-Fabris informs the pre-shutters are commissioned by XRO during Sunday's shift.

LAS:
- Nothing to report

UNSYS: 
- Nothing to report

SPB:
- Work is ongoing.

FXE:
- Preparing for beam operation: no big problems.
- Thursday we reported issues with motors not moving. EEE helped and it was found the current of the motors were not correctly migrated. 
Now motors are working. Currents were set too low - this no risk of damage.

MID:
- Preparing for beam.

HED:
- Preparing and checking equipment.

SCS:
- Preparing for beam tomorrow.
- FFT end station problems reported last week are solved.

SQS:
- Waiting for the beam.
ELOG V3.1.4-7c3fd00