Group Selection Page HELP Controls Group Data Analysis Group ITDM WP76 DET Vacuum EEE WP78 WP74 FXE SCS SPB MID HED SQS SXP Sample Environment Operation PSPO XO TS Migrated2Zulip
Technical integration and coordination SASE1 Status and SASE3 Readiness
  Technical integration and coordination logbook, Contact: A. Violante, G. Wellenreuther, Page 24 of 31  Not logged in ELOG logo
ID Date Authordown Location Severity Subject
  147   29 Jul 2020, 08:59 Andreas GallerGeneralInformationNotes XO Integration Meeting 29.07.2020

General Announcement:

  • .

CTRL:

  • INfluxDB migration is running smoothly, tomorrow the last topics will be switched to influx only
  • some Basler / Andor cameras not working at 10 Hz is related to the data network --> depends

DA:

  • n

EEE:

  • Company Wille is on-site for hardware installations
    • hRIXS,
    • HED cable installations
    •  

VAC:

  • no issues

XPD:

  • i

DET:

  • commissioning shifts with AGIPD
  • pn CCD at SQS also on commissioning

ITDM: 

  • issue from Monday wrt crippled DAQ when having no sow data in a datasource
    • the fix reported on Monday only works partially --> earliest estimate for fixing is now next week
  •  

XRO:

  • s

LAS:

  • n

UNSYS: 

  • no issues

SPB:

  • OCD for Basler cameras
  • OCD for MC2 stages (problem with encoders, EEE is informed)

FXE:

  • Major issue with the machine wrt to big brother
  • JUngFRAU seems to be more affected by the DAQ glitch
  • GOTTHARD detector should be re-integrated into the DAQ
    • K. Wrona clarifies that only a reconfig of datasources is needed

MID:

  • beam looks unstable
    • horizontal jitter is higher than usual

HED:

  • no issues

SCS:

  • no issues
    • Daniele: is the soft-mono solved?
    • TM comments: the pre mirror is in place piezos are working

SQS:

  • no issues
  • pnCCD commissioning
  148   03 Aug 2020, 09:23 Andreas GallerGeneralInformationNotes XO Integration Meeting 03.08.2020

General Announcement:

  • .

CTRL:

  • few issues on SA3 vacuum server, over the weekend.
    • twice some devices were not running,
    • when restarting Beckhoff loops from the GUI please remember that it takes time until they are back
  • device servers with - in their name. restarting with the service manager cannot cope with this --> fix is underway
  • scheduling:
    • Beckhoff: small movement error fix is underway and it is suggested to update karabo Beckhoff servers later this week.
    • influxDB data logging
      • current version does not allow easy correlation data from two devices in Grafan (web front-end) an update to the next higher version would cure that
        • suggest to update Wednesday morning early
  •  

DA:

  • no issues

EEE:

  • utca OCD calls
    • nothing serious
  • PLC no OCD calls
    • some updates are planned for FXE, MID SCS on Beckhoff

VAC:

  • no issues

XPD:

  • no issues

DET:

  • comm AGIPD detectors
    • detectors are stable, but issues with online processing

ITDM:

  • new version of DAQ had been tested
    • should be deployed this week
  • 1 OCD call for recording data with ADQdigitizer
    • requires coord between CTRL and ITDM and EEE
    • this operation mode had been tested
  • 1 OCD call JUNGFRAU SPB in burst mode --> did not work
    • SH: was the receiver crashing?
    • KW: not clear, nothing was working in that config
    • SH: the problem had been identified at FXE --> fix should be deployed at SPB as well

XRO:

  • update:
    • follwoing up the issue with the attenuator damage in SAx
  •  

LAS:

  • all three laser are running
    • some problems with shutters
      • SQS: shutter in ILH, cooling water refilled --> but interlocks could not be set
        • XO to coordinate discussion with Pouneh

UNSYS: 

  • no issues

SPB:

  • karabo sessions lost connections to GUI server on exflcon026
  • JUNGFRAU receiver crashing
  • DAQ took long time to change state
    • even switching to ignore after run take a long time
    • this relates to JUNGFRAU
  • GOTTHARD specref device crasing multiple times
    • restarting had to be done multiple times
  • optics interlock hutch was observed to be broken on Thursady night

FXE:

  • digitizers at some point stopped
    • connection to boards and triggers
    • BF: this has to be investigated!
  • beam stability
    • mirror cooling
  • EXAFS within 700 eV had been measured
  • PP Laser was very stable

MID:

  • VAC incident in CRL2 --> which closed V0 --> VAC solved the issues
  • due to high pulse energies small damage to attenuator and instrument component had been
  • DAQ update scheduling
  •  

HED:

  • beam is jittering (when collimated 100 um are observed)
  • CRL scene optics hutch is mixed up for one or two motors --> Thomas Preston investigate

SCS:

  • no issues

SQS:

  • interlock / shutter issue
  149   05 Aug 2020, 09:02 Andreas GallerGeneralInformationNotes XO Integration Meeting 05.08.2020

General Announcement:

  • .

CTRL:

  • SA3 vac loop
    • devices lose connection to the PLCs every now and then (every few days)
  • karabo fix for small movement error on MC2 motors
    • for the tunnel topics CTRL suggests to do that Thursday morning
  • InfluxDB

DA:

  • no issues
  • upcoming commissioning
    • da infrastructure up and ready

EEE:

  • cw36, cable installations require

VAC:

  • no issues, normal activities

XPD:

  •  

DET:

  • no issues

ITDM:

  • continuing with Monday tasks

XRO:

  •  

LAS:

  • increas priotity on karabo integration for lasermet interlock
  • SH: for SA1 and SA2 much of the interlock data is

UNSYS: 

  • today ZZ --> cell 33 should be fixed today as well as cell1

SPB:

  • nothing outstanding
    • DAQ testing
    • VAC intervention

FXE:

  • FXE and XRO is switching off M3 cooling
  • no update on the digitizer issue

MID:

  • no issue

HED:

  • MC2 motor timeout problem, karabo fix seems to work
    • there are other time out errors that ar not addressed by this
    • SH: suggests a zoom session for demonstration of these
    • TP: e.g. stop button gives time

SCS:

  • no issues
  • installation of girder
  • bestec is working on hRIXS
  • recommissioning of Mono

SQS:

  • laser interlock issue
    • Lasermet is visiting today

  152   14 Aug 2020, 10:40 Andreas GallerGeneralInformationNotes XO Integration Meeting 17.08.2020
General Announcement:
- An informal Run coordinators' BKR chat to exchange ideas happens every day at 15:00. 
It is a forum in case technical and scientific people wish to make formal requests. XO will send an e-mail with Zoom link.
- XO would like to ask instruments to pay attention to the parameters of the Delivery and Operators table, especially regarding the bunch limits for the North branch.
Ideally we shall discuss one week before beam delivery.
- H. Sinn notices that if SPB move some motors, this is temporarily cutting SA3 beam due to MPS. SQS has not observed this effect. Harald will further investigate. 
Adrian M. says SCS impacts SPB in different ways.
- A. Galler mentions that SRP/task force will distribute updates related to the currently raising Covid issues.

CTRL:
- One group of motors at the same SCS/PLC was not accepting changes. A re-start with servers in small loops must help.
- Timing servers (switching off archive): CTRL wants to perform today or tomorrow morning the installation of the new version. Nobody seems against it.

DA:
- Nothing to report.

EEE:
- EEE understand the team request regarding the 5 Hz trigger will be done tomorrow.
- EEE waits for confirmation of SEPS update, possibly happening today or tomorrow. XO mentions Z. Ansari will be able to confirm today after lunch time.

VAC:
- Nothing to report.

XPD:
- Not present.

DET:
- XO inquires on the DSSC activities in SCS: DET says it may be delayed a bit due to other activities; DET got a ticket regarding operation; DA believes the DSSC was 
running and used.

ITDM: 
- Comment on DSSC: it was used but we shall not forget that on the first day there was not a preparation and we could expect hiccups.
- A faulty memory module must be replaced and the exflgateway will be shut down shortly for this activity at around 12:00. An e-mail will be sent but nobody seems against 
to it. 

XRO:
- Nothing to report.

LAS:
- SA3 AMPHOS photodiodes still has problems. System is partially working and can be operated. LAS knows beam size and pointing do not change but not if loses power. 
AMPHOS is contacted. 
The consequence is that switching ON and OFF takes more time because it is done manually. Further measurements will be done and SA 3 instruments will be updated 
accordingly.
- LAS informs its OCD team is not responsible for synchronization issues. 
- SA1 and SA2 lasers are fine.

UNSYS:
- Small issues with SA3 PLC crashes: SA3 is operated without first cells. A re-start of the servers is needed, probably today or tomorrow. UNSYS will inform SCS and SQS 
when this is fixed. 

SPB:
- Nothing to report.

FXE:
- FXE says that SQS will need to perform some tests: this will be discussed in separate round.

MID:
- All fine.

HED:
- Data recording on Saturday night was not saved. Shift crew realized at the end of the shift that it was not saved - main data for the shift. 
- ITDM investigated the issue after ticket arrived yesterday. It confirms data was not recorded and can't see why this happens as ticket arrived late. Even the folder of 
the data was not recorded. 
For the future: there is an assumption to look at the data every few minutes. ITDM will share procedures. Further discussions on flexibility for different systems/setups 
have to be done.
- HED says the 5Hz test must be tomorrow by the morning. XO states that currently this is only a test then we will see what happens. HED has this understanding.
- HED has recorded several hundreds of microns in horizontal jitter. XRO says that it is important to work together for investigating the jitter. 
HED will send the data to XRO and/or the coordinator of stability task force.

SCS:
- Not present.

SQS:
- Preparing next week user operation; still some problems with Zoom connection: SQS and ITDM will discuss the issue.
  Draft   12 Oct 2020, 09:12 Andreas GallerGeneralInformationNotes XO Integration Meeting 12.10.2020

General Announcement:

  • .

CTRL:

  • issues SA3 vacuum loop
    • gets more and more diffcult to recover
      • problem not clear, PLC comminucation is lost without obvious reasons
      • no software changes took place from either CTRL nor EEE ... component issue?
  • fastadc issues --> EEE
  • mirror in SA3 not always following a move ommand XTD10 M1

DA:

  •  

EEE:

  • OCD at HED --> hexapod
  • fineDelay

VAC:

  • preventive action in XTD10 for GATT scroll pump

XPD:

  • SA2 imager XTD6 pop in 45 after M3 small mark on the imager --> imager still usable

DET:

  • nothing to report

ITDM:

  • OCD call data aggregator at MID
    • need to understand better how to avoid the situation
  • users complained to maxwell service (DESY directly) about limited resources becuase of high load by other users
    • there are reserved nodes --> use them!
  • issues with scratch
    • more than 300 TB had been accumulated within a relatively short time
      • it seems that data was calibrated to scratch not to proc
      • MID comments --> a special calib mode was used that could not save to proc which is why it was saved to scratch
  • problem with one of the proxy servers --> degraded performance of data migration

XRO:

  •  

LAS:

  • issue at SA1 with Galvo
    • after shift change to FXE, laser was not working --> Galvo was out of phase
    • FXE resetted something (not clear) and the laser came back
    • LAS investigating the issue

UNSYS: 

  • nothing special
    • a couple of times the undulators opened suddenly without any command issued.
    • O. Henssler from DESY proveds the logs

SPB/SFX:

  • coupling with SA1 and SA2 (SA2 using train on demand) is an issue
    • beam walks off the XTD9 XGM aperture
  • offset mirrors M2
    • pitch movement got stiff
  • smaract cotnrollers
    • most fixed by increasing timeout windows

FXE:

  • shutter can be opened despite closed vavales

MID:

  • used pulse on demand
    • users were happy

HED:

  • damage on M3 mirror
    • due to focusing scheme --> 9keV and intermediate focus --> during alignment unfortunately the focusing point came too close to M3
  • meeting with XPD and XRO at 11:30
  • hexapod issue reported to EEE is not quite fixed
    • ´status is not reporting the correct status of the hexapod
    • hexapod started working at some point and fell back to weird operation later again
  • CRL arm7 seems to be at the limit of the x-axis
    • if FEL stays where it is, XTD1 chamber might need to be moved
  • JUNGFRAU issue
    • up to a point the data is fine in the preview
      • after some runs data seen in the preview is not written to file

SCS:

  • nothing to report

SQS:

  • l
  169   14 Oct 2020, 09:22 Andreas GallerGeneralInformationNotes XO Integration Meeting 14.10.2020

General Announcement:

  • .

CTRL:

  • problems in SA3
    • VAC loop unstable, devices cannot be brought into a stable state --> what used to be a restart every  two weeks, cannot be recovered these days
    • issues with motors developing a short time out
      • somewhere there is a beavy load on Beckhoff loops
      • TM comments: at times the movements happen very late after issuing the command
    • influxDB sees high load
      • any modification of or running a new macro?
      • Please let CTRL know
    • the issue started with VAC --> devugging shoud start there

DA:

  • extrafoam OCD call

EEE:

  • working together with CTRL on SA3 issue
  • OCD call from SCS but call was not correctly frowarded

VAC:

  • not present

XPD:

  • no issues

DET:

  • OCD call from SCS --> was fixed

ITDM:

  • nothing to report

XRO:

  • nothing to report

LAS:

  • no issues

UNSYS: 

  • nthing to report

SPB/SFX:

  • all fine

FXE:

  • people on shift could not initiate a hutch search
  • GABS access right missing (Gebietsabsuche)
    • introduced without informing FXE

MID:

  • waiting for invitation AGIPD trainID solution

HED:

  • JUNGFRAU issue presists
  • HexaPOD is working again
    • work around

SCS:

  •  

SQS:

  • DAQ issue
    • no data was recorded without
  • vac is an issue but not endangering
  • motor issue is vital to the instrument

  213   07 Apr 2021, 08:52 Andreas GallerGeneralInformationNotes XO Integration Meeting 07.04.2021

General Announcement:

  • .

CTRL:

  • recurrent error reprted by LAS  --> drift compensation in SA2 --> need feedback
  • minor issues reported instruments during startup

DA:

  •  

EEE:

  • Issue on April 4th --> 4 PLCs shut down without a cause, (looks like power cut)
  • MID crate went down at 9:00
  • SA3 utca shut down (could be voltage drop, could be ehternet) (9:35)

VAC:

  • VAC-OCD recovered SA2 vacuum state (valves, and ystem) (see EEE SA2 incident above)
  • VAC obseved that the MID Mono warmed up, the cryo warmed up presumably after a PLCs update which interrupted an interloop communication

XPD:

  • nothing report

DET:

  • everything running fine

ITDM:

  • SA1 baclony room checked
    • some racks lost power --> investifation going on (possibly happened on Sat. Apr 3rd 8:00 am)

XRO:

  • incorrect motor velocity in SA3 --> fixed
  •  

LAS:

  • small issue in SA2 with slow feedback --> see CTRL report

UNSYS: 

  • problem on SA1 central control node, after a power cycle aircoils and phase shifters were unresponsive

SPB/SFX:

  • Laser Interlock issue was solved, power spike involved that reported by MEA3 ( klaus Witt).

FXE:

  • no issues

MID:

  • M1 mirror was moved completely out on 1st of Apr.
    • --> Naresh Kujala moved M1 out.

HED:

  • Laser interlock issue on Tuesday
  • with regards to the MID Mono cryo, there had been HED PLC updates
  • calibration pipeline issue on AGIPD
  • HED utca in optics hutch went off

SCS:

  • no issues

SQS:

  •  
  239   07 Jul 2021, 09:07 Andreas GallerGeneralInformationNotes XO Integration Meeting 05.07.2021

General Announcement:

- User Operations Meeting will resume on Friday

CTRL:

- Last week found small bug for the fastADC – short down time requested

DA:

- Nothing to report.

EEE:

- Fast electronics – are planning a ZZ

- Fuses issue – MID & HED medium priority crates fixed

- SASE 3 vacuum loop has to be updated – today afternoon or tomorrow around lunch timewill be coordinated by XO with EEE and MXL

VAC:

- Nothing to report

XPD:

- Start up of equipment

DET:

- Nothing to report.

ITDM:

- Nothing to report.

XRO:

- Nothing to report.

LAS:

- Alignment Laser interlock issue at SA3, being investigated

UNSYS:

- Nothing to report.

SPB:

- some motor issues after crate restarts in connection with but not caused by the works adressing the fuse issue

FXE:

- Nothing to report.

MID:

- all fine

HED:

- nothing.

SCS:

- Nothing to report.

SQS:

- Nothing to report.

  240   07 Jul 2021, 09:14 Andreas GallerGeneralInformationNotes XO Integration Meeting 07.07.2021

General Announcement:

  •  

CTRL:

  • nothing to report

DA:

  • Nothing to report

EEE:

  • XTD 10 ZZ uTCA excahange

VAC:

  • nothing

ME:

  • nothing

XPD:

  • within next three days XPD equipment to be checked with x-rays
  • DAQ test next Monday
  •  

DET:

  • LPD
    • communication with RAL and STFC, no sign of corrosion --> single module to be taken out and test in the lab

ITDM:

  • nothing

XRO:

  • nothing
  •  

LAS:

  • redmine tickets

UNSYS: 

  • nothing to report

SPB/SFX:

  • ITDM DAQ test today

FXE:

  • nothing --> hutch being prepared
  • PLC loops 4 and 7 are down due to hardware issues on the PLC --> EEE on it.
    • sample stack --> loop4 preparation delayed

MID:

  • pre is going on, everything

HED:

  • nothing

SCS:

  • nothing

SQS:

  • nothing to report

AOB:

  • Zunaira --> beam shutter keys

  241   12 Jul 2021, 09:29 Andreas GallerGeneralInformationNotes XO Integration Meeting 12.07.2021

General Announcement:

  •  

CTRL:

  • InFlux, still experiencing delay with querying the database (20min, karaba; 5min Grafana)
    • Jan reports that in the XGM trendlines a similar effect is seen

DA:

  • nothing to report

EEE:

  • Friday call from BKR, because of MPS blocking
    • FXE SHUT MPS signal was not reset
    • ZA comments, that the reason is not yet clear --> ZA is contact with Rathjen and MPS experts

VAC:

  •  

ME:

  •  

XPD:

  • For the FXE SHUT it seems MPS and karabo data are differeing
  •  

DET:

  • LPD
    • Hazem is back on Friday --> Supermodules will be tested then in the Lab
  • AGIPD
    • special dark procedur currently not working well

ITDM:

  • nothing to report

XRO:

  • This week, component check in all SASE tunnels
  •  

LAS:

  • nothing to report

UNSYS: 

  • Friday
    • SA1 cell 10, Suren exchanged the coupler

SPB/SFX:

  • nothing to report

FXE:

  • nothing to report
    • PLC issues loop4 and loop7 solved

MID:

  • nothing to report

HED:

  • nothing to report

SCS:

  • nothing to report

SQS:

  • nothing to report

AOB:

  • Zunaira --> beam shutter keys

  242   14 Jul 2021, 09:28 Andreas GallerGeneralInformationNotes XO Integration Meeting 14.07.2021

General Announcement:

  •  

CTRL:

  • InlFlux logging, some statisitics had been gathered --> but no root cause had been found.
    • Load Balancer would needed to be restarted --> data inside buffer would be

DA:

  • all good

EEE:

  • PLC team is still busy with check up of the "fuse" issue
  • MID cabling going

VAC:

  •  

ME:

  •  

XPD:

  • one XGM didn't ecevice a signal
    • quickly resolved
  • downstream XGM's are running as well

DET:

  • AGIPD
    • dark procedure fixed and seems to be working now at SPB/SFX, has to be installed at HED and MID
  • LPD
    • 3 supermodules had been moved to the DET LAB --> so far visual inspection does not show major issues
    • no module powered yet
       

ITDM:

  • nothing to report

XRO:

  • SA1 was aligned
    • SPB/SFX done

LAS:

  • humidty in PPLAS
    • TS working on it
      • PKG after maintenance did not come back to specs

UNSYS: 

  • nothing to report

SPB/SFX:

  • nothing to report

FXE:

  • nothing to report --> shutter porblem solved

MID:

  • nothing to report

HED:

  • nothing to report

SCS:

  • triggers

SQS:

  • nothing to report

AOB:

  •  

  265   04 Oct 2021, 09:30 Andreas GallerGeneralInformationNotes XO Integration Meeting 04.10.2021

General Announcements
none

 

CTRL
- late train IDs at XGM, being sorted

 

DA
- nothing to report

 

EEE

DET

ITDM
- nothing to report

XRO
-

LAS
- Failure of Power SUpply on AMPHOS in SA3, had been replaced over the weekend,
- observed jump on ODL in SA2 around midnight --> being investigated

UNSYS
- nothing to report
- PKG status to be discussed

 

SPB/SFX
- nothing major to report

 

FXE

 

MID
- Feedback for M2 stopped working, started calculating wrong values

HED
- nothing to report

SCS
- problems with DAQ: DA1 stuck --> DOC and ITDM are aware

SQS
- nothing to report

 

AOB

 

 

 

  266   06 Oct 2021, 09:28 Andreas GallerGeneralInformationNotes XO Integration Meeting 06.10.2021

General Announcement:

  •  

CTRL:

  • nothing to report

DA:

  • nothing to report

EEE:

  • nothing to report

VAC:

  • nothing to report

XPD:

  • nothing to report

DET:

  • nothing to report (SPB reports JF1M issue --> suspected readout board issue)

ITDM:

  • issues with Nagios
    • misconfig by puppet mangement (DESY)

XRO:

  • nothing to report

LAS:

  • nothing to report
    • SA3 PPL up and running

UNSYS: 

  • Phaseshifter tables for higher energies in blue week had been uploaded
  • two quad movers from SA2 moved to 0
    • triggered by doocs --> quad movers moved back but it is unclear if they actually returned the BBA optimized position
    • clarification with M. Scholz confirms that quad movers did not move.

SPB/SFX:

  • JF
  • nothing to report

FXE:

  • User Experiment starts
  • C&C update requested until next week for LPD (uTCA)

MID:

  • all fine at MID

HED:

  • nothing to report

SCS:

  • not present

SQS:

  • nothing to report

AOB:

  •  

  267   11 Oct 2021, 09:27 Andreas GallerGeneralInformationNotes XO Integration Meeting 11.10.2021

General Announcement:

  •  

CTRL:

  • nothing report

DA:

  • nothing to report

EEE:

  • several motors in SPB/SFX had trouble, all originating from the same crate

VAC:

  • VAC problems at HED last Wed
    • monochromator section in the tunnel, two unidentified vacuum bursts

XPD:

  • nothing to be reported

DET:

  • nothing to report

ITDM:

  • nothing to report

XRO:

  • FXE (PZ) reported a large jump in the bender setting, sebsequently Ry and pitch drifted for days and stabilized later
    • M1 M2 alignment changed as well
    • currently stable and being investigated

LAS:

  • nothing to report

UNSYS: 

  • nothing to report

SPB/SFX:

  • unstable pulse energy jittering ~ 35% over days.

FXE:

  • Experiment went well, apart from minor issue with calibration pipeline with JF

MID:

  • all fine

HED:

  • nothing to report

SCS:

  • not present

SQS:

  • not present

AOB:

  •  

  268   13 Oct 2021, 09:26 Andreas GallerGeneralInformationNotes XO Integration Meeting 13.10.2021

General Announcement:

  • This meeting is a tool to share information/experiences across scientific and technical groups

CTRL:

  • system are working

DA:

  •  

EEE:

  • next week
    • update on GATT and EPS loop in SA3 in roder to allow for new protection of GATT for the whole beaemtime
    • SA2 on Thursday (maybe Friday), try to correct backlash issue --> loop update

VAC:

  • all is running
  • HED VAC event
    • miscommunication between operators led to this issue

XPD:

  • no issue to report
  • next week, during the whole week there'll be a high photon energy test at SA1 and SA2 see a big involvement of XPD
    • 24 keV @SA1 (Tue)
    • ~30 keVC @ SA2 (Wed/Thu)
    • PI/Planner is Frank Brinker

DET:

  • investigating JF1M issue of 4-6Hz instead of 10 Hz operation

ITDM:

  • nothing

XRO:

  • SA1 M1/M2 drifts under investigation
  • XRO is involved as well with next weeks high photon energy effort as well as EEE loop updates

LAS:

  • sub sync

UNSYS: 

  • nothing

SPB/SFX:

  • user exp this week, 24 keV next week

FXE:

  •  

MID:

  • all fine at MID

HED:

  • next week high photon energy

SCS:

  • nothing to report

SQS:

  • next week material tests, maybe also detector group.

AOB:

  •  

  288   20 Dec 2021, 09:25 Andreas GallerGeneralInformationNotes XO integration meeting 20.12.2021

General Announcement:

  •  

CTRL:

  • no update

DA:

  • nothing

EEE:

  • nothing

VAC:

  • nothing to report

XPD:

  • nothing special, shtudown tasks are in schedule, HXPES / XTED2 cable work ongoing

DET:

  • nothing special

ITDM:

  •  

XRO:

  •  

LAS:

  • lasers ramped down

UNSYS: 

  • APPLEXv inv place, VAC to be closed next year

SPB/SFX:

  • working on mirrors
    • checking vacuum today
  • not clear what is the status with the movement of racks wrt SXP (SPB/SFX optics hutch racks currently powered down)
    • electrical installation?
    • PG comments: Brad won't allow operation until 230 V power distribution is calrified, once Brad gives the OK, the racks can be switched on
      racks are being finalized by EEE, but some checks need electrical power
    • RB: SPB/SFX were promised that the move of the racks were finished before X-Mas, but it seems the electrical work is not up to satandards

FXE:

  • shutdown task in schedule

MID:

  • all fine
    • some loop updates planned for Today

HED:

  •  

SCS:

  •  

SQS:

  • nothing

AOB:

  • light OCD over X-Mas for XPD in case of floowings, power outages.lists will be

  289   05 Jan 2022, 09:29 Andreas GallerGeneralInformationNotes XO Integration Meeting 05.01.2022

General Announcement:

  •  

CTRL:

  • no major updates

DA:

  • no major updates

EEE:

  • 1 MID plC dead
    • replaced on Monday
  • cable work planned for next week
    • HED, SXP

VAC:

  • In general excellent progress
  • closing of M2 XTD2 (SA1) in progress, sealing issues mitigated

XPD:

  • XTD10, XTD6
    • improvements, commissioning ongoing
  • clean room tent water leak reported on 23.12.
    • fixed by TS befroe X-Mas

DET:

  • no major issues

ITDM:

  • Jan 19: dCachce maintenance

XRO:

  • progress as planned
  • changes to existing components will be posted to respective elogs

LAS:

  •  

UNSYS: 

  • progress as planned

SPB/SFX:

  • Vac monitoring recoverd

FXE:

  •  

MID:

  • PLC outage on Jan 1 st caused VAC issues (reported by EEE)
    • fixed
  • no access to MID optics hutch due to interlock test

HED:

  • everything on schedule
  • leak on a hose to humidifier device in A12. This leaked a few litres on the floor.
    • to be fixed by Caverion

SCS:

  • progress as planned

SQS:

  • progress as planned
  297   02 Feb 2022, 08:39 Andreas GallerGeneralInformationNotes XO Integration Meeting 02.02.2022

General Announcement:

  •  

CTRL:

  • observation from DOC
    • macros some times after the upgrade to Python 3.8 --> please contact CTRL?

DA:

  • significant upgrade to Offline Analysis -->
    • proc data won't inlcude a copy of raw data any longer

EEE:

  • fast electronics

VAC:

  • no issues

XPD:

  • no incidents
    • 2 tunnel accesses on Monday --> succesful

DET:

  • DET commissioning at SPB (AGIPD JUNGFRAU 1M), MID (AGIPD), HED (ePIX, JUNGFRAU)

ITDM:

  • E0.604 rack room, Wed next week
    • fixing power distribution units in every rack --> TS and external company will need a full day
    • affected services are: Lab DAQ, LAB control servers (EEE; CTRL, DET), GitLab runners, one machine for data analysis, PLC database, karabo project database (?)
  • Yesterday short interruption with influx reading note --> test requested for next Monday causing a 1 hour interruption

XRO:

  • SA1 / SA2 M3 PBLMs have been equipped with diamond plates and can be used for beam stability measurements
  • Backlash Controls implemented last week --> values
  • report of lost positions of vertical slit in SA3
    • in case of similar issues please contact DOC prior to self fixing.

LAS:

  • SA2 PPL is good
  • SA3 PPL planned to be up today
  • SA1 PPL being investigated as agreed with SA1 instruments

UNSYS: 

  • transparency test  for APPLE X went successful

SPB/SFX:

  • SPB/SFX aligned since yesterday, no issues

FXE:

  • blown fuses in crates --> solved with EEE

MID:

  • all fine

HED:

  • Com yesterday
    • outstanding issue: fastADC not working EEE aware of that

SCS:

  •  

SQS:

  • GATT always worked but very slowly responding
    • OCD contacted
    • Raul comments that this is a known issue and should be communicated to CTRL
    • SH nesures that Raul creates the ticket
  • XTD10_PES
    • digitizer display frozen almost all time (connected to 2 DAQs) --> reported to DOC
    • SH comments that when connecting to two DAQs (tunnel and SQS), should be connected to only one DAQ.

  314   04 Apr 2022, 09:26 Andreas GallerGeneralInformationNotes XO integration meeting 04.04.2022

General Announcement:

  •  

CTRL:

  • PP LAS restarting device servers for upgrading the device tag --> autoinstantiate some servers all topics

DA:

  • Planned maintenance today for Cal and gpfs delayed at least until next Monday

EEE:

  • nothing major to report

VAC:

  • 1 ZZ ongoing to XTD4 to shiled an ion pump controller, suspicion of radiation damage.
    • AK Dump XTD10? --> yes

XPD:

  • similar Diamond cracks as in solid attenuator had been observed in the transmissive imagers
  • Last weeek FEL imager issue had been clarified (image was rotated by 180 °, occured due to faultly config load)

DET:

  • AGIPD1M (SPB/SFX), Friday morning some DAQ issues induced train losses. Didn't happen again after careful checking

ITDM:

  • Issue at HED with data migration --> discussion will take place

XRO:

  • Tomorrow and after tomorrow late shift some CTRL support might be required

LAS:

  • PLL LAS SA1 sync issues (LbSYNC informed and arriving 10:00)
  • PPL LAS3 NOPA setup

UNSYS: 

  • ZZ ongoing

SPB/SFX:

  • Experiment went well, no major issue
  • Run Controller crashd a few times over the weekend. Could be restarted but crashes some time later and has to be restarted

FXE:

  • affecetd by LAS Sync issue
  • issue with doocs panel for shutters (yifeng)

MID:

  • all fine
  • SSRY motor issue (ELMO)
    • Nerea updated the ticket --> motor is working

HED:

  • DA1 got stuck for a while (fixed by restarting)
  • lot of short runs (1min) and only one train isneed from that -> requires fast data migration and analysis -> doesn't always work
    • discussion with ITDM commencing
  • PAM was missing from DAQ

SCS:

  • no major issues
  • RIXS on liquids went well

SQS:

  • mono shift becuase

DOC /DRC

issues with call forwarding

  315   06 Apr 2022, 09:15 Andreas GallerGeneralInformationNotes XO integration meeting 06.04.2022

General Announcement:

  •  

CTRL:

  • influxDB outage (telegraf issue)
    • SA1 and SA3 affected
    • currently fixed but linked to a device in SQS

DA:

  • nothing major

EEE:

  • PLC colleagues are working on CR and support requests
  • pulling cables for SQS and SCS
  • reported to XO uTCA in XTD1
    • remote reboot planned for Friday, reserve ZZ slot for Friday

VAC:

  • repair of XTD2 solid attenuator ongoing

XPD:

  • FD @ SA2

DET:

  • nothing to report

ITDM:

  • nothing to report
  • next Monday GPFS update will take place

XRO:

  • mirror calibration started in SA2
    • beam path through offset mirros not visible -> no beam on M3 pop in, but visible on M2 pop in MCP in beam?
    • JG: no MCP in beam, how about PBLM?
    • LS: no PBLM in beam
    •  

LAS:

  • Sync issue from Monday cannot be replicated by Sebastian -->
  • tests for SPB happening tomorrow

UNSYS: 

  • circular polratizaton lasing achievd in APPLE-X in left and right hand polarization, also linear horizontal and vertical and 45° measured at 900 and 700 eV
    • thanks to UNSYS and DESY APPLE-X comm team.

SPB/SFX:

  • no major

FXE:

  • nothing to add

MID:

  • all fine

HED:

  • nothing to report

SCS:

  • reservation of nodes for jupyter hub.
    • requested during drc hour fix to reserve 3 nodes
      • didn't work out
    • is it possible to reserve 3 nodes by default?
  • Olivier reports there was a misunderstanding and it got fixed very quickly
  • Janusz reports that by standard 4 nodes are reserved for each experiment.

SQS:

  • nothing to report

 

ELOG V3.1.4-7c3fd00