​​​​​On all PCs in the control rooms including BKR and also on the exflgateway there is a new version of jddd installed which is working with openjdk-11.
It is worth to mention that the old javaws from old oracle java 8 is deprecated and it is not recommended running jddd panels using old way, like
javaws jddd-run.jnlp

The recommended way, is to run it on the control PC (if you are in the control room), you don't need to login to exflgateway and start it there anymore, although this is also possible.

To start a svn repository selection window just run
jddd-run

To start a panel of a given name from http repository just type for instance
jddd-run -http XFELMainTaskbar.xml

To start a panel from svn repository just type for instance
jddd-run -file XFELMainTaskbar.xml
 

In case of question contact it-support@xfel.eu

Best

Janusz

Currently EuXFEL enforces a hand-off policy for instrument/tunnel hardware. That includes remote control of motors, pumps, etc.. as well as changing config Files. If and when this policy is lifted will be communicated during Dispatch and Technical Integration Meetings. Please also don't hesitate and contact XO in case of any questions.

SPB:

• reached safe state
• rougning pumps still runnning and valves open
• PLCs need to run for monitoring

FXE:

• n

MID:

• absolutely safe
• cooling water connection
• PLCs switched off

SCS:

• S

 EEE:

• MID switched off completely, all other PLCs are running
• MID utca also shut down
• Jörn, plenty of time for additional planning

CTRL:

• broker logs ok from last weekend
• ICI contacts are in discussion instruments

ITDM:

• while instrument schutdown, network and servers are still running

HED:

• safe state, all motors switched off ( parameters saved) all valves close, ion pumps are stil running.

DA:

• work to do

XRO:

• M1s parked on Friday, tunnel seems ok, lenses seem to be fine
• small problems in the GUI,

XPD:

• x-ray diagnostics had been secured last week, i.e. power ramped down. XGM vaccum needed.

FXE:

• Jungfrau chiller switched on, AMPHOS shutter chiller
• OGT3 no pump cart, ion pumps still running, gate valves closed

VAC:

• V0 closed, OCD looking at vacuum twice a day, PLCs needed and running

SPB:

• AGIPD improvement campaign great success
• EEE --> 2nd C&C worked just fine

FXE:

• BTM tests successful
• Johann MDL motors should be in closed loop
• JF CTRL device crashed

MID:

• AGIPD Flat Fields done
• Data Correction pipeline was down --> 1 day lost
• PPLaser comm this week
• extrafoam issues

SCS:

• nothing to report

 EEE:

• updates for SDL (MID)
• fastADC issue --> don't take more than 40k samples; bugfix in progress

CTRL:

• 8 OCD events
  • mostly deployment isues
  • FXE DA3 overload
  • old version of scantool @ SCS

 XPD:

• unusual behaviour of beam pos measured with XGM
  • cross check done yesterday

ITDM:

• DA crashes --> being investigated

HED:

• tecnosoft terminal issue
  • motor ran into Ty limit (CCW) and got stuck due to tecnosoft logic

SPB:

• nothing to report

FXE:

• MC2 library motor commissioning on-going

MID:

• SDL motor parameters defined, however one crate is blocked by Wille and 6 motor connectors (Harting material) are still missing
  once fixed, motor paramaters can be uploaded
• WCB (wall connection boxes) in otics hutch are partially finished

HED:

• Wille is working on some crates and the respective Beckhoff loops are down for the moment
• loop updates from Tuesday on

 EEE:

• additional limit switched for XTD6 CRLs (MID) are being installed
• HED is asking for limit switches on their XTD6 CRLs as well --> EEE and HED will investigate when and how
• cable change in FXE starts this week with exchaging wrongly poled SHV cables

CTRL:

• nothing to report

VAC:

• nothing to report

XRO:

• nothing to report

SPB:

• Testing coordinated movement of Mirror motors with the MC2 lib on lemo drives
• optics hutch vented accidentally vented but root cause is understood and vacuum had been reestablished

FXE:

• XTD2 CRLs have encoder problems --> cables damaged --> repair strategy is being evaluated with EEE

MID:

• SDL should enter the hutch by the end of January

SCS:

• pulse (train) picker to be installed in the tunnel by the end of this week

 EEE:

• FXE had been migrated to MC2 lib
  • motors need to be recalibrated
• XTD6 motion part is to be migrated to MC2 lib
• SQS gets interlock updates

CTRL:

• busy with tunnel, additional support for XPD (imagers motion components)

SPB:

• nothing to report

FXE:

• not present due to group retreat

MID:

• Mono done, no severe issues from commissioning weekend

SCS:

• not present

 EEE:

• SQS pnCCD cables have been installed, waiting for crate to connect

CTRL:

• two minor OCD call and one regarding AGIPD
  • SPB not aware that no support was scheduled for AGIPD

 XRO:

• piezo karabo device and firmware in HED mono need to be checked for compatibility

ITDM:

• 2 calls
  • derver down and restarted
  • data aggregator down and restarted
• new RunConfig delpoyed at FXE

DA:

• jupyterhub @SCS showing performance issues --> investigated by DA

* Users are scheduled to be here this week (4 beamlines in user runs). SPB, HED, MID report several users have cancelled the travel. Beamlines are making mitigation plans 
to run experiments.

FXE:
- Setting up and working with detectors; Working with 4-bounds MONO; Von-Amos detector working;
- Jumps of beam position have been observed and have to be evaluated;
- Jungfrau detector crashed and DET was contacted;

SPB:
- Smooth run after new tuned up on Tuesday;
- Jump on beam position comes from mirrors;
- It was observed a change of number of bunches on Tuesday night: from 2 to 30 for example; XO comment: This time should be not considered as regular beam delivery and 
only parasitic use. Nevertheless, better information on what kind of changes the machine may perform during the shift can help for the future use of parasitic beam.
- AGIPB was successful; also preparation for users; Mitigated troubles with missing user;

SCS:
- Not present

SQS:
- Not present

HED:
- Solving issues with motors together with EEE last week;
- Hexapod vacuum feedthrough: missing flange has to be borrowed from another group  - still to be found;

MID:
- The Pump-probe laser test last week was very successful;
- Re-start of some devices was needed;
- For this week: reduction of user group from 11 to only 3 visitors. Beamtime is a continuation from last year's interrupted time due to the power outage. Local staff is 
mitigating missing users;

EEE:
- Nothing to report

CTRL:
- Nothing to report

ITDM: 
- Not present

VAC:
- Gas attenuator in SQS: not above 10.2 mbar - in investigation. A stress test has to be made and shall be agreed with BKR;

DET:
- Not present

LAS:
- Not present

XPD:
- Not present

FXE:
Nothing to report: no issues;

MID:
Delay line pumping down; Connecting all devices in preparation to be ready for Friday;

EEE:
Finishing SQS interlock scenes and SPB loops;
ELMO parameters lost themselves (in connection to XRO/Maurizio request). Parameters to be checked this week and next shutdown;
XPD ticket to be checked;
Cabling shall be started for SQS/SCS: waiting for open hutch;

CTRL:
Ticket from XPD (shared EEE/CTRL): dry run did not work at BKR: missing pieces. 
Please instruments check the systems during the day prior Friday when the Test Run starts;
Request from CTRL/Chris: Define guidelines for the users/support on the ticketing and e-log (who has responsibilities to check devices?).

ITDM: 
Ticked from XPD/Liuba: it is a ticket with link (?) to E-log.


* Mc2 motors: XRO needs a list of all motors in order to check configurations. Example: SA3 MONO pre-mirrors with torque set to zero; SA3 exit 
slits with wrong settings.

* CTRL reminds the instruments to check devices during working hours prior Friday when the Test Run starts with beam delivery.

CTRL:
- It was remotely observed that some cameras were consuming too much memory. By remotely re-starting these devices the issue was solved.  
- No calls to the OCD during the weekend.

EEE:
- No issues to report;
- Planning a meeting with Instruments/CTRL/DA to discuss long term tasks that have been working on during this reduced operation period.

VAC:
- Nothing to report; All running in good state.

XPD:
- Nothing to report.

DET:
- Nothing to report.

ITDM:
- Nothing to report.

XRO:
- After the recent power glitch: XRO has checked the basic parameters of special motors which presented problems in the past associated to power glitches;
- At this time, the main basic parameters remain OK (note that only few devices were checked - the ones which presented problems in the past);
- During the EuXFEL restart a deeper look on all devices has to be taken together with the instruments. 

SPB:
- Nothing to report.

FXE:
- Nothing to report.

MID:
- Nothing to report.

HED:
- Nothing to report.

	 

FXE: no issues

SPB: no issues

MID: Split & Delay line arriving on Friday, MID aims for a quick integration into instrument / beamline
         EEE informed to switch Hexapod motors from loop3 to loop 7

HED: changing loop1 (JJ X-ray motors) from open to closed loop operation

SQS: KB works, see sometimes spontaneous switching of end switch logics

EEE: MID, SPB, VAC loop updates running this week;
         no triggers for experiments available until end of power off work
         Jörn: cabling for MID is in full swing, for future installations first check phase 1 cabling, for non blocking
                                   HED: cabling
                                   SCS company Witte 30 ccables
                                   FXE: two CRDs not approved yet, no cabling during this shutdown

Controls:
 

General Announcement:

• Default beam positions are being implemented for each SASE at the FEL imager to reduce re-alignment offers for the instrumetns after shutdowns and facility development weeks

CTRL:

• minor OCD calls
  • 6541, 6542
• few MC2 motors not working -> target velocity was set to 0
• in SA1 the bunch pattern changes @10 Hz --> data logging system (with timers) gets overloaded ...
  • if this was to become a normal mode of operation, the system would need to be adpated --> as for now bunch pattterns are not logged anymore
• remote user access to karabo
  • soo to be tested with SQS
• inlfuxDB
  • FXE 95% migrated, probably 100% at the end of the day
  • LAS SA1 100% migrated
  • MID, SCS shall reply when migration is possible (causes a short down time of datalogging)
  • SPB, HED shall reply s.a.

DA:

• nothing to report

EEE:

• issue with encoders in SPB --> some errors had been disabled --> checks for cable lengths (OCD call)
• SQS interloop comunication working? EEE, yes, need to investigate
• N. Jardon reminds about the default parameter procedure
• pre shutter in SA3 works commence when Zunaira, Martin and Maurizio

VAC:

• nothing to report

XPD:

• intervention Monday in SA3, PES is operational

DET:

• no issues

ITDM: 

• last week new DAQ deplyoed in HED, FXE and SPB and tunnels, the three other instruments had been delayed
  • MID today, SQS yesterday
• scratch space in gpfs --> running out of space --> data needs to be removed
  • procedure not yet agreed upon
  • all involved parties should identify data that can be removed from scratch
  • 100 TB are left
• internal proposals for commissioning time needed
  • in the future please prepare those in advance

XRO:

• during the weekend, XRO was recommissioning of the beam transport
  • some qctivities were completed on Tuesday, M3 repositioned from damaged spot
  • recommissioning is completed --> however small problems are to be expected over the frst few days, please contact XRO

LAS:

• no issues

UNSYS: 

• cell 33 in SA2 communication crippled, ZZ planned for next monday

SPB:

• reasonably succesful first night with beam, instrument aligned with alignment laser
• tunnel EPS system --> the FXE_XTD9_popin blocked SPB to 1 pulse
  • MPS signals from SPB might be masked by the machine -> needs to be checked
• 1 OCD call to EEE
• dMigration to influxDB can be done

FXE:

• re align beam to FXE pop in
• mono re alignment
• issue with FastValva --> naming convention on the PLC level had been changed, now only capital letters are allowed --> Bernard is looking into this
• tunnel project using step function with motors throws an error on the slot
  • CTRL is workig on a fix already, it happens for very small steps
  • J. Nardon: was also reported by SQS
• all TView devices had to be restarted as they were out of sync

MID:

• alignment went smooth, until diagnostic endstation
  • data loggers are fine today to migrate to influxDB
    • Steffen aims at afternoon
• pre shutter
  • for CRL2 not possible to laign as the pre shutter always moved in
    • XRO looks into it

HED:

• beamline aligned
  • beam profile excellent in fornt of hutch
    • spatial jitter present, and horizontal movement
  • mirror feedback macro not working
• XGM investigation together twith Theo
• IPM didodes are not read out --> comment by Peter, check the timers
•  

SCS:

• no issues

SQS:

• beam from around noon, beamline aligned, set points on imagers need to be re found

Currently EuXFEL enforces a hand-off policy for instrument/tunnel hardware. That includes remote control of motors, pumps, etc.. as well as changing config files. If and when this policy is lifted will be communicated during Dispatch and Technical Integration Meetings. Please also don't hesitate and contact XO in case of any questions.

SPB:

• instrument is fine in safe state.
• anyone having a VAC monitoring script connected to an SMS service?
  • SH: comments that CTRL is working on that on a more general scope, but that needs a bit more time

FXE:

• JungFrau checked and powered down.

MID:

• everything is in a safe state.
  • Martin D. reported a VAC issue --> gonna be clarified
    • MD reports a spike in the VAC which might indicate a leak in a bellow

SCS:

• VAC interlock closed
• eplans for hRIXs electronics
• MT wrote a rudimentary webservice for monitoring karabo stuff via a webbrowser --> not to be used until sanctioned by CTRL

 EEE:

• general remark: EEE provides two key systems: utca, and PLCs
  • currently only PLCs for critical systems are covered by OCDs
  • however all other PLCs are kept running, but not necessarily fixed on-site
  • utca not critical --> thus no OCD for that

CTRL:

• all systems running
  • limitations on karabo in the control network as stated in MB message --> finding out what that means for work on CTRL topics

ITDM:

• everything working, dropbox for urgently needed IT equipment available

HED:

• working on scenes / projects, recombining and cleaning up.

DA:

• not present

XRO:

• tunnel components secured, something on CRLs to be clarified with VAC

XPD:

• everything is fine

VAC:

• VAC in tunnel is stable
• new software for vacuum pump carts developed and being rolled out

SPB:

• interument parked
• power cut --> someon needs to come in
• NJ: what'S that status of the VAC
• KC & RB: safe state, roughing system still running, in the event of a power cut this needs to be looked at

FXE:

• nothing to report
• NJ: VAC in safe state? --> MK yes everything is switched off

MID:

• instrument parked, VAC is running but pumps will be stopped today and partially vented
  • gate valves are closed hopefully the VAC stays

SCS:

• SCS in safe state, all pumps running
• valves around KB are permenantly closed
• in the event of a power cut all other gate valves will close
• loop update done yesterday

 EEE:

• preparation for safe state ongoing
  • discussed

CTRL:

• is master timing going away or not?
• if master timing goes down, some devices
• ICI contacts identify what can be remotely done and what not

• u

ITDM:

• nothing special

HED:

• HED is going to sleep within the next two days

DA:

• focus on long standing tasks

XRO:

• beam transport is going to be parked today

CTRL:

• notificagion service device going to be tested this week
  • ITDM: SMS part is operational but needs to be implemented

EEE:

• shutdown task list to be submitted today

VAC:

• no one present

XPD:

• shutdown task list submitted

DET:

• nothing to report

ITDM:

• nothing to report
•  

XRO:

• nothin to report

SPB:

• VAC i

LAS

• w

FXE:

• shutdown list

MID:

• shutdown list
• Jörg and Jörn (EEE) align for shutdown task list

HED:

• aligning with Jörn (EEE) on shutdown taks

SCS

• working on shutdown list

DA:

CTRL:

• no bigger issues
• announcement: inital simulation environment ready which can simulate BECKHOFF devices
  • shall be opened to all groups for karabo development

EEE:

• continue work
  • shutdown task deadline may be too early
• if people have CRs CRDs, cable issues please submit

VAC:

• water pumps

XPD:

• nothing to report

DET:

ITDM:

XRO:

• nothing

SPB:

• nothing to report

LAS

• waiting for karabo policy

FXE:

• nothing to report

MID:

• nothing to report
• two weeks deadline extensions like EEE, DET

HED:

• nothing to report

SCS

• shutdown list week extension

DA:

CTRL:

• productive meeting with HED
  • CTRL will ask the other instruments if a similar concept could be agreed upon
• discussion with LAS this afternoon with respect to the current hardware policy

EEE:

• HED provided tasks that EEE shall do
• uTCA development ongoing
  • review how digitizers are being used (fastADC, SPdevices, clock & Control)

VAC:

• power glitch

XPD:

• nothing to report

DET:

ITDM:

• nothing to report, no indication of power glitch

XRO:

• no indication of power glitch

SPB:

• nothing to report

FXE:

• nothing to report, problem to read out pressure values
  • Bernd Baranasic: no ion pressure readings on OGT1
    • in PLC it looks ok, but karabo shows 0
  •  

MID:

• meeting with DESY safety colleagues wrt PUMA, going to be bundled with LDM safety
• discussing with Bruno about digitizers
•  

HED:

• see CTRL

SCS

• only valves in loop1 were closed
• every few days a pump is failing, new behaviour
  • JG: comments it is a known behaviour that one of the gauges showed an erratic behaviour (wrongly set epsilon in karabo)
  • GM: answers, what happened on Saturday was slighty different

DA:

FXE

• No major issues - PLCs update has been started by EEE (BB)

SCS

• Hrixs and related components will be delivered on 13 and 14.01.2020. SCS is coordinating the works with TS in order to crane the chambers into the hall (collision with the scaffolding required for HED dipole laser)
• Puls picker update in XTD10. Requires update of loops. EEE is not informed. JTD follows the issue up.

EEE

• General work is ongoing.
• Next week the EPS loops will be updated in the framework of the full beam operation project.
• Issue with a PLC in SPB crashing after update to Win10. Beckhoff is working to a solution. If this does no work the PLC will be replaced.

Controls

• A mail will be sent out early next week to announce th deployment schedule of the new Karabo release.

​FXE

• Radiation tests ongoing.
• EEE informs that the PLC drawings will be exchanged in the WS

SPB/SFX

​SCS

SQS

​MID

HED

• During the first week of shutdown (KW47) the loop1 devices will be put into closed loop (e.g. for backlash compensation).
• An electrical shutdown seems to be necessary to upgrade the protection against the power glitches, especially to protect the optical lasers. This is now planned for the 17/18.19 for SASE2 and similar dates for SASE1 and 3. AV will try to collect more information and come back to the instruments ans technical groups.

Optical lasers

VAC

XRO

​XPD

​DET

​EEE

• EEE needs the updated interlock definitions from VAC
• The list of requested services during the WS is very long. NJ is trying to plan the works inside EEE and will come back to XO/PMO in case priorities have to be assigned. Also, late requests and changes are making things more difficult.

​Controls

• The overnight and weekend OCD service will stop during the shutdown. OCD only available until 18:00
• Karabo 2.7.0 deployment date (now forseen for KW51) is being verified. More info to come.

​ITDM

SRP

TS

AoB

SPB/SFX

• Digitizers are ready, have been tested by CAS ==> to be be installed / integrated probably next week ==> according to Adrian probably Monday, to be confirmed with AE (Bruno + Hamed) ==> is confirmed to be today
• Different GUIs were reporting varying values for STATUS on different clients / machines ==> ARound will make sure a proper description of the issue (which machines, which clients, when, ...) will be brought to the attention of the proper people @ CAS. ==> CAS is aware. ==> CAS has a suspect.
• There appears to be an issue with recorded / stored values vs. values shown in the client of motors moving. CAS shall receive a proper + detailed description of the issue.

FXE

• Tool to save motor positions is not working reliably. ==> CAS + AE have different tools on different levels. There is not automatic / global restoring of for example motor positions from the CAS-side available. BUT in the shutdown motor position should not be lost, unless there is a true power outage also affecting the CPUs.
• Problems with the PP-laser have been reported.

​SQS

SCS

MID

• Request to have the same kind of feedback as implemented at FXE ==> will require HW changes, to be done during the summer shutdown, and work by CAS in order to adapt the procedure from FXE.

HED

• According to KS the Smaract-stages are to be checked with AE
• Interlock definitions would be needed by Wednesday ==> MS is on it.
• Last weeks issues regarding the epix were probably caused by the DAQ.

​OPT Lasers

​​XRO

XPD

VAC

DET

• The DSSC underwent successful readout test, more DAQ-test to come.
• The pnCCD saw first visible light, working now on the delay / timing.

​​AE

ITDM

​EET

CAS

• A Hotfix 2.4.2 is provided by CAS, which should fix some issues related to the XGM.

SRP

TS

AoB