Group Responsible: Service & Tools

Affected Area: BNLBox

Maintenance Type: scheduled downtime

BNLBox will be unavailable starting at 11:00 AM EST on December 30, 2025, due to scheduled maintenance. During this time, the service will be inaccessible. Users should complete any work before the maintenance window begins. Normal operations are expected to resume once maintenance is complete, on or before 5:00 PM EST on December 30, 2025. Users may resume usage at that time. Thank you for your patience during this scheduled downtime.

Group Responsible: IT Fabric

Affected Area: b725 Network and Tape rooms

Maintenance Type: transparent

FandO is performing inspection and remediation work on PDU3A4 feeding the Network and Tape rooms in the b725 datacenter today ~9:30am-3pm. All equipment is powered redundantly from another PDU, no outage is expected, but systems will be in a more at-risk state than normal.

Group Responsible: Service & Tools

Affected Area: SCDF Mattermost

Maintenance Type: service interruption

SCDF Mattermost service has been updated and service has resumed, thank you for your patience. If there are any issues please report problems by opening an RT ticket in the Software queue 'RT-RACF-Software@bnl.gov'

Group Responsible: Service & Tools

Affected Area: SCDF Mattermost

Maintenance Type: service interruption

An emergency update needs to be applied to the SCDF Mattermost service, users should not experience any interruption to usage, however if there is an issue the service will be down temporarily. This update will fix an issue where users are unable to retrieve group messages using the '+' button from the sidebar and will update the webui. Apologies for the interruption and thank you for your patience.

Group Responsible: Service & Tools

Affected Area: SCDF Mattermost

Maintenance Type: scheduled downtime

At this time the SCDF Mattermost service scheduled maintenance has completed and service has resumed. Users should now be able to use the service, you may be prompted to log in again if you were in the middle of a session. If there are any issues please open an RT ticket in the Software queue 'RT-RACF-Software@bnl.gov' and thank you again for your patience.

Group Responsible: Service & Tools

Affected Area: SCDF Mattermost

Maintenance Type: scheduled downtime

A planned maintenance of the SCDF Mattermost will be performed today, 12/01/2025, between 5-6pm EST. The service will be unavailable during this time and following the restoration of the service users may begin using it normally. Thank you for your patience during this scheduled outage.

Group Responsible: IT Fabric

Affected Area: sPHENIX and shared pool HTC Farm condor worker nodes

Maintenance Type: service interruption

FandO reported PDU1A3 is back up to 187F, but on the connections for all 3 phases this time. SCDF is shedding load from row 103 by draining jobs and powering off idle nodes to get to a stable safe state for the long holiday weekend. This only impacts sPHENIX and shared pool condor users/experiments.

Group Responsible: IT Services

Affected Area: OpenShift Virtual Enviroment

Maintenance Type: service interruption

An upgrade was begun today on OpenShift. Though we were informed that it would be transparent to all, we have found that some network interruptions are occurring. The upgrade cannot be interrupted once it has started. The Main servers have completed, and we do not expect any further interruptions. However, there is a possibility of further interruption to services as the upgrade proceeds.

Group Responsible: IT Services

Affected Area: SCDF Services

Maintenance Type: Unknown

The SDCC recently unveiled its new website http://www.sdcc.bnl.gov that serves as the entry point to facility services and support. In addition, we have created a public MatterMost channel for feedback and recommendations on the new website. Users are welcome to join this channel (see link below) and participate.\n\nhttps://chat.sdcc.bnl.gov/bnl/channels/sdcc-website-feedback\n\nPlease note that this channel is not meant to be used for support issues (broken links, missing documentation, request for changes, etc). Support requests must be made through the RT ticket system (go to http://www.sdcc.bnl.gov and select 'Get Help')

Group Responsible: Network

Affected Area: SCDF Services

Maintenance Type: Unknown

Hi all,\n\nThe clusters are back to normal operations starting 12:30 pm.\n\nThe system affected were IC cluster, Skylake cluster and the volta cluster.\n\nRegards,\nCostin

Group Responsible: Services & Tools

Affected Area: SCDF Communications

Maintenance Type: service interruption

This is just testing the db write

Group Responsible: Services & Tools

Affected Area: Star GPFS

Maintenance Type: Unknown

Access to Star GPFS (gpfs/gpfs01) has been restored. End Date/Time: 2/12/2024 10:01 pm Expected Impact: access is available

Group Responsible: IT Services

Affected Area: Star GPFS

Maintenance Type: Scheduled Downtime

The Star GPFS File System experienced serious errors over the weekend and is currently Offline. We have opened a ticket with the Vendor and are working to get this resolved. Will send updates as available. End Date/Time: 2/13/2024 7:27 am Expected Impact: access is unavailable until issue is resolved

Group Responsible: Experimental Support

Affected Area: US ATLAS dCache storage service

Maintenance Type: Service Interruption

The US ATLAS storage system is scheduled for an upgrade to the latest software release, dCache 9.2. Consequently, this maintenance process will result in a temporary interruption of accessibility to the storage system from 9:00 AM to 1:00 PM (EST) on January 22, 2024. We apologize in advance for any inconvenience this work may cause. End Date/Time: 1/22/2024 1:00 pm Expected Impact: US ATLAS dCache storage service interruption

Group Responsible: IT Fabric

Affected Area: EIC Lustre

Maintenance Type: Scheduled Downtime

eicoss02.sdcc.bnl.local is back online after outage. End Date/Time: 1/5/2024 5:15 pm Expected Impact: Lustre file system for EIC won't be available.