@gwmngilfen:fedora.im
=====================

2025-12-09 09:40:00
- 3 hours debugging issues with old data-analysis code for an Ansible colleague 😕 
- took rdu2 proxies out of DNS
- shutdown servers in RDU2
- deployed change to copr hosts to fix external access to zabbix
- we can use this for other external hosts too

2025-12-05 10:36:00
- - Deployed rabbitmq zabbix template
- planned datagrepper monitoring

2025-12-04 10:31:00
- Firmware docs [written](https://docs.fedoraproject.org/en-US/infra/howtos/idrac-firmware-update/#_using_the_firmware_proxy_in_rdu3)
- Too many meetings
- some internal admin (holiday leave booked etc)

2025-12-03 11:01:00
- CentOS Zabbix PSQL pr deployed to stg
- took longer than i expected to get the psql   ->  csv -> zabbix handling right though
- discussed whats needed for final zabbix approval with nirik
- other meetings

2025-12-02 10:16:00
- yesterday public holiday
- Fri:
- posted zabbix postgres PR
- worked on rabbitmq Fedora patch


@arrfab:fedora.im
=================

2025-12-09 10:02:00
- still investigating https://gitlab.com/CentOS/infra/tracker/-/issues/1820
- Prepared all the moving hardware for rdu3 (https://gitlab.com/CentOS/infra/tracker/-/issues/1815)
- setup vpn ci tunnel (https://gitlab.com/CentOS/infra/tracker/-/issues/1816)

2025-12-08 08:06:00
- Added el10 nmconnection style setup for kvm-host and bridge+vlan interfaces (ansible kvm-host role)
- Meeting about DC move 
- Investigating the postgresql issue on cbs.centos.org (https://gitlab.com/CentOS/infra/tracker/-/issues/1820)
- Started to work on CI Vlan in RDU3 (machines will arrive soon)

2025-12-04 10:07:00
- Prepared some machine/hardware to be ready for dc-move (https://gitlab.com/CentOS/infra/tracker/-/issues/1815)
- Massively modified the hyperscale build tags for epel-rpm-macros dep if using epel as external repository (https://gitlab.com/CentOS/infra/tracker/-/issues/1821)
- Still investigating the "stuck" task on cbs.centos.org and if that's rhel9/httpd related (https://gitlab.com/CentOS/infra/tracker/-/issues/1820)
- Prepared new sprint

2025-12-03 12:26:00
- Starting to work on hardware prep for dc-move operation (https://gitlab.com/CentOS/infra/tracker/-/issues/1815)
- Still investigating (upgraded koji) CBS tagBuild issues (https://gitlab.com/CentOS/infra/tracker/-/issues/1820)

2025-12-02 12:52:00
- Worked on CentOS Stream for calligrabot signing queue
- Continuing hardware decom for rdu2


@zlopez:fedora.im
=================

2025-12-09 12:26:00
- Helping Greg with rdu-cc migration
- Dentist appointment in the morning
- Investigate the bodhi staging messaging queue ([ticket](https://pagure.io/fedora-infrastructure/issue/12932))

2025-12-08 11:35:00
- Resolve very big fedora messaging queue on staging bodhi (I had to add more resources to db01.stg, but the queue is getting processed now)
- Fix release-monitoring.org check (check is running again now)

2025-12-05 09:17:00
- Fix koschei - watcher pod in staging OpenShift ([ticket](https://pagure.io/fedora-infrastructure/issue/12909))
- Update ipsilon01 to Fedora 43
- Fix resultsdb-ci-listener pod in staging OpenShift ([ticket](https://pagure.io/fedora-infrastructure/issue/12909))

2025-12-04 09:03:00
- release-monitoring.org: Fix [sphinx9 update](https://github.com/fedora-infra/anitya/pull/1985) on anitya
- release-monitoring.org: Fix [sphinx9 update](https://github.com/fedora-infra/the-new-hotness/pull/618) on the-new-hotness
- release-monitoring.org: Fix [sphinx9 update](https://github.com/fedora-infra/the-new-hotness-messages/pull/78) on the-new-hotness-messages
- Compliance & Ethics training
- Check production OpenShift for failing pods

2025-12-03 09:02:00
- I&R weekly report
- Fix jira_sync failing
- Process PDR request
- release-monitoring.org: Review Anitya [PR](https://github.com/fedora-infra/anitya/pull/1981)
- release-monitoring.org: Fix [sphinx9 update](https://github.com/fedora-infra/anitya-messages/pull/78) on anitya-messages

2025-12-02 10:45:00
- Deal with AI scrapers on pagure.io
- Review community [blog post](https://discussion.fedoraproject.org/t/review-publish-test-day-2025-12-02-freeipa-webui-test-day/175338)
- Fix jira_sync recreating issues for forge.fedoraproject.org


@patrikp:matrix.org
===================

2025-12-08 08:53:00
- `pungi-fedora` repo is successfully migrated to the new forge.
- Some ops tickets.
- Meetings.

2025-12-03 15:40:00
- Took care of various BAU tickets.
- Investigation of `pungi-fedora` migration is complete and PRs are prepared.


@amedvede:fedora.im
===================


@nirik:matrix.scrye.com
=======================

2025-12-08 17:36:00
- * Datacenter move sync - 2025-12-05 8am
* Looking at proxy alerts, started crond and synced some things.
* adjusted some group permissions ( https://pagure.io/fedora-infrastructure/issue/12962 )
* Some minor updates for compose tracker doc ( https://pagure.io/infra-docs-fpo/pull-request/444 )
* Helped jflory7 with ssh key on people01
* Resumed failed updates composes on bodhi-backend01
* Build python-nss in f43-infra koji tag for bodhi backend upgrades.
* Canceled some openjdk scratch builds that were clogging up s390x builders.
* Pushed allowlist for anubis for productmd user-agent
* Build calibre 8.16.1 for rawhide.
* Replied to everyone in the scrapers discussion thread. ( https://discussion.fedoraproject.org/t/scrapers-and-ideas-for-how-to-deal-with-them/175760/15 )
* Upgraded bodhi to F43 and 25.11.2 ( https://pagure.io/fedora-infra/ansible/pull-request/2976 )
* Looked at copr ipv6 issues. Seems like things are in a weird state. rebooted 02.
* scraper hitting src.fp.o. Blocked /blame/ and /history/ endpoints and tweaked things.
* Fixed koji_sync_listener ( https://forge.fedoraproject.org/releng/tickets/issues/13122 )
* docs: content hosting sop updates ( https://pagure.io/infra-docs-fpo/pull-request/445 )
* docs: database sop: https://pagure.io/infra-docs-fpo/pull-request/446

2025-12-05 18:34:00
- * Fixed a few post migration issues on pagure.io (selinux release upload/ssh outgoing mirror)
* collectd sop doc update ( https://pagure.io/infra-docs-fpo/pull-request/443 )
* Fedora Infrastructure meeting - 2025-12-04 9am
* Bunch of internal stuff to adjust s390x and pagure.io firewalls to fix issues.
* 1x1 with mattdm - 2025-12-04 11am
* tombstoned old cle matrix room
* Shut down old libravatar instance ( infra 12780 )
* matrix MAS outage. Filed ticket, created pr for changes ( https://pagure.io/fedora-infra/ansible/pull-request/2995 ), updated status, sent announcements to lists.
* Infra and Releng daily - 2025-12-04 noon
* Merged website cleanup phase 2 pr ( https://pagure.io/fedora-infra/ansible/pull-request/2962 )
* Removed osci-pipelines-queue-12 rabbitmq queue again
* Pushed some nagios changes to prevent bogus alerts
* Yearly Ethics training stuff
* Doubled cpus on pkgs01

2025-12-04 19:44:00
- * 1x1 with Fabian - 2025-12-03 8am
* bugzilla2fedmg sop updates ( https://pagure.io/infra-docs-fpo/pull-request/442 )
* Setup os-control to allow sysadmin-openshift access/sudo ( https://pagure.io/fedora-infra/ansible/c/900a06c04903ea96b19779b81cb641bc92105d65?branch=main )
* EPEL meeting - 2025-12-03 10am
* 1x1 with ashcrow - 2025-12-03 10:30am
* Added some kernel.org mirrors to acls ( https://pagure.io/fedora-infrastructure/issue/12941 )
* Allowlisted /extras for src in anubis ( https://pagure.io/fedora-infrastructure/issue/12949 )
* Infra and Releng daily - 2025-12-03 - noon
* pagure.io migration - 2025-12-03 - 1pm

2025-12-03 18:14:00
- Fought scrapers... ended in a draw I think. :(
- Migrated stg.pagure.io to rdu3, retired old pagure-stg01
- december docs: updated dns sop: https://pagure.io/infra-docs-fpo/pull-request/440
- Some matrix moderation setup
- Some ticket catchup, more to come


@jnsamyak:matrix.org
====================

2025-11-30 08:05:00
- Last week was a partial week off, but the weekend turned out to be quite hectic with multiple releng fires and discussions:
- Dealt with multiple Robosignatory issues, including signing delays and configuration verification.
- Participated in EOL (End of Life) discussions and related cleanup follow-ups.
- Debugged a corrupt RPM issue that was impacting compose completion.
-Investigated and helped with Bodhi compose failures for Fedora 41 ensured fixes.

Monday:
- Had a RelEng update call with Patrik to discuss this week’s goals and priorities, especially around migration progress and ongoing cleanup tasks.
- Participated in the Release Engineering sprint call, and created the Sprint 6 board to track all ongoing and upcoming work items.
- Continued to deal with migration blockers, EOL follow-ups, and routine releng ops tasks (pushes, build tracking, and compose checks).
- Started looking into Forgejo Actions integration as a potential replacement for Zuul, evaluating its feasibility and how it fits into the Fedora infrastructure workflow.