@zlopez:fedora.im ================= 2026-01-13 09:11:00 - Process PDR request ([ticket](https://pagure.io/fedora-pdr/issue/337)) - Resolve permission denied on flatpak indexer PV ([ticket](https://pagure.io/fedora-infrastructure/issue/12909)) - still didn't fixed, but spent most of the day on it yesterday - Find the correct number of consumers on staging bodhi ([ticket](https://pagure.io/fedora-infrastructure/issue/12932)) 2026-01-14 08:39:00 - Help rcalwoo with jira filter - Look at the ipa backups ([ticket](https://pagure.io/fedora-infrastructure/issue/12992)) - I&R weekly report - Set languages project replica to 0 ([ticket](https://pagure.io/fedora-infrastructure/issue/12998)) 2026-01-15 09:04:00 - Look at proxy05 - Couldn't do much about it as it's a sponsored machine - Look at the IPA backups ([ticket](https://pagure.io/fedora-infrastructure/issue/12992)) - I spent part of the day to try to reduce size of LDAP db without luck, will reach to IPA folks regarding that - Process PDR request ([ticket](https://pagure.io/fedora-pdr/issue/338)) - [FAS] New Group Request: flock-team ([ticket](https://pagure.io/fedora-infrastructure/issue/13036)) - created the group, but matrix room and mail are still missing - [FAS] New Group Request: badges-team ([ticket](https://pagure.io/fedora-infrastructure/issue/13044)) - created the group, but matrix room and mail are still missing 2026-01-19 08:35:00 - Fixed IPA backups ([ticket](https://pagure.io/fedora-infrastructure/issue/12992)) - Process PDR request ([ticket](https://pagure.io/fedora-pdr/issue/339)) - Update bodhi staging ansible for correct number of consumers ([ticket](https://pagure.io/fedora-infrastructure/issue/12932)) - Review and publish community update blog post ([ticket](https://communityblog.fedoraproject.org/community-update-week-03-2026/)) - /etc/cron.daily/sync-http-logs-and-merge.sh on log01 errors ([ticket](https://pagure.io/fedora-infrastructure/issue/12833)) 2026-01-20 08:43:00 - Update python-datanommer-models package ([ticket](https://bugzilla.redhat.com/show_bug.cgi?id=2430361)) - Process PDR request ([ticket](https://pagure.io/fedora-pdr/issue/340)) - Fix mirrorlist-statistics cronjob ([ticket](https://pagure.io/fedora-infrastructure/issue/12993)) - Update python-datanommer-commands package ([ticket](https://bugzilla.redhat.com/show_bug.cgi?id=2430360)) - bodhi.stg queue rising again - had to adjust number of consumer to 15 to keep up - 500 when merging https://pagure.io/fedora-infra/ansible/pull-request/3052 ([ticket](https://pagure.io/fedora-infrastructure/issue/13060)) @arrfab:fedora.im ================= 2026-01-13 09:14:00 - Worked on openshift pv request for softwarefactory (https://gitlab.com/CentOS/infra/tracker/-/issues/1827) - worked on mirror request (https://gitlab.com/CentOS/infra/tracker/-/issues/1830) - closed ticket about automotive sig redirect request (https://gitlab.com/CentOS/infra/tracker/-/issues/1796) - various 1:1 2026-01-14 13:05:00 - discussion with Stream team about signing pkg to bump and rebuild+deploy - 1:1 with Greg about sprint planning to come - reported Docs SIG issue on their broken pipeline (and explained how to fix it) - closed ticket from softwarefactory about PV request in openshift CI env (https://gitlab.com/CentOS/infra/tracker/-/issues/1827) 2026-01-15 08:52:00 - helped IBM contributors for the openshift access for nfs-ganesha (https://gitlab.com/CentOS/infra/tracker/-/issues/1832 and https://gitlab.com/CentOS/infra/tracker/-/issues/1831) - plenty of discussions about dc-move for stream so still trying to find info - modified underlying EBS volume for debuginfod service (https://gitlab.com/CentOS/infra/tracker/-/issues/1834) - discussion around risc-v machines racking https://gitlab.com/CentOS/infra/tracker/-/issues/1797 2026-01-16 13:23:00 - Worked on blocked signing queue for stream, (https://issues.redhat.com/browse/CS-3038) and created MR to implement missing function needed for the calligrabot/robosignatory integration (https://gitlab.com/CentOS/common/calligrabot/-/merge_requests/3) - Fixed a rendering issue on docs.centos.org vhost, due to git submodules being changed upstream and so not pulling anymore (now all ok) - discussion about redundancy path for risc-v machines that are racked but waiting on network (lacp mode, to be configured - https://gitlab.com/CentOS/infra/tracker/-/issues/1797) - reprovisioned server with el10, setup iscsi in multipath mode (netapp) and ansible is now configuring the server (retrieving content) for new rdu3 internal mirror (https://gitlab.com/CentOS/infra/tracker/-/issues/1833) 2026-01-19 09:01:00 - renewed LetsEncrypt TLS certs for infra, but also adapted our automation script around it (https://gitlab.com/CentOS/infra/tracker/-/issues/1835) - Attended first CentOS SIG Council meeting (playing bridge between other SIGs and infra/technical advisor role) - follow-up on risc-v machine status (now racked, next : network access) - kicked the mirror script on new rdu3 internal mirror (https://gitlab.com/CentOS/infra/tracker/-/issues/1833) 2026-01-20 10:19:00 - Deployed and verified python-calligrabot bump on stream signing (https://issues.redhat.com/browse/CS-3038) all done now - Modified ACL for fedora mirror https://gitlab.com/CentOS/infra/tracker/-/issues/1837 - Added okd tags for Cloud SIG, all verified to be working (https://gitlab.com/CentOS/infra/tracker/-/issues/1838) @gwmngilfen:fedora.im ===================== 2026-01-13 11:08:00 - upgraded the psql max connections checks in CentOS zabbix (in stg) - new certs for messaging services (logging and zodbot) - sprint planning 2026-01-14 10:08:00 - Finish CentOS pgsql monitoring item - Starting using/understanding COPR to rebuild django-allauth - finished ethics & compliance 🎉 2026-01-15 10:26:00 - Nagios is down 1000 items 🙂 - new certs for api.ocp and api.ocp.stg - checked out the new docs repo from forge to add docs for api certs - mentee meeting & sprint planning 2026-01-19 10:15:00 - met with security folks about Stream ticket - removed more redundant checks from nagios - wrote api.ocp docs - 1:1s with ashcrow and others - investigated old certificate on getfedora.org - ran the whole proxy playbook just to be sure - logged 13051 to fix properly - forgot to send on Fri, so also: - work on Stream internal ticket - pushed api.ocp docs - logged those Dell tickets I missed on Wed 2026-01-20 11:28:00 - Stream ticket progress, had to get Networking involved - Helped Michal fix a db issue with Pagure - tricky little caching issue, ended up having to reboot it - broke, and then fixed the vpn on pagure01 and stg02 - finally restored access to storinator, handed off to Kevin - this took a while, fun saga @amedvede:fedora.im =================== 2026-01-13 08:54:00 - all meetings - fix few small ticket - pagure staging are able to send messages again 2026-01-15 13:18:00 - fix problems preventing mass rebuild - testing creation of Anitya project @patrikp:matrix.org =================== @nirik:matrix.scrye.com ======================= 2026-01-14 19:28:00 - * CLE weekly meeting - 2026-01-13 7:30am * FESCo meeting - 2026-01-13 9am * Fedora Infra daily meeting - 2026-01-13 noon * 1x1 with Greg - 2025-01-13 1pm * Fixed copr log01 issue ( https://pagure.io/fedora-infrastructure/issue/12947 ) * Merged pr for matrix msc2965 ( https://pagure.io/fedora-infra/ansible/pull-request/2995 ) * Merged pr for f44 mass rebuild signing ( https://pagure.io/fedora-infra/ansible/pull-request/3021 ) * Merged pr for br community site redirect ( https://pagure.io/fedora-infra/ansible/pull-request/3033) * Merged pr for anubis to allow jira sync ( https://pagure.io/fedora-infra/ansible/pull-request/3039 ) * Updated a number of other pr's with review comments. * Wrote up openshift api cert renewal info and sent to Greg * Tracked down a mail problem on rhel10 hosts (no bdb, use lmdb) * Updated communishift cluster to 4.20.8 from 4.19.21 2026-01-15 19:08:00 - * 1x1 with Fabian - 2026-01-14 8am * Dequeued bodhi update creation message from package with >100 char build * EPEL meeting - 2026-01-14 10am * 1x1 with ashcrow - 2026-01-14 10:30am * Removed proxy05 from dns, looked into access to it's mgmt at new provider * Infra daily triage - 2026-01-14 noon * Merged pr to do atomic desktop redirects ( https://pagure.io/fedora-infra/ansible/pull-request/3035 ) and deployed * Re-added proxy03 then proxy14 and tested. * Gathered ccp file for python maintainers from failed build. * Sorted out permissions on forge.stg and test migrated infrastructure tickets to test 2026-01-16 18:24:00 - - Fedora Infrastructure meeting - 2026-01-15 9am - Dug into retirements not working right ( https://pagure.io/fedora-infrastructure/issue/13020 ) - Looked at some internal stuff - Daily infra triage - 2026-01-15 noon - Fixed riscv-koji proxying config - Bunch of chatting with live assistants to get proxy05 mgmt access - Filed ewaste/recycle tickets for old power8's/dells left in rdu2 - Merged two proxy prs: https://pagure.io/fedora-infra/ansible/pull-request/3044 and https://pagure.io/fedora-infra/ansible/pull-request/3042 - Fixed bugzilla description for Fedora (still had 41 and branched 43) 2026-01-19 20:57:00 - * Restarted failed updates pushes * Redeployed f44-rebuild signing when it wasn't active. * Sent out announcement about forge migration for infra tickets next week * Fixed some perms on people01 for schedule updating * Looked a bunch at projects on forgejo, updated readmes * Made forge move pr for infra git: https://pagure.io/fedora-infrastructure/pull-request/13056 * Made forge move pr for infra ansible: https://pagure.io/fedora-infra/ansible/pull-request/3048 * PR for adjusting bz description at branch/eol ( https://forge.fedoraproject.org/infra/docs/pulls/480 ) @jnsamyak:matrix.org ==================== 2026-01-14 13:08:00 - releng ops ticket, meetings sprint planning, making boards, mentoring, 1:1 working on automation task for mass branching, reviewing and merging prs tox one, and documentation checks - having a busy week :D