Duration: 10 minutes

Affected Components: Fluxer Gateway (gateway.fluxer.app)

Apr 30, 02:12:54 GMT+0
Investigating - We are currently investigating this incident..

Apr 30, 02:23:19 GMT+0
Resolved - This incident has been resolved..

Duration: 4 minutes

Affected Components: Fluxer API (api.fluxer.app)

Apr 29, 19:07:15 GMT+0
Investigating - We are currently investigating this incident..

Apr 29, 19:11:12 GMT+0
Resolved - This incident has been resolved..

Apr 29, 19:21:31 GMT+0
Postmortem - At 19:01:58 UTC, our Valkey instance was OOM-killed by the kernel. The pod's memory limit was set to 512 MiB — a low default carried over from initial setup — and Valkey itself had no eviction ceiling configured, so under normal application growth its working set crept past the pod's limit before the configured LRU eviction policy ever had a chance to engage. Valkey came back \~1 second later, but because it's an in-memory store, all ephemeral state (including the snowflake node-ID leases held by every API pod) was wiped on restart. Starting around 19:04:30 UTC — roughly the renewal interval after the restart — every API pod tried to renew its lease, found it gone, and treated the loss as terminal instead of recoverable. From that point until mitigation, 100% of message sends and webhook deliveries returned 500 across the fleet. We mitigated at \~19:09 UTC by rolling both API deployments, which let pods acquire fresh leases on startup. Total user-visible impact: \~5 minutes of fleet-wide message-send failures..

Duration: 44 minutes

Affected Components: Fluxer API (api.fluxer.app)

Apr 24, 22:29:28 GMT+0
Investigating - We are currently investigating this incident..

Apr 24, 23:13:32 GMT+0
Resolved - This incident has been resolved..

Duration: 12 minutes

Affected Components: Fluxer Gateway (gateway.fluxer.app)

Apr 23, 18:27:48 GMT+0
Identified - We are continuing to work on a fix for this incident..

Apr 23, 18:39:36 GMT+0
Resolved - This incident has been resolved..

Apr 23, 18:40:32 GMT+0
Postmortem - A brief production outage was caused when troubleshooting production state in the gateway and triggering a node failure. We are working towards better redundancy and protection against this class of failures in the future. Thanks for your patience!.

Duration: 13 minutes

Affected Components: Fluxer Gateway (gateway.fluxer.app)

Apr 20, 16:35:42 GMT+0
Investigating - We are currently investigating this incident..

Apr 20, 16:48:25 GMT+0
Resolved - Sorry about the brief downtime. We'd been putting off a downscaling of our Kubernetes cluster for a while, and I finally went ahead with it. During the process, the gateway exceeded its memory limit and rolled, which forced everyone to reconnect — a process that takes a little time. Now that we've ripped the bandaid off, this shouldn't be needed again in the near future..

Affected Components: Fluxer API (api.fluxer.app)

Apr 19, 11:21:54 GMT+0
Investigating - We are currently investigating this incident..

Apr 19, 11:47:41 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Apr 19, 12:00:23 GMT+0
Postmortem - Between **2026-04-19 06:16 UTC and 11:44 UTC (\~5h 28m)**, the public API returned errors on every Cassandra-backed request. A Cassandra container log grew unbounded (no Docker log rotation) and filled the disk on a database node, which tripped Cassandra's `disk_failure_policy=stop` and took the database offline. We truncated the log, restarted Cassandra, rolled the API pods, then added Docker log rotation, silenced the noisy logger, and installed a daily cron that truncates any runaway container log as a safety net. We apologise for how long this took to remediate. We're setting up alerting for this class of failure that bypasses do-not-disturb so it can't happen again..

Apr 19, 12:09:57 GMT+0
Resolved - This incident has been resolved..

Duration: 39 minutes

Affected Components: Fluxer Gateway (gateway.fluxer.app), Fluxer API (api.fluxer.app)

Apr 16, 12:06:47 GMT+0
Investigating - We are currently investigating this incident..

Apr 16, 12:42:23 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Apr 16, 12:46:01 GMT+0
Resolved - This incident has been resolved..

Apr 16, 12:50:15 GMT+0
Postmortem - This incident has been resolved. The traffic between two services (the API and database) was getting caught up in filters. We've taken this time to quickly move the database to be closer to the rest of the infrastructure too..

Duration: 1 hour and 20 minutes

Affected Components: Fluxer Gateway (gateway.fluxer.app)

Apr 15, 13:23:54 GMT+0
Investigating - We are currently investigating this incident..

Apr 15, 14:44:19 GMT+0
Resolved - This incident has been resolved..

Apr 15, 14:44:42 GMT+0
Postmortem - Around 378 users were getting stuck because of a bug in our internal session counter. It wasn't decrementing properly in all cases, so it would incorrectly flag users as having too many active sessions and reject new connections. We've unblocked everyone affected and have fixed the underlying bug. Apologies for the trouble!.

Duration: 3 hours and 26 minutes

Affected Components: Fluxer API (api.fluxer.app)

Apr 14, 16:08:48 GMT+0
Investigating - We are currently investigating this incident..

Apr 14, 19:34:28 GMT+0
Resolved - This incident has been resolved..

Duration: 1 day, 17 hours and 47 minutes

Affected Components: Fluxer Gateway (gateway.fluxer.app)

Apr 14, 12:56:55 GMT+0
Investigating - We are currently investigating this incident..

Apr 14, 13:38:42 GMT+0
Resolved - This incident has been resolved..

Apr 14, 14:09:24 GMT+0
Resolved - This incident has been resolved..

Duration: 1 day, 19 hours and 46 minutes

Affected Components: Fluxer Gateway (gateway.fluxer.app), Fluxer API (api.fluxer.app)

Apr 13, 15:00:58 GMT+0
Investigating - We are currently investigating this incident..

Apr 13, 15:12:20 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Apr 13, 15:20:03 GMT+0
Postmortem - On April 13, 2026, the API intermittently served 503 because a risk-data sync emptied its Cassandra table during a failed rewrite, causing the API to fail closed. We restored service by repopulating the table and restarting the API, then fixed the underlying issue by removing duplicate cache-refresh work, adding sync locking, and changing the risk-list update flow so failed syncs can no longer wipe entire datasets..

Apr 13, 15:38:49 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Apr 13, 15:44:43 GMT+0
Resolved - This incident has been resolved..

Duration: 33 minutes

Affected Components: Fluxer API (api.fluxer.app)

Apr 13, 08:24:15 GMT+0
Investigating - We are currently investigating this incident..

Apr 13, 08:57:38 GMT+0
Resolved - This incident has been resolved..

Duration: 9 hours and 46 minutes

Affected Components: Fluxer API (api.fluxer.app)

Apr 12, 04:27:56 GMT+0
Resolved - This incident has been resolved..

Apr 11, 18:41:34 GMT+0
Investigating - You will experience degraded platform functionality while our trust & safety team is actively stopping ongoing platform-wide abuse..

Apr 11, 21:08:18 GMT+0
Investigating - We are preparing to bring registrations back online with improved safeguards designed to better prevent abuse. We strongly condemn all illegal activity on our platform and are actively cooperating with law enforcement and other relevant authorities..

Duration: 43 minutes

Affected Components: Fluxer Gateway (gateway.fluxer.app)

Apr 10, 23:14:02 GMT+0
Investigating - We are currently investigating this incident..

Apr 10, 23:50:46 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result. There will be some intermittent errors and latency until everyone has fully reconnected. Thanks for your understanding!.

Apr 10, 23:56:33 GMT+0
Resolved - This incident has been resolved..

Duration: 16 minutes

Affected Components: Fluxer API (api.fluxer.app)

Apr 10, 16:22:06 GMT+0
Investigating - We are currently investigating this incident..

Apr 10, 16:28:16 GMT+0
Identified - The issue has been identified and a fix is being deployed..

Apr 10, 16:38:03 GMT+0
Resolved - This incident has been resolved..

Duration: 16 minutes

Affected Components: Fluxer Gateway (gateway.fluxer.app), Fluxer API (api.fluxer.app)

Apr 10, 00:35:13 GMT+0
Investigating - We are currently investigating this incident..

Apr 10, 00:51:03 GMT+0
Resolved - This incident has been resolved, we encountered an issue between two of our providers; one of which we are moving off of..

Duration: 10 minutes

Affected Components: Fluxer API (api.fluxer.app)

Apr 9, 22:12:19 GMT+0
Investigating - We are currently investigating this incident. You will receive it as soon as possible!.

Apr 9, 22:22:37 GMT+0
Resolved - This incident has been resolved..

Duration: 26 minutes

Affected Components: Web Client (web.fluxer.app), Media Proxy (fluxerusercontent.com), Static Assets (fluxerstatic.com), Fluxer Gateway (gateway.fluxer.app), Fluxer API (api.fluxer.app), Website (fluxer.app)

Apr 8, 13:43:21 GMT+0
Investigating - We are currently investigating this incident..

Apr 8, 14:01:48 GMT+0
Investigating - We are continuing to investigate this incident..

Apr 8, 14:05:45 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Apr 8, 14:09:23 GMT+0
Resolved - This incident has been resolved..

Apr 8, 14:22:27 GMT+0
Postmortem - At approximately 13:42 UTC, a networking issue at our upstream hosting provider Vultr caused all inbound traffic to be dropped, resulting in a complete outage across all Fluxer domains. We mitigated by rerouting traffic directly to instances under our control, bypassing the affected Vultr infrastructure. The root cause lies squarely with Vultr, and we're in contact with them to find out what went wrong. On the bright side, the workaround also resolved a pre-existing IPv6 issue we'd already filed with them; so, thanks for that, we guess!.

Duration: 1 day, 11 hours and 31 minutes

Affected Components: Web Client (web.fluxer.app), Fluxer Gateway (gateway.fluxer.app), Fluxer API (api.fluxer.app), Website (fluxer.app)

Apr 7, 02:37:55 GMT+0
Identified - We identified an issue with IPv6 not working on our upstream provider. We are working with them to to resolve this issue..

Apr 8, 14:08:28 GMT+0
Resolved - We have applied a fix for our other ongoing incident which in turn also fixed IPv6..

Duration: 16 minutes

Affected Components: Media Proxy (fluxerusercontent.com), Static Assets (fluxerstatic.com), Fluxer API (api.fluxer.app)

Apr 1, 15:04:45 GMT+0
Investigating - We are currently investigating this incident..

Apr 1, 15:14:39 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Apr 1, 15:21:02 GMT+0
Resolved - This incident has been resolved..

Duration: 28 minutes

Affected Components: Fluxer API (api.fluxer.app)

Apr 1, 00:34:33 GMT+0
Identified - We are continuing to work on a fix for this incident..

Apr 1, 00:58:25 GMT+0
Monitoring - We implemented a fix and are currently monitoring the result..

Apr 1, 01:02:21 GMT+0
Resolved - This incident has been resolved..

Duration: 35 minutes

Affected Components: Fluxer API (api.fluxer.app)

Mar 31, 22:15:31 GMT+0
Identified - We are continuing to work on a fix for this incident..

Mar 31, 22:32:16 GMT+0
Identified - A patch is being rolled out. This will take 5-10 minutes..

Mar 31, 22:50:53 GMT+0
Resolved - This incident has been resolved..

Duration: 1 hour and 28 minutes

Affected Components: Fluxer API (api.fluxer.app)

Mar 29, 19:00:42 GMT+0
Resolved - Our upstream provider has resolved the outage on their end and email sending works again. You'll need to resend the verification email if you didn't receive it by pressing the button in the banner at the top of the screen. Thanks for giving Fluxer a go!.

Mar 29, 17:33:01 GMT+0
Identified - We are continuing to work on a fix for this incident..

Duration: 12 minutes

Affected Components: Fluxer API (api.fluxer.app)

Mar 29, 05:49:04 GMT+0
Identified - We've identified the root cause and are deploying a fix..

Mar 29, 06:01:28 GMT+0
Resolved - This incident has been resolved..

Duration: 1 minute

Affected Components: Fluxer Gateway (gateway.fluxer.app)

Mar 26, 21:17:39 GMT+0
Investigating - We are currently investigating this incident..

Mar 26, 21:18:48 GMT+0
Resolved - This incident has been resolved..

Duration: 21 minutes

Affected Components: Fluxer Gateway (gateway.fluxer.app)

Mar 24, 17:30:00 GMT+0
Identified - We are planning for a scheduled maintenance during this time. You may be frequently disconnected from the service..

Mar 24, 17:51:18 GMT+0
Completed - Maintenance has completed successfully..

Duration: 19 minutes

Affected Components: Fluxer Gateway (gateway.fluxer.app)

Mar 20, 17:45:00 GMT+0
Identified - Communities may disappear and come back. We apologise for the inconvenience..

Mar 20, 18:03:33 GMT+0
Completed - Maintenance has completed successfully..

Duration: 15 hours and 25 minutes

Affected Components: Web Client (web.fluxer.app)

Mar 11, 18:41:20 GMT+0
Identified - If your client crashed just recently, that was our fault, not yours! Everyone received a bad payload over their WebSocket connection and was forced to reload. Sorry!.

Mar 11, 13:40:00 GMT+0
Identified - <https://bsky.app/profile/did:plc:tgm3isug3dbipufep4durid5/post/3mgrz7nqoms2o> Member lists have been disabled globally to shed some load to make the platform a bit more usable (the member list is the bane of my existence) in preparation for the next deploy that will let us bring them back, HQ back, improve loading times of media, eliminate random failures and intermittent latency, and a lot of other cool things!.

Mar 11, 21:39:31 GMT+0
Identified - We're finishing up some remaining things caught in testing before rolling this out to everyone! Stay tuned 👀.

Mar 12, 05:04:47 GMT+0
Completed - We're still working on this! Member lists will remain disabled for a bit longer. Thanks for your patience — we want this upgrade to go as smoothly as possible so we're taking extra care to work out the remaining issues found during testing..

Duration: 4 days, 23 hours and 4 minutes

Affected Components: Web Client (web.fluxer.app), Media Proxy (fluxerusercontent.com), Static Assets (fluxerstatic.com), Fluxer Gateway (gateway.fluxer.app), Fluxer API (api.fluxer.app), Website (fluxer.app)

Feb 28, 04:22:34 GMT+0
Identified - We're still in the process of working on the migration, but we've flipped over all of the infrastructure to the new stuff now! We're working on some bugs still, but we should still be on track for 10 AM UTC on Saturday..

Mar 1, 11:04:26 GMT+0
Completed - Maintenance has completed successfully..

Feb 26, 14:34:25 GMT+0
Identified - We're still working on fixing some some bugs with the updated gateway, which are causing all guilds to become unavailable on certain changes and making the platform unstable for brief periods of time before we roll it out to a wider audience..

Feb 26, 19:41:15 GMT+0
Identified - The media proxy and the static assets remain stable on the new infrastructure, so both are being marked operational now. We are continuing to have a subset of traffic hitting the new infrastructure and hope to fully cut it over soon..

Feb 24, 12:00:00 GMT+0
Identified - We are planning for a scheduled maintenance during this time to complete the migration of the infrastructure. We hope to keep the platform online as much as possible throughout this transition..

Feb 24, 12:00:01 GMT+0
Identified - Maintenance is now in progress.

Feb 24, 14:21:09 GMT+0
Identified - The infrastructure migration is still in progress and the maintenance window has been extended by an hour to accommodate needs..

Feb 24, 20:01:47 GMT+0
Identified - We're finally ready to start cutting over traffic! Things will continue to be a little bumpy as we sort out and scale up the new infrastructure, and may become unavailable entirely for some users for a short period. If you are using the official client and you're not let back in, please try to hit \[CTRL\] + \[R\] (or \[**⌘**\] + \[R\] if you're a Mac user) to reload it to see if that solves the issue..

Feb 25, 09:26:13 GMT+0
Identified - Sorry for the lack of updates, we've been heads down working on getting everything online and haven't had time to get the status page properly updated. We're almost to the point where things are in working order, however, there's an existing issue with the client not loading properly that we are working on fixing..

Feb 27, 21:46:29 GMT+0
Identified - Just wanted to share an update here for everyone watching alongside at home that we're still working on things behind the scenes..

Feb 25, 20:20:57 GMT+0
Identified - The maintenance is still underway, however preliminary testing with the new infrastructure has been well! We hope to be fully online again with a little treat for everyone soon. 👀.

Duration: 2 hours and 50 minutes

Affected Components: Media Proxy (fluxerusercontent.com), Website (fluxer.app), Fluxer API (api.fluxer.app), Web Client (web.fluxer.app), Static Assets (fluxerstatic.com)

Feb 24, 02:00:00 GMT+0
Identified - We are working on migrating Fluxer to newer infrastructure. Stay tuned..

Feb 24, 04:49:35 GMT+0
Completed - Maintenance will be ending shortly but work will continue on the web client in the meantime. The progress of the migration will resume tomorrow morning as things have stabilized for this evening..