Incidents and maintenance reported on status page for Steel https://status.steel.dev/ https://d1lppblt9t2x15.cloudfront.net/logos/f489743f5c17a6d355bb490d1a8e3091.png https://status.steel.dev/ en https://status.steel.dev/maintenance/1092256 Sat, 17 Oct 2026 02:30:00 -0000 https://status.steel.dev/incident/1092256#55be1fd4be59a46a4a536c274c057eb38beff4c9685acd2f3b8e245b4003bbbe Maintenance Maintenance completed https://status.steel.dev/maintenance/1092256 Fri, 16 Oct 2026 16:30:00 -0000 https://status.steel.dev/incident/1092256#65f7737b2c694cbc68962303efd28309b7884b3dd8741d9951f5b4ebafb8f606 Maintenance Upcoming maintenance may temporarily interrupt active browser sessions and affect new session creation. We’ll share updates here and confirm when maintenance is complete. https://status.steel.dev/incident/1079717 Fri, 02 Oct 2026 02:55:00 -0000 https://status.steel.dev/incident/1079717#035c7159b4daa81d3e50d63f1884132ee9ddcd2d31400890c49073179befa028 Incident We have successfully rolled out the fix out across the affected fleet. Session connectivity and error rates have returned to normal. https://status.steel.dev/incident/1079717 Fri, 02 Oct 2026 02:26:00 -0000 https://status.steel.dev/incident/1079717#89e666057ced86b89067b71c656c75ae59b8daab631577f9ede2ca9c3ec03314 Incident We have identified the root cause of the issue. It will be resolved within 10-15 minutes. Thanks for your patience! https://status.steel.dev/incident/1079717 Fri, 02 Oct 2026 01:00:00 -0000 https://status.steel.dev/incident/1079717#7a23d9e85cc3e6f0c736ea9054d42172e27d2707d693fc044b21a82b1cdab068 Incident Looking into the errors and will be updating here shortly https://status.steel.dev/incident/1073946 Fri, 25 Sep 2026 21:19:00 -0000 https://status.steel.dev/incident/1073946#d6b2f0292753e4ae7e1312a13c197ec30b19e7f14119d8abb8ea019e8f485f45 Incident We rolled out an update a few hours ago, and live streaming and recording have remained stable since. We’ll continue to monitor things closely to make sure everything remains healthy. https://status.steel.dev/incident/1073946 Fri, 25 Sep 2026 14:29:00 -0000 https://status.steel.dev/incident/1073946#4353a83cefbe47ad4bc1553c980b3a0d1fa355032ead66b4ddd9d82e826a21ce Incident Live streaming may experience playback stalls, disconnections, or delayed recordings. API functionality is operating normally. We’re investigating and replacing affected streaming workers, and we’ll share an update as we learn more. https://status.steel.dev/incident/1072386 Wed, 23 Sep 2026 21:05:00 -0000 https://status.steel.dev/incident/1072386#6a0b44343f181eb66039725387e9fcec64729595a297426f5d122614a2fada0e Incident We've pushed out a fix and these issues should be resolved now. `headless` is still facing a couple issues but we will follow up with updates there shortly. https://status.steel.dev/incident/1072386 Wed, 23 Sep 2026 19:18:00 -0000 https://status.steel.dev/incident/1072386#5af16bb3bdb505943dda3e9ccf4f1a1a61249279f80168e7a4293a1312e038d8 Incident There's slightly higher than expected latency and issues with recordings for some sessions; we're investigating and will follow up with updates shortly. https://status.steel.dev/incident/1065911 Wed, 16 Sep 2026 20:59:00 -0000 https://status.steel.dev/incident/1065911#1a5d515d4566b6b856251663298c7ebdf2cab6846d125a30fd374c9970f66a40 Incident All connections should be functioning properly again. https://status.steel.dev/incident/1065911 Wed, 16 Sep 2026 18:41:00 -0000 https://status.steel.dev/incident/1065911#88ce53fde64cb21c320e3c9a57f1be97806049bfc2fc0467ea88a03e8fe0e10f Incident We're investigating what could be causing this and we'll follow up with an update shortly. https://status.steel.dev/incident/1051432 Fri, 04 Sep 2026 23:53:00 -0000 https://status.steel.dev/incident/1051432#1878c4c4c36a38a8ab6b75ae68caf66bf77793421cbfc9b5d25940c44ac44629 Incident We’ve pushed out a fix/patch; but it turns out this was a longer blip from one of our upstream providers. We’ll be working on workarounds for this going forward. https://status.steel.dev/incident/1051432 Fri, 04 Sep 2026 23:46:00 -0000 https://status.steel.dev/incident/1051432#3f0667be95d735ade11f772b8221ea0e77bf782c1aa68bdad7291f5833731c93 Incident Currently looking into the problem https://status.steel.dev/incident/1050815 Fri, 04 Sep 2026 14:30:00 -0000 https://status.steel.dev/incident/1050815#f30f5c7d880a5343ca87209d5617a8b88db1e98c3d585a3341afa6fa9a77dc91 Incident We've pushed a fix and are monitoring the situation. https://status.steel.dev/incident/1050815 Fri, 04 Sep 2026 14:27:00 -0000 https://status.steel.dev/incident/1050815#84b927879e5b0dfacbaf4f5deded75a114bbc4bcbf205b68d4b7c4168ef66365 Incident Looking into some high latency / create errors https://status.steel.dev/incident/1028957 Sun, 23 Aug 2026 12:51:00 -0000 https://status.steel.dev/incident/1028957#7dec8f8d6caa41be6835fa61ef8521e86fced910abdbc3f844d29a577f21ea7e Incident We've scaled up our capacity and creates should be handled smoothly. https://status.steel.dev/incident/1028957 Sun, 23 Aug 2026 12:34:00 -0000 https://status.steel.dev/incident/1028957#b16898fc069ab131644ed771c51533db833b6fdcf2b34fe69b56e8413d7b7e76 Incident We've resolved the underlying problem and new session creates should be successful going forward shortly; we'll update the situation as we go https://status.steel.dev/incident/1028957 Sun, 23 Aug 2026 07:10:00 -0000 https://status.steel.dev/incident/1028957#921ccab8f1de1648d15a0d0a891cef3597edb8348ef471dfe06a4d548bdc0c60 Incident We're looking to get this resolved immediately; apologies for the inconvenience https://status.steel.dev/incident/996168 Tue, 04 Aug 2026 20:25:00 -0000 https://status.steel.dev/incident/996168#d0112bbb27567370f4249a8f686727ff93deb1cd6b7d9050347ab7b99f28d57b Incident we've pushed a patch and WS connections should be up again. https://status.steel.dev/incident/996168 Tue, 04 Aug 2026 20:15:00 -0000 https://status.steel.dev/incident/996168#1e8d9412cb403ff1434f9e694c310ed676f889b7754b738892ec6b3b8e5d8cd6 Incident We're currently investigating https://status.steel.dev/incident/989034 Fri, 31 Jul 2026 21:36:50 -0000 https://status.steel.dev/incident/989034#9c8995dec655247e3f14cdd3c5197c5aaae8a11ab4ccb8d38de78c9ceef9a1f8 Incident Resolved. The API instances handling WebSocket connections were restarted, and connection capacity has returned to normal. New browser connections have been succeeding since 21:15 UTC. We are continuing to work on the underlying cause to prevent a recurrence. https://status.steel.dev/incident/989034 Fri, 31 Jul 2026 21:19:08 -0000 https://status.steel.dev/incident/989034#f6e4f2dc61222d5e97fad012500ce0f73d3b14f617e8c3bdc089e03085919230 Incident This has been mitigated. WebSocket connections to connect.steel.dev should be working normally again. Please retry if you were affected. https://status.steel.dev/incident/989034 Fri, 31 Jul 2026 21:06:01 -0000 https://status.steel.dev/incident/989034#86daf19aff209d4c76ea1717bbfc489af7f25d096a3d55635d05374c75b3b1a2 Incident We are seeing elevated failures establishing browser WebSocket connections (wss://connect.steel.dev) due to API connection capacity pressure. Session HTTP APIs may still respond, but new CDP/Playwright connections can return 503. We are investigating and will update shortly. https://status.steel.dev/maintenance/987779 Fri, 31 Jul 2026 03:34:40 -0000 https://status.steel.dev/incident/987779#f5c57d989ef8b00cd46b3fea45c388ab4198bad962256c0fb8cef0d38c01c4d3 Maintenance We will perform brief scheduled maintenance on our database infrastructure. **When:** Tuesday, August 4, 2026, 11:00 PM – 11:30 PM Eastern **Expected impact:** Short service interruption (typically under 5 minutes) for API connectivity during the window while databases reboot. No action is required on your side. We will post an update when maintenance is complete. https://status.steel.dev/incident/973354 Wed, 22 Jul 2026 10:10:00 -0000 https://status.steel.dev/incident/973354#6a6236e4bc6e173828c0570f16b54967aca9b617f5f45a5f2daadce59fb8da9f Incident DNS has been restored https://status.steel.dev/incident/973354 Wed, 22 Jul 2026 09:25:00 -0000 https://status.steel.dev/incident/973354#85e3625b4db673bca18987ffc48c0fedff646e07c4373a84462324d0df3b5c74 Incident IN THE MEANTIME, ALL USERS PLEASE USE https://http.steel-edge.net/ as an alternate domain for the API https://status.steel.dev/incident/973354 Wed, 22 Jul 2026 05:22:00 -0000 https://status.steel.dev/incident/973354#bb2ee0434c0fe758b2716fcd1e6eb68479f7ad93d75dad85e31d28928ea0dc8e Incident All services are down currently https://status.steel.dev/incident/970496 Mon, 20 Jul 2026 17:05:00 -0000 https://status.steel.dev/incident/970496#dd4c67a893ec6b6350edb5dd830778ebcf18a6e0d736502d521d1160bf69c70d Incident Things are stable again and most requests should be operational. https://status.steel.dev/incident/970496 Mon, 20 Jul 2026 16:40:00 -0000 https://status.steel.dev/incident/970496#3010e41b7dd752220acdd5031529ee3c8766582abb7e6d812d7d566fcc759b9d Incident Looking into what's causing this! https://status.steel.dev/incident/938569 Mon, 29 Jun 2026 15:06:00 -0000 https://status.steel.dev/incident/938569#e9ec9de3e27011fa60a90a5303a4b2730efde925f885259a675ca6c59163f941 Incident Thing seem to be stable -- once again, we'll continue to monitor the situation for any other issues. https://status.steel.dev/incident/938569 Mon, 29 Jun 2026 14:56:00 -0000 https://status.steel.dev/incident/938569#9c166a7c4cf0a030e16dacdb0224bb93c7d7042973e71ccdc999ea4fb81daa1b Incident Facing a reflux of the same problems once again with regards to session creation. https://status.steel.dev/incident/938569 Mon, 29 Jun 2026 14:41:00 -0000 https://status.steel.dev/incident/938569#78ca7794ca58de26d7133dc89d4025bf8d89ac2bb9ec93557bdcdf88cfeea78c Incident We're seeing some early signs of life; we're continuing to monitor the situation to ensure we're back to normal. https://status.steel.dev/incident/938569 Mon, 29 Jun 2026 14:19:00 -0000 https://status.steel.dev/incident/938569#353360b2c03bb8ad7e94d0a85112084f6792190a986c164b6343be7a0503c5ba Incident We're working on a fix for this https://status.steel.dev/incident/937005 Sat, 27 Jun 2026 17:48:00 -0000 https://status.steel.dev/incident/937005#55912d4eadcfcc7dadc5da1a28311c352d06eb9110794873b6e974d85d5a80ee Incident We’re back! Everything should be up and running. Thanks for bearing with us. https://status.steel.dev/incident/937005 Sat, 27 Jun 2026 17:40:00 -0000 https://status.steel.dev/incident/937005#2f8b8f94f324ed325183ff037208b13422381a363739b32acfd432421a542824 Incident Investigating the issue https://status.steel.dev/incident/920055 Wed, 10 Jun 2026 20:12:00 -0000 https://status.steel.dev/incident/920055#ea591920f79e2c1e632e5fb7053402d42a6f8df971669cc9583cb0ab7d39a35e Incident Most problems should have been resolved and should be stable going forward. https://status.steel.dev/incident/920055 Wed, 10 Jun 2026 15:51:00 -0000 https://status.steel.dev/incident/920055#80c86099420919c6fd322d13c0cb5f900053d37f167178495ae5e3e4c488d0af Incident We've pushed a patch but we're closely monitoring the system and will return to green once fully stable. https://status.steel.dev/incident/919850 Wed, 10 Jun 2026 11:55:00 -0000 https://status.steel.dev/incident/919850#d537c9f70b4fb040834c0c7905bb633c01f61b685d76bfaec5e576b42675b200 Incident We’ve pushed up a number of different changes and things should be stable again. We’ll continue to monitor for failures going forward! https://status.steel.dev/incident/919850 Wed, 10 Jun 2026 08:07:00 -0000 https://status.steel.dev/incident/919850#e01dfa060d40dc3a2d742ae24c1e2b617bb07192b931bacf8fe42eef322da1fd Incident We’re having a higher rate of errors when creating sessions than usual and we’re closely investigating the situation https://status.steel.dev/maintenance/914814 Fri, 05 Jun 2026 18:13:32 -0000 https://status.steel.dev/incident/914814#7018d940f005f3d38739199b1bb9f30142ba96497b1ef990a7a7e84848c284c4 Maintenance An upstream network provider will be performing emergency maintenance during this window. We expect services to remain fully operational, though some requests may experience slightly higher latency or occasional failures. https://status.steel.dev/incident/938610 Fri, 05 Jun 2026 15:30:00 -0000 https://status.steel.dev/incident/938610#1abd56cb85e3fa9908cd278bfc36a8c9410a19d4ac944408076e220a6239d080 Incident All proxy issues should be resolved now! https://status.steel.dev/incident/914579 Fri, 05 Jun 2026 14:27:00 -0000 https://status.steel.dev/incident/914579#dbbfe44d6de3452cc122226e71484268f3ad15d027f531acaee83da908d284c8 Incident We are seeing consistent healthy connections from the same affected IPs -- function should be fully restored. Performance is improving but we're still working toward full recovery. We'll continue monitoring and post another update once we're fully stable. https://status.steel.dev/incident/914579 Fri, 05 Jun 2026 14:14:00 -0000 https://status.steel.dev/incident/914579#4f792484c60ba13665ea2a0be3fba5a5a01f9c43b0aa147f76af242acf473e00 Incident We're currently investigating the problem and will be back with updates https://status.steel.dev/incident/938610 Fri, 05 Jun 2026 13:30:00 -0000 https://status.steel.dev/incident/938610#10f06cb4761675dc296e559d61ae411f40889c8ed9b37698833e144657d02d8a Incident We're investigating it https://status.steel.dev/incident/911582 Wed, 03 Jun 2026 01:42:00 -0000 https://status.steel.dev/incident/911582#b3ae32593b438758eb7f778947716ae216370dce4446e4f0d64c61d514331192 Incident We've cleared up a queue that was backed up and should be fully recovered. We'll continue to monitor the situation. https://status.steel.dev/incident/911582 Wed, 03 Jun 2026 01:37:00 -0000 https://status.steel.dev/incident/911582#7629e94502f0b4786e668163202d3568934fed3c4c06c3c11ebfde3f1fccd9a1 Incident Investigating the issue currently https://status.steel.dev/incident/910293 Mon, 01 Jun 2026 19:00:00 -0000 https://status.steel.dev/incident/910293#71071a5870cc5875bef35d67ba650f5aa43284d0db08607a29173a638ce15606 Incident We have pushed a patch temporarily to resolve the errors; investigating some core services to see what could've happened. https://status.steel.dev/incident/910293 Mon, 01 Jun 2026 18:56:00 -0000 https://status.steel.dev/incident/910293#d00b5b61e6ba1c09fc8ee732735b2ea092d096edf0eda4e6ee6d068e2bd00ae8 Incident We are investigating the issue https://status.steel.dev/incident/905948 Tue, 26 May 2026 21:54:00 -0000 https://status.steel.dev/incident/905948#bc46b27424fd74c76bc812c6c618f533ed4465fc6109dbf687ce881c175fd58c Incident Our auth provider has pushed a fix. All issues with the dashboard should be resolved now. https://status.steel.dev/incident/905948 Tue, 26 May 2026 21:38:00 -0000 https://status.steel.dev/incident/905948#b6e2a696037ad2257d8fd566306bbaba7a52c08461b797465ae17449e851133f Incident Our auth provider is having issues and we're affected. Working with them to get this resolved. https://status.steel.dev/incident/895171 Wed, 13 May 2026 15:41:00 -0000 https://status.steel.dev/incident/895171#0d2df5fc5e8514f31d369d05a520a7f682620d0b4e9f261b82c095f525a440da Incident We've patched the issue and will be scaling out to handle even more load. https://status.steel.dev/incident/895171 Wed, 13 May 2026 15:38:00 -0000 https://status.steel.dev/incident/895171#dbbcc92d383a6b55b5be237261948f5a37a02d912d4115e736f5177fd22d54b7 Incident We're working on a fix! https://status.steel.dev/incident/893640 Tue, 12 May 2026 03:22:00 -0000 https://status.steel.dev/incident/893640#2ac920a299563af35cd4da388a777d4d299f52219d603fc86daab893d8aec8ac Incident We have pushed a fix to session creation and our streams are slowyly coming back to life -- we'll continue to monitor the situation to make sure things are going smoothly https://status.steel.dev/incident/893640 Tue, 12 May 2026 03:13:00 -0000 https://status.steel.dev/incident/893640#ac67d703da9e36c7408944ddf18f6a4093c0c0a0d79937a46f2e7059ee425444 Incident We're taking a look into this https://status.steel.dev/incident/879166 Fri, 24 Apr 2026 22:35:00 -0000 https://status.steel.dev/incident/879166#f465f40301850e6e976deaba4e01537eb52a958db20073281caf5eb2ae3d9eb1 Incident Everything should be back to performing as usual. We're continuing to monitor the situation until we ensure consistent stability. https://status.steel.dev/incident/879166 Fri, 24 Apr 2026 21:29:00 -0000 https://status.steel.dev/incident/879166#dbccf7890c53367b2d96f0754313c286add0940beeb3fb54778229a0bef67b5c Incident Some requests are having longer than usual latencies. https://status.steel.dev/incident/878319 Thu, 23 Apr 2026 07:15:00 -0000 https://status.steel.dev/incident/878319#06782937dd560c6e50da6dac89f133042b27d149241733ab503062e8eb64a1c8 Incident We have pushed a fix for this and all operations should be live again. Apologies for the disturbance, we're working to make sure this doesn't happen again. We're continuing to monitor the situation until we have full confidence that everything is stable again. https://status.steel.dev/incident/878319 Thu, 23 Apr 2026 06:10:00 -0000 https://status.steel.dev/incident/878319#231463527551a0862d9b72fa33c32226689127f2a098085feaa4ad532326d2c4 Incident Our upstream infrastructure provider's API is unresponsive. We're working with them to get things back in business. https://status.steel.dev/incident/871301 Tue, 14 Apr 2026 09:08:00 -0000 https://status.steel.dev/incident/871301#2878ab88ec73952d06af3b34922f7aa940ca6ac62bff65195366865bad9974c1 Incident We have found the root problem and have pushed fixes. Things should be stable now but we’re continuing to monitor the situation closely. https://status.steel.dev/incident/871301 Tue, 14 Apr 2026 06:20:00 -0000 https://status.steel.dev/incident/871301#badfdea85c93d7b6ca6a06d2430e64b06e726710a4d9ba2d7cff0ca44b2732e0 Incident Session creation is consistently failing, we’re investigating immediately. https://status.steel.dev/incident/862757 Wed, 01 Apr 2026 22:12:00 -0000 https://status.steel.dev/incident/862757#1cc1cd8e7ffa84a813cbfe0fed91eb4419a1abcb34ef8777aa04c9c136fff8f6 Incident This has been resolved https://status.steel.dev/incident/862757 Wed, 01 Apr 2026 22:08:00 -0000 https://status.steel.dev/incident/862757#1518486bb529d87240ce69bf19b6c355b54a08cbcf7d7695acb7d74be60e114c Incident We're pushing out a fix here shortly https://status.steel.dev/incident/860552 Mon, 30 Mar 2026 12:50:00 -0000 https://status.steel.dev/incident/860552#eb6441bde3a25c079a2a2725afe7f6fce664e599c3b5a410608d2af3b2ab286d Incident We have pushed a patch for this and everything should be working smoothly again. This was a result of some rogue security patches that became too restrictive for playwright. https://status.steel.dev/incident/860552 Mon, 30 Mar 2026 04:02:00 -0000 https://status.steel.dev/incident/860552#dc3da82e488d0a44d53459435dc6cdc635e5636f84f275a8ba6c681274d68fe7 Incident Playwright clients are currently facing issues connecting with Steel. We’re looking into resolving this. https://status.steel.dev/incident/857432 Wed, 25 Mar 2026 17:45:00 -0000 https://status.steel.dev/incident/857432#c4d088ada982e5da65fded8b9eed767e611c42a7bd998038ae997c0616386d70 Incident We’re back! Our core API should be up and running. Thanks for bearing with us -- we are documenting playbooks currently to make sure this doesn't happen again. https://status.steel.dev/incident/857432 Wed, 25 Mar 2026 17:06:00 -0000 https://status.steel.dev/incident/857432#922533cf69feec0517ad6ee7c066550ac4af23bdeecfa2f3c0cdd0a5bf805294 Incident We are back to accepting session requests and are monitoring things very closely. We'll follow up with a post-mortem when things are all green. https://status.steel.dev/incident/857432 Wed, 25 Mar 2026 15:51:00 -0000 https://status.steel.dev/incident/857432#c1db30c1da686825cf187041e892fb844346ed7d7ee75fb55899119a5172a2a9 Incident We're investigating into this deeply. https://status.steel.dev/incident/847150 Thu, 12 Mar 2026 15:46:00 -0000 https://status.steel.dev/incident/847150#771556b3f170186454c2452b47713fef93aef502a6dfe777c7c4d6392c6a53cf Incident IAD is back online -- we appreciate your patience as we worked to get it back up. We'll be pushing some improvements to avoid this in the future. https://status.steel.dev/incident/847150 Wed, 11 Mar 2026 18:14:00 -0000 https://status.steel.dev/incident/847150#700d9415c952078204e09696e43dfa8300a3e845bd9c6ca8dbe4621578a00402 Incident We're working with our compute provider to get things back online. We'll follow up here shortly. https://status.steel.dev/incident/846365 Tue, 10 Mar 2026 21:55:00 -0000 https://status.steel.dev/incident/846365#d813a3099a7e75864271ce353b58ece9dd2532909b7792be48549d2cab50461a Incident We've pushed a temporary fix but it's not 100% just yet -- finalizing changes slowly. https://status.steel.dev/incident/846365 Tue, 10 Mar 2026 21:51:00 -0000 https://status.steel.dev/incident/846365#8b7bf09a77060ba3fb8a91f89efa5073636c79dadc442c4750adea8304f2d22b Incident We're investigating this thoroughly and will follow up with updates shortly https://status.steel.dev/incident/843684 Sat, 07 Mar 2026 18:18:00 -0000 https://status.steel.dev/incident/843684#ec0e7938e2da66e92fdb733ceb771188e8277d6f50a4d8d2c9076c820347642c Incident We have identified the root cause and fixed the issue. Things should be back to smooth sailing. https://status.steel.dev/incident/843684 Sat, 07 Mar 2026 18:07:00 -0000 https://status.steel.dev/incident/843684#dffb3e2bfafda64b1221d51be40df81a375c5755018796e781e7a1b21fbd3bd3 Incident We're looking into this and will provide an update here soon https://status.steel.dev/incident/829666 Fri, 20 Feb 2026 18:28:00 -0000 https://status.steel.dev/incident/829666#acca9fd47009cc412db416f2d35e8df441269b31f4db3316d2e3e26ac1e1c5b5 Incident We’re back! Everything should be up and running + operating smoothly. Thanks for bearing with us. https://status.steel.dev/incident/829666 Fri, 20 Feb 2026 18:13:00 -0000 https://status.steel.dev/incident/829666#4c0dc612e3de5ef40094892a8dbe639dae60a0408b4133434b4e4cbba85d8379 Incident We've pushed out a patch and are monitoring how it affects the delayed state updates. We'll follow up with more shortly. https://status.steel.dev/incident/829666 Fri, 20 Feb 2026 17:48:00 -0000 https://status.steel.dev/incident/829666#7dcf366d1bf9a6d8df6df91af909a1a30474dc4416f1b3a6bd811726c5dc6b53 Incident Users are reporting inconsistent states + limits for their orgs. We're looking at pushing a fix here soon https://status.steel.dev/incident/828948 Thu, 19 Feb 2026 18:51:00 -0000 https://status.steel.dev/incident/828948#0e6d217958f6471aa46c1a64e924dab46bec0ba4d07ef4ae46257aca89af472b Incident We’re back! Auth on the dashboard should be running smoothly. Thanks for bearing with us. https://status.steel.dev/incident/828948 Thu, 19 Feb 2026 17:06:00 -0000 https://status.steel.dev/incident/828948#e97d589658d937ef797eff734f980ecf400b398208c1d67fd589f0f829d89927 Incident We're facing higher latencies than usual and are monitoring the situation closely from our upstream auth provider. The API is still functional. https://status.steel.dev/incident/821885 Wed, 11 Feb 2026 17:29:00 -0000 https://status.steel.dev/incident/821885#624b40ddbde71e5e1302263755eb22b89ae39501c2eff612859e3603d2550ab7 Incident LAX has been brought back up and should be live. https://status.steel.dev/incident/821885 Mon, 09 Feb 2026 16:59:00 -0000 https://status.steel.dev/incident/821885#e087b9fba936d534b15a16cbe7c56000b229edc73fd1ae19f3612da7b9f0e843 Incident We’ve had to temporarily take down the region due to ongoing issues with different services. We’ll be working on getting it back up ASAP. https://status.steel.dev/incident/818593 Wed, 04 Feb 2026 20:00:00 -0000 https://status.steel.dev/incident/818593#54d32a57aa81a4e00c77c9141d75ae2b167b63a4ddc3db52f43b3475b87fd51c Incident We successfully reset this region with our upstream provider and things should be operation smoothly. https://status.steel.dev/incident/818593 Wed, 04 Feb 2026 17:00:00 -0000 https://status.steel.dev/incident/818593#ab7fbaa8af6a48b5be11f00213157439a784a8a880b7b6c66c9e320dd0789184 Incident Our IAD region is seeing a higher rate of errors than usual. We're working with our upstream provider to resolve this. https://status.steel.dev/incident/800394 Thu, 08 Jan 2026 04:33:00 -0000 https://status.steel.dev/incident/800394#668e308b9abb4aa1229fcc649de9d8b281a01c9862f2358d78bb818dff639925 Incident This was resolved -- the intermittent issues were as a result of our NATs streams being backed up. https://status.steel.dev/incident/800394 Thu, 08 Jan 2026 02:01:00 -0000 https://status.steel.dev/incident/800394#cbd7e60ccae9b58392ae3343c9211ef7be8248a133198053ee25e84ff0a662c4 Incident We're investigating this https://status.steel.dev/incident/790842 Fri, 19 Dec 2025 12:52:00 -0000 https://status.steel.dev/incident/790842#ece0ed5b49dc231d5368f44646753d3266a0b2e6d4a1646a6c9ee7236afb1d83 Incident Services were being throttled in this region and we've scaled up our capacity for now. We will continue to monitor the situation. https://status.steel.dev/incident/790842 Fri, 19 Dec 2025 12:22:00 -0000 https://status.steel.dev/incident/790842#8ea04d70dd2c9f3ca60f31059ef85101e30ca3643ba883d1293a1f5b275f56a3 Incident Most users will be auto-redirected to a different region, but for people selecting `ord` it's important to either remove this selection for now or set it to a different region https://status.steel.dev/incident/788525 Thu, 18 Dec 2025 09:29:00 -0000 https://status.steel.dev/incident/788525#5f5e624c84be127ef71fbea189e722cbc163d37abe71ead3796be214bfa73363 Incident This has been finally resolved by our upstream provider. We will be migrating some core infra to more reliable providers (as we've been doing the last little while) to mitigate this in the future. https://status.steel.dev/incident/788525 Wed, 17 Dec 2025 21:48:00 -0000 https://status.steel.dev/incident/788525#1382cce05356fbb033ce6bf40f0166e79a79208351efff17cccb52c9253a06dc Incident We've identified that this is a result of redis timeouts in the ord region. We're working on a fix for this. https://status.steel.dev/incident/788525 Wed, 17 Dec 2025 21:43:00 -0000 https://status.steel.dev/incident/788525#1d6ee43feff780799f0832343d7d8846f154974e00123463b03614ce8833733e Incident We're looking into this https://status.steel.dev/incident/788011 Wed, 17 Dec 2025 06:11:00 -0000 https://status.steel.dev/incident/788011#c47d6709cda455a0f0e97d7df774af964bf337aeb8ca2852c00b445b66458d73 Incident This was a result of some upstream issues again and we were able to get things back up just recently -- most people will have been auto-redirected unless `iad` was explicitly passed in. Will be a lot faster on this going forward for the people manually selecting regions. https://status.steel.dev/incident/788011 Tue, 16 Dec 2025 23:28:00 -0000 https://status.steel.dev/incident/788011#a85609e37e2186499d921b6187111b85eab80e73913ce2ed592e69408fd854e4 Incident We’re working on getting this back up asap. https://status.steel.dev/incident/784634 Thu, 11 Dec 2025 18:54:00 -0000 https://status.steel.dev/incident/784634#ed2833fd100fe30d70bfb2440ac4cafb5ab36d5ea51771180b9796ea23b12a84 Incident This was resolved by fixing root connectivity issues from an upstream update that happened earlier today. https://status.steel.dev/incident/784634 Thu, 11 Dec 2025 18:29:00 -0000 https://status.steel.dev/incident/784634#b487f52ee2718d726991c2b8f2d78afaeb21aa82fe11e25b16ffe94452ea257b Incident We are investigating this and will report shortly https://status.steel.dev/incident/780983 Fri, 05 Dec 2025 22:55:00 -0000 https://status.steel.dev/incident/780983#7b8c99e180b2985df7fe6f3d26c5a571bae4a038b99394d747b5efd2634847d5 Incident A fix has been rolled out and we’re continuing to monitor the situation https://status.steel.dev/incident/780983 Fri, 05 Dec 2025 21:27:00 -0000 https://status.steel.dev/incident/780983#35d3ad09ac52a644b1517fcfc5c9cf4cb9af8bf3f2dfe12c838839f25ad5c81a Incident We’ve pushed a temporary solution here and we’ll be rolling out a wider fix soon. https://status.steel.dev/incident/780486 Fri, 05 Dec 2025 09:20:00 -0000 https://status.steel.dev/incident/780486#9db894d8e488b5c9edbd64b69345839c12e01951c737780fb540fbb81d5e780d Incident This has been resolved by Cloudflare and our auth provider is back online. https://status.steel.dev/incident/780486 Fri, 05 Dec 2025 09:01:00 -0000 https://status.steel.dev/incident/780486#a894fabfce2f06b30844dcd1187c556e90103125b4cc9e7a36b353cd26e4e31e Incident Cloudflare is currently down and as a result so is our auth provider. https://status.steel.dev/incident/779076 Wed, 03 Dec 2025 18:50:00 -0000 https://status.steel.dev/incident/779076#8a18d9f9804aaaa382bc63a82b9c95734655987077d4e0f04e5767d146ac1b8c Incident We've migrated to a backup + our main cluster has also been booted back up. Appreciate the patience here -- we'll be actively working on making sure this never happens again. https://status.steel.dev/incident/779076 Wed, 03 Dec 2025 18:44:00 -0000 https://status.steel.dev/incident/779076#ff8f01dcf715dd788b43ff51b9dc383a756e7dce7e93719c8034080f8455c68f Incident We're working with our upstream provider about getting these hosts back up. We will be rolling out a multi-cloud solution going forward to deal with these availability issues. https://status.steel.dev/incident/779076 Wed, 03 Dec 2025 18:23:00 -0000 https://status.steel.dev/incident/779076#b3111dc7a742056fdabab75cb10582ae5efbb436b017d15fc493fa61ce8ad2b9 Incident Our redis connections are down -- we are looking into this! https://status.steel.dev/incident/779076 Wed, 03 Dec 2025 18:20:00 -0000 https://status.steel.dev/incident/779076#495bbac22985459cf2094b33d308efb84a25213c14fe87ee62134f60aba2e224 Incident We're investigating a slowdown in our Redis clusters -- we'll update shortly on fixes/outcomes. https://status.steel.dev/incident/771762 Fri, 21 Nov 2025 19:18:00 -0000 https://status.steel.dev/incident/771762#5d1757fa64fa3229a0131c31c2d762da379b5668bc04bee070d8e27da2c69588 Incident Pushed a fix here, things should be smoother now. https://status.steel.dev/incident/771762 Fri, 21 Nov 2025 18:47:00 -0000 https://status.steel.dev/incident/771762#0144fae26935b59948df4ecbe722ddc0d4d254613a6de4de5f418d6afbd584ef Incident We’re seeing higher errors then usual; we’re investigating and will follow up here soon. https://status.steel.dev/incident/770138 Wed, 19 Nov 2025 11:38:00 -0000 https://status.steel.dev/incident/770138#8976fe80f9f18f5b49c5e7bdd829046fe15ae6fc770d75058cfb0ca841820262 Incident We've pushed a scaling fix and traffic is being balanced now. Will continue to monitor for any outliers. https://status.steel.dev/incident/770138 Wed, 19 Nov 2025 11:17:00 -0000 https://status.steel.dev/incident/770138#460242855cce8a5d76f7d5d4e263fd8ad60a077899bba96ba5c6d85c1f17c03a Incident We're looking into it-- and we'll follow up with an update here shortly. https://status.steel.dev/incident/769296 Tue, 18 Nov 2025 16:10:00 -0000 https://status.steel.dev/incident/769296#e41d0e7c1b3d14179357ec8d5b2046a4743e743554e8a20a18b7b10164cfd6b4 Incident These specific issues are resolved. https://status.steel.dev/incident/769296 Tue, 18 Nov 2025 14:54:00 -0000 https://status.steel.dev/incident/769296#c056054408936ae55a2c858275e7a304e5d955f390477c66d7538b3034938caf Incident Some routing / metadata endpoints might be a little shaky as a result of Cloudflare being down. We're working on getting a solution out here now. https://status.steel.dev/incident/767678 Mon, 17 Nov 2025 22:01:00 -0000 https://status.steel.dev/incident/767678#922087cfb0dc3ade90989b559d76c6da98eb08d9361df8b74eace2152f25d0a0 Incident We have pushed up some further mitigations and are working with our infra provider to ensure a complete resolution to this problem. We will be posting some more updates here when that is in place. https://status.steel.dev/incident/767678 Mon, 17 Nov 2025 19:45:00 -0000 https://status.steel.dev/incident/767678#8a4340d73a0c6f8ed6048bbb2806cd89ccc97bb4ac180e3c680c4f402ef28c0a Incident Services are slowly coming back online. https://status.steel.dev/incident/767678 Mon, 17 Nov 2025 16:43:00 -0000 https://status.steel.dev/incident/767678#cc63fdfa2f678b856b26741d398692dafcca3f1b3d83f390dd0808b662b2603b Incident Upstream network maintenance has somehow affected our regional routing logic and sessions being created in US East are failing. https://status.steel.dev/incident/762450 Tue, 11 Nov 2025 22:20:00 -0000 https://status.steel.dev/incident/762450#4244a0346a76cd2334463f3198a62e2ca6186d47a6ccb5c08c5bff9831228672 Incident We've pushed a fix here and have been monitoring it for the last 20 minutes or so -- it seems like traffic is properly routing for now. We'll share any additional updates here. https://status.steel.dev/incident/762450 Tue, 11 Nov 2025 20:42:00 -0000 https://status.steel.dev/incident/762450#8062ef0e9c677376142c5b514585e1423861fe499a393cf5fbe3c9f58aaf4683 Incident We're currently facing some host IP connection issues with our infra in US East -- a fix will be rolling out soon where we will migrate traffic to US West in the meantime https://status.steel.dev/incident/746472 Mon, 20 Oct 2025 18:40:00 -0000 https://status.steel.dev/incident/746472#8aa6c85575bc2a938016d84739d1784361bb30ba3d2474707599e62445be258d Incident We have patched the majority of the issues here. There are still lingering network related issues here (especially networks where NAT traversal is limited). We'll push some updates there soon. https://status.steel.dev/incident/746472 Sun, 19 Oct 2025 19:52:00 -0000 https://status.steel.dev/incident/746472#2b5701960e2e83f880225168aa9d0205dee112c85244697e9fc07bdb30914f8c Incident We're facing some issues on our streaming service but pushing a patch soon -- in the meantime; you can set `headless: true` in the session creation field and it should be patched https://status.steel.dev/incident/745467 Fri, 17 Oct 2025 19:26:00 -0000 https://status.steel.dev/incident/745467#9a54711e66b1e9e21b85908e771ff6a7b806fb6e09cbfc54d29a4fefb8b104ca Incident Things are stabilizing and seem to be back on track across the board -- we're still keeping an eye on things and will notify if things change. https://status.steel.dev/incident/745467 Fri, 17 Oct 2025 14:59:00 -0000 https://status.steel.dev/incident/745467#b8b9594b8a78f5169bfd407f3b911336c1abe137a6074939183b88c4b25f6a80 Incident We are working on a fix here and all things should be resolved soon https://status.steel.dev/maintenance/745438 Fri, 17 Oct 2025 13:43:44 -0000 https://status.steel.dev/incident/745438#7ff1de675007d548ad2c9300cc277c0489f4815b0d3d317718702443c608cd36 Maintenance Requests will fail for some users for <10 mins as we ship some crucial infrastructure changes. Apologies in advance, we will be back shortly. https://status.steel.dev/incident/727417 Sat, 20 Sep 2025 01:22:00 -0000 https://status.steel.dev/incident/727417#102b0e052923fae52a084c568adc455ebe27fb31e7fd79e02874f83bc681ba25 Incident We've been monitoring the situation for quite a while now and it seems like session acquisition + launching is back to being stable. We'll follow up with an incident report with more details. https://status.steel.dev/incident/727417 Fri, 19 Sep 2025 23:44:00 -0000 https://status.steel.dev/incident/727417#e634cbbe6faed61af33c76e730e857e8b6f7cf019604e2d1a8e0de287641a28e Incident Our scaling services are slowly healing from the backlash of earlier requests. We're continuing to monitor the situation and will post an update once everything is all clear. https://status.steel.dev/incident/727417 Fri, 19 Sep 2025 21:46:00 -0000 https://status.steel.dev/incident/727417#30ad880deef0c1a399161a20a42dba7b0fd7e76d810950448a4c71d5c2c52475 Incident We're looking into this right now -- we'll be back with updates shortly https://status.steel.dev/incident/725558 Wed, 17 Sep 2025 01:55:00 -0000 https://status.steel.dev/incident/725558#55d18a2011105bb61b37e8853b33bbf502fae5a194db16bb3d2d619eed4a042f Incident Last artifact has been cleaned up! We should be smooth sailing from now on. https://status.steel.dev/incident/725558 Wed, 17 Sep 2025 01:18:00 -0000 https://status.steel.dev/incident/725558#7988c9ae44e6117643b814c906a04912c5e883c736d707064e2554db81350d3e Incident Some instances are still awaiting new changes -- manually expediting this currently. https://status.steel.dev/incident/725405 Tue, 16 Sep 2025 20:48:00 -0000 https://status.steel.dev/incident/725405#f124a32045c59d832ba29d53d7d6ff7fee14a7354cb6c72fc114954b779a55d3 Incident ## Overview The Steel Sessions API entered a degraded state with a higher error rate due to intermittent failures in the session acquisition and reservation logic. The switching logic responsible for managing session lifecycles exhibited unpredictable behavior, resulting in users being unable to establish or maintain browser sessions. This was made prevalent to us due to a large amount of requests/backpressure which revealed this specific issue. ## Timeline - 6:03 PM UTC - Initial increase in number of requests to the Sessions API - 6:53 PM UTC - Engineering team identified intermittent failures in session management + some early user reports - 7:48 PM UTC - Root cause traced to switching logic in session acquisition/reservation system - 8:12 PM UTC - Issue isolated and fix implemented - 8:48 PM UTC - Service fully restored and monitoring confirmed stability ## Root Cause The session acquisition and reservation system contained flawed switching logic that intermittently failed to properly: - Allocate available browser sessions to incoming requests - Release reserved sessions back to the available pool - Handle concurrent session requests during high load periods This resulted in a cascading failure where the session pool became exhausted due to sessions being incorrectly marked as reserved but not properly allocated or released. ## Impact - **User Impact:** Slowly increasing unavailability for browser automation tasks - **Duration:** 2h46m - **Affected Users:** Many users attempting to create new browser sessions during the incident window - **Business Impact:** Service interruption affecting customer workflows and API integrations ## Resolution The engineering team identified and corrected the faulty switching logic in the session management system. The fix involved: - Refactoring the session state transitions to ensure atomic operations - Implementing proper error handling for edge cases in session allocation - Adding additional validation checks for session pool consistency ## Current Status ✅ **Issue Resolved:** The switching logic has been fixed and deployed ✅ **Service Restored:** All session acquisition functionality is operating normally ✅ **Monitoring Active:** Enhanced monitoring is in place to detect similar issues ## Next Steps and Preventive Measures ### Immediate Actions (Next 7 Days) 1. **Enhanced Monitoring Implementation** - Deploy additional alerting for session pool health metrics 2. **Load Testing** - Conduct comprehensive load testing of session management under various scenarios - Validate fix effectiveness under simulated high-concurrency conditions ### Medium-term Actions (Next 30 Days) 1. **Code Review and Testing Enhancement** - Comprehensive audit of session management codebase - Implement additional unit and integration tests for session lifecycle edge cases - Establish chaos engineering practices for session management resilience 2. **Infrastructure Improvements** - Evaluate session pool sizing and auto-scaling mechanisms and test with methods in #1 - Design graceful degradation strategies for session pool exhaustion 3. **Documentation and Runbooks** - Create detailed runbooks for session management incidents ## Lessons Learned - High-concurrency scenarios expose edge cases not apparent under normal load - Proactive monitoring of internal system states (session pools) is critical for early detection - Automated testing should include concurrent access patterns and resource exhaustion scenarios ## Post-Incident Review A detailed post-incident review meeting will be scheduled within 48 hours to discuss: - Technical deep-dive into the root cause - Evaluation of response time and communication - Assessment of proposed preventive measures - Assignment of follow-up action items https://status.steel.dev/incident/725405 Tue, 16 Sep 2025 19:00:00 -0000 https://status.steel.dev/incident/725405#0d8cd7cb1d6476c382290b14216d3a8ce7d435d2f38061090c433a6a2165e531 Incident Several services are being affected, but we're working on some upgrades https://status.steel.dev/incident/721203 Tue, 09 Sep 2025 17:08:00 -0000 https://status.steel.dev/incident/721203#64e85e357385f67190a32293a81ba315e7bf9baf63f5d4ebc4367c14d5a50067 Incident This should be resolved. https://status.steel.dev/incident/721203 Tue, 09 Sep 2025 14:38:00 -0000 https://status.steel.dev/incident/721203#eb6a3a88db388c32dd9c23004b96f41283d2d65ff08dd648280c7f4c747df909 Incident Region selection is failing due to an upstream issue with our global routing provider. We are looking into this. https://status.steel.dev/incident/720440 Mon, 08 Sep 2025 13:05:00 -0000 https://status.steel.dev/incident/720440#a56d90429052b689a97c8525ce66dff36bb1a18b28492a647a0578c01b51866b Incident We have pushed changes to reflect the situation in Mumbai and we're no longer routing there. All services should be back online. https://status.steel.dev/incident/720440 Mon, 08 Sep 2025 12:39:00 -0000 https://status.steel.dev/incident/720440#b1616fcaa4803301cf9f41b09dc5fb123eed3767aad54fff8ba2f83c6ccfce2a Incident We are continuing to work with our external connectivity providers to address the service degradation caused by multiple submarine cable outages. Traffic between India and Europe/US East is impacted. Since this is an external incident, some degradation may still occur. We'll provide another update as soon as we have more information. https://status.steel.dev/incident/607702 Mon, 23 Jun 2025 15:47:00 -0000 https://status.steel.dev/incident/607702#247c971081bc6594970402c9291ea400a0340868ad52c1477662d1cfc24322be Incident Things are starting to look okay, we're monitoring the situation as we get back to peak performance https://status.steel.dev/incident/607702 Mon, 23 Jun 2025 13:57:00 -0000 https://status.steel.dev/incident/607702#db1f4c0f28c5d656479d30fc49a159ddfe9c0c86cc9095515bbb75a9912dd06c Incident We're investigating an error that is showing up for a lot of users when creating a new session, specifically: ``` Maximum call stack size exceeded ``` We'll be back with more updates https://status.steel.dev/incident/606421 Fri, 20 Jun 2025 15:11:00 -0000 https://status.steel.dev/incident/606421#c396ef8f51d4bb56540a400f3f9da06adcfc861797899df68c824a5e551a3d23 Incident A fix has been deployed -- everything looks good on initial testing but we'll continue to monitor the situation. https://status.steel.dev/incident/606421 Fri, 20 Jun 2025 14:33:00 -0000 https://status.steel.dev/incident/606421#0765a877aaee5d357e11b378015dfd5c2fdf5f6455bb91dec24049644ed7b629 Incident We're looking into this right now and will have an update shortly. https://status.steel.dev/incident/581975 Thu, 29 May 2025 22:27:00 -0000 https://status.steel.dev/incident/581975#ab7b1faddc6ca0903e3742612887b4fa31fe1f7eeb2d288eb2a45277a22b73f2 Incident Okay, after some long investigations; we've found some temporary fixes to help with some of the scale problems we're dealing with. We'll continue to improve on this with a more thoughtful long-term solution -- but in the meantime we'll be monitoring our service closely. Thank you all for your patience! https://status.steel.dev/incident/581975 Tue, 27 May 2025 19:15:00 -0000 https://status.steel.dev/incident/581975#6eeb886a37d5368547ff9d453a8c0f2dc8481709a4d151cc1420b5b29481ce8b Incident We’re investigating an issue with our sessions API that is impacting some users due to a larger number of requests than usual. We’re working to fix the problem as quickly as we can. We’ll share another update shortly. https://status.steel.dev/incident/554108 Wed, 30 Apr 2025 02:31:00 -0000 https://status.steel.dev/incident/554108#e9be378e9827f405cf025a7530aa3f02777a8b795a5a3e0b76c8e837a3d32433 Incident API was slow to respond for a little bit but the issue has been resolved! https://status.steel.dev/incident/554108 Wed, 30 Apr 2025 02:11:00 -0000 https://status.steel.dev/incident/554108#1e722ec09724a10ce56c6694081e463130153ed6d66c9e20c636a5bfa252f669 Incident Running into issues https://status.steel.dev/incident/509641 Sat, 08 Feb 2025 21:28:00 -0000 https://status.steel.dev/incident/509641#cedb8844ff042147877095d5d63978768362b3b0ac995f80d171321908938bfc Incident Everything has been resolved here! https://status.steel.dev/incident/509641 Sat, 08 Feb 2025 21:18:00 -0000 https://status.steel.dev/incident/509641#1bf310debf60286f6e5ef3c457300dce59997b3d4e8005c1e15ed50337fd564e Incident The API is slow to create sessions + some users are experiencing errors https://status.steel.dev/incident/501482 Sat, 25 Jan 2025 08:23:00 -0000 https://status.steel.dev/incident/501482#87809f2df10eff75e9f10c6b5c860f79248be52365925dee029043953ebe0e39 Incident Fixed! https://status.steel.dev/incident/501482 Sat, 25 Jan 2025 00:21:00 -0000 https://status.steel.dev/incident/501482#abdf110644aa4ba2102c0be2055ee1882c312b85c0359f8f7ac575808258e04b Incident We're taking a look at a fix -- should be available soon! https://status.steel.dev/incident/500986 Fri, 24 Jan 2025 01:55:00 -0000 https://status.steel.dev/incident/500986#24b9f61692c6e2d0bca2fc3ce43a1f2147e84dce9ea8f9a10e96224dc29c0ce1 Incident We are back. https://status.steel.dev/incident/500986 Fri, 24 Jan 2025 01:54:00 -0000 https://status.steel.dev/incident/500986#5b869e3110980951e4c8845280f95a6c29a7707d7bff869631427b39b2c2c890 Incident This issue is related to our internal service. We're working on fixing the issue and service will be available again very soon. https://status.steel.dev/incident/500088 Wed, 22 Jan 2025 22:59:00 -0000 https://status.steel.dev/incident/500088#d79f72634e05ff81ea1d606174c02890821b54fb4934921e95c3b587c9b4a24a Incident We have identified the cause and pushed a fix! Things look somewhat stable now. https://status.steel.dev/incident/500088 Wed, 22 Jan 2025 14:32:00 -0000 https://status.steel.dev/incident/500088#89cb007c0bc11dca4f45a0f35bb415179fe145eecf712fcce8b3dc25c38ac5fc Incident We’re looking into it but session creation times have gone up a bit (P99 of 3.7 seconds) We will update this page once a fix is up! https://status.steel.dev/incident/495440 Tue, 14 Jan 2025 00:54:00 -0000 https://status.steel.dev/incident/495440#4a4add2514cc0e1578c3441ebbabd1d82bfd7b4741f9a0d347ec9b5249413706 Incident Live session views were down for about ~30 minutes due to an error with our session event persistence layer, everything should be good now! https://status.steel.dev/incident/479277 Tue, 17 Dec 2024 13:00:00 -0000 https://status.steel.dev/incident/479277#1d5e36cc24af3fd7253fe966bd5947b35126915300e0eeaed21298145c1489f6 Incident We have finally pushed the fixes for the session creation bugs -- sessions and other requests should be back to being quick and snappy! https://status.steel.dev/incident/479277 Mon, 16 Dec 2024 22:28:00 -0000 https://status.steel.dev/incident/479277#20c17a452a70775f427a6d0fd51f2562ac6b9f540dc2d11eb95d83dd2d923659 Incident Some requests are taking longer than normal -- we are on it, we'll have an update shortly https://status.steel.dev/incident/477215 Sat, 14 Dec 2024 00:15:00 -0000 https://status.steel.dev/incident/477215#27c473fea7433dcbf77d21eef8870a12f3626c79cc79dc8e5b751a4337e28e88 Incident We have pushed a temporary fix while we continue to work on a permanent solution. https://status.steel.dev/incident/477215 Fri, 13 Dec 2024 15:06:00 -0000 https://status.steel.dev/incident/477215#9895927408205deb0a453dcdf214ae70a52616d4abad8fba2e7b606c2010361a Incident We’re having some trouble with our machine locks during session creation. We’re working to fix the problem as quickly as we can. We’ll share another update shortly. https://status.steel.dev/incident/446973 Fri, 18 Oct 2024 19:51:00 -0000 https://status.steel.dev/incident/446973#aac13237d6382cbe94e4c54ac9d2d0ddf98266fd5973177aebfc2ab8021fbfc8 Incident Our API was briefly down for ~3 minutes as we scaled our cache. Everything should be back to normal.