February 2025

Login issues

February 17, 2025 4:17PM UTC

Login issuesService Disruption

Incident Status

Service Disruption

Components

Image Generation, Text Generation, Login

Locations

Coreweave

---

January 28, 2025 7:49PM UTC

[Investigating] We're aware of issues affecting the servers and are actively looking into the cause. We will keep you updated and thank you for your patience in the meantime. 現在サーバーに問題が起こっており、チームは原因を調査中です。最新情報を追ってお知らせいたします。ご迷惑をおかけいたしますが今しばらくお待ちください。

January 28, 2025 7:58PM UTC

[Identified] We have identified this as a major networking fault in the entire cluster and are in talks with our service provider, CoreWeave, about this issue.

January 28, 2025 8:23PM UTC

[Monitoring] All server issues have been resolved and should be back to working as usual. We'll be keeping an eye on things though! Sorry for the intermittent issues! サーバーの問題はすべて解決され、現在、通常通りご使用できるようになりました。今後も注意してモニターしてまいります。この度はご不便をおかけし、大変申し訳ありませんでした。

February 17, 2025 4:17PM UTC

[Resolved] This incident is resolved.

December 2024

Stability enhancement maintenance

December 17, 2024 4:45PM UTC

Stability enhancement maintenancePlanned Maintenance

Description

For stability reasons, we must carry out high priority maintenance for the NovelAI service. We expect this maintenance to finish after 30 minutes. Expect all NovelAI services to remain unstable in the maintenance period. Maintenance start: 2024-12-17 16:30 UTC Maintenance end: 2024-12-17 17:00 UTC

Components

Image Generation, Text Generation, Login

Locations

Coreweave

Schedule

December 17, 2024 4:30PM - December 17, 2024 5:00PM UTC

---

December 17, 2024 4:30PM UTC

[Update] Maintenance has started.

December 17, 2024 4:45PM UTC

[Update] Maintenance is complete.

Server issues

December 17, 2024 2:49PM UTC

Server issuesService Disruption

Incident Status

Service Disruption

Components

Image Generation, Text Generation, Login

Locations

Coreweave

---

December 17, 2024 12:05AM UTC

[Investigating] We're aware of issues affecting the servers and are actively looking into the cause. We will keep you updated and thank you for your patience in the meantime. 現在サーバーに問題が起こっており、チームは原因を調査中です。最新情報を追ってお知らせいたします。ご迷惑をおかけいたしますが今しばらくお待ちください。

December 17, 2024 12:22AM UTC

[Identified] We have identified this as a cluster fault which brought down critical internal services offline. We are in talks with our service provider, CoreWeave, about this issue.

December 17, 2024 12:41AM UTC

[Monitoring] The servers have stabilized and are operating normally again. Thank you for your understanding during the outage. We'll be keeping an eye on things and update you as needed! サーバーは復旧し、安定して再び通常通り稼動しております。復旧作業の間、ご理解いただきありがとうございました。今後も状況をモニターし、必要に応じて最新の状況をお知らせいたします。

December 17, 2024 2:49PM UTC

[Resolved] This maintenance is resolved.

Datacenter Power Issue

December 5, 2024 8:33PM UTC

Datacenter Power IssueDegraded Performance

Incident Status

Degraded Performance

Components

Website, Image Generation, Text Generation, Login, Payments

Locations

Github Pages, Coreweave, Cloudflare, Paddle

---

December 5, 2024 11:58AM UTC

[Identified] Our infrastructure provider, CoreWeave, is currently experiencing a power issue at one of their data centers. As a result, you may notice increased latencies as some of our hardware goes offline. In the worst-case scenario, this could lead to a full outage. We will provide updates as soon as we have more information. You can follow CoreWeave's incident at status.coreweave.com --- 現在、CoreWeaveに関連した障害が発生しており、サイトに影響が出ています。 チームは現在問題の解決に向けて、状況をモニターしつつ対応作業中です。 状況が変わり次第、随時お知らせいたします。しばらくの間ご不便をおかけいたしますが何卒ご了承ください。 障害の状況はこちらでご確認いただけます：status.coreweave.com

December 5, 2024 8:33PM UTC

[Resolved] All issues have been resolved and NovelAI.net is fully functioning again. The team is monitoring the status and we thank you for your patience! --- すべての問題が解決され、現在、NovelAI.netは再び正常に機能しております。 チームは継続して状況をモニターしてまいります。 皆様のご理解とご協力に感謝いたします！

November 2024

Issues with older text generation models

November 7, 2024 6:17PM UTC

Issues with older text generation modelsOperational

Incident Status

Operational

Components

Website, Image Generation, Text Generation, Login, Payments

Locations

Github Pages, Coreweave, Cloudflare, Paddle

---

November 7, 2024 4:42AM UTC

[Investigating] We are currently experiencing issues with our older text generation models. While this should not affect Erato and Kayra themselves, you may still encounter errors when Hypebot tries to generate a comment. Additionally, lorebook and story name generation may produce errors.

November 7, 2024 5:58AM UTC

[Identified] We have identified the issue and deployed emergency measures to stabilize the system while we analyze the root cause.

November 7, 2024 11:24AM UTC

[Monitoring] We've deployed a potential fix and are monitoring the situation now.

November 7, 2024 6:17PM UTC

[Resolved] This issue appears to be resolved now.

Server issues

November 6, 2024 2:11PM UTC

Server issuesPartial Service Disruption

Incident Status

Partial Service Disruption

Components

Image Generation, Text Generation, Login

Locations

Coreweave

---

November 5, 2024 9:46PM UTC

[Investigating] We're aware of issues affecting the servers and are actively looking into the cause. We will keep you updated and thank you for your patience in the meantime. 現在サーバーに問題が起こっており、チームは原因を調査中です。最新情報を追ってお知らせいたします。ご迷惑をおかけいたしますが今しばらくお待ちください。

November 5, 2024 10:04PM UTC

[Identified] We have identified this as an intermittent networking issue in our cluster. We've been in talks with CoreWeave, our service provider, about this issue. More information at status.coreweave.com/pages/incident/5e126e998f2f032e1f8f0f4b/672a927e092cb20534d5ef8f

November 6, 2024 12:33AM UTC

[Monitoring] The servers have stabilized and are operating normally again. Thank you for your understanding during the outage. We'll be keeping an eye on things and update you as needed! サーバーは復旧し、安定して再び通常通り稼動しております。復旧作業の間、ご理解いただきありがとうございました。今後も状況をモニターし、必要に応じて最新の状況をお知らせいたします。

November 6, 2024 2:11PM UTC

[Resolved] This incident is resolved.

Scheduled Maintenance and Service Interruption

November 5, 2024 11:54AM UTC

Scheduled Maintenance and Service InterruptionPlanned Maintenance

Description

We'll be undergoing a short temporary maintenance on the NovelAI backend for approximately one hour between 11:00 UTC and 12:00 UTC. We appreciate your patience and understanding! We will keep you updated as needed! --- ただいま、NovelAIバックエンドの臨時メンテナンスを行っております。予想される所要時間は1時間で、11:00(UTC)から12:00(UTC)までを予定しています。どうか皆様のご理解とご協力をお願いいたします。進捗状況につきましては随時お知らせいたします。

Components

Website, Image Generation, Text Generation, Login, Payments

Locations

Github Pages, Coreweave, Cloudflare, Paddle

Schedule

November 5, 2024 11:00AM - November 5, 2024 12:00PM UTC

---

November 5, 2024 11:54AM UTC

[Update] The disruptive parts of our maintenance are over, and things seem to have gone generally well. If you notice any issues, please let us know.

November 5, 2024 11:54AM UTC

[Update] We've completed our maintenance without any major issues.

October 2024

Slow Generations

October 15, 2024 12:43PM UTC

Slow GenerationsDegraded Performance

Incident Status

Degraded Performance

Components

Website, Image Generation, Text Generation, Login, Payments

Locations

Github Pages, Coreweave, Cloudflare, Paddle

---

October 15, 2024 12:20PM UTC

[Investigating] The team is aware of the generation issues currently affecting the service and is investigating the cause of them. We will keep you updated and thank you for your patience in the meantime. --- 現在AI生成に関して問題が起こっており、チームは原因を調査中です。最新情報を追ってお知らせいたします。ご迷惑をおかけいたしますが今しばらくお待ちください。

October 15, 2024 12:35PM UTC

[Monitoring] We believe we have identified the issue and are monitoring a potential fix.

October 15, 2024 12:43PM UTC

[Resolved] All server issues have been resolved and should be back to working as usual. We'll be keeping an eye on things though! Sorry for the intermittent issues! --- サーバーの問題はすべて解決され、現在、通常通りご使用できるようになりました。今後も注意してモニターしてまいります。この度はご不便をおかけし、大変申し訳ありませんでした。

High latency on story loading and saving

October 11, 2024 5:13PM UTC

High latency on story loading and savingDegraded Performance

Incident Status

Degraded Performance

Components

Login

Locations

Coreweave

---

October 7, 2024 4:15PM UTC

[Investigating] We're aware of issues affecting the servers and are actively looking into the cause. We will keep you updated and thank you for your patience in the meantime. 現在サーバーに問題が起こっており、チームは原因を調査中です。最新情報を追ってお知らせいたします。ご迷惑をおかけいたしますが今しばらくお待ちください。 --- This issue affects story saving and loading (which in turn, affects logins), leading to unexpected latencies and timeouts.

October 8, 2024 4:17PM UTC

[Identified] We identified this as a consistent networking issue between our core systems, and have been in talks with our service provider, CoreWeave, about this issue.

October 9, 2024 3:05PM UTC

[Identified] We continue to investigate the root cause of the networking issue with CoreWeave.

October 9, 2024 4:30PM UTC

[Identified] We have implemented a mitigation that should reduce the impact and loading times while our provider continues to work on resolving the root cause.

October 9, 2024 9:23PM UTC

[Monitoring] The mitigation has worked and logins are fast again. This incident will remain open as CoreWeave is investigating this issue.

October 11, 2024 5:13PM UTC

[Resolved] CoreWeave confirms they have found the cause for the networking issue and the core service is stable now. This issue is resolved.

Server issues

October 1, 2024 1:55PM UTC

Server issuesService Disruption

Incident Status

Service Disruption

Components

Image Generation, Text Generation, Login

Locations

Coreweave

---

September 30, 2024 11:49PM UTC

[Investigating] We're aware of issues affecting the servers and are actively looking into the cause. We will keep you updated and thank you for your patience in the meantime. 現在サーバーに問題が起こっており、チームは原因を調査中です。最新情報を追ってお知らせいたします。ご迷惑をおかけいたしますが今しばらくお待ちください。

October 1, 2024 12:03AM UTC

[Identified] We identified this as a cluster fault which brought many core production systems offline, and are in talks with our service provider, CoreWeave, about this issue.

October 1, 2024 12:37AM UTC

[Identified] We can see login / story fetching working for users, generation services are being worked on at the moment.

October 1, 2024 1:04AM UTC

[Identified] We continue to work with CoreWeave on this issue. At the moment, Clio (and older models), NovelAI Diffusion V2 (and older models) are functional. Kayra, Erato, and NovelAI Diffusion V3 are being worked on for their recovery.

October 1, 2024 3:33AM UTC

[Monitoring] The servers have stabilized and are operating normally again. Thank you for your understanding during the outage. We'll be keeping an eye on things and update you as needed! サーバーは復旧し、安定して再び通常通り稼動しております。復旧作業の間、ご理解いただきありがとうございました。今後も状況をモニターし、必要に応じて最新の状況をお知らせいたします。

October 1, 2024 1:55PM UTC

[Resolved] This incident is resolved.

September 2024

Part 2 of Cluster Migration Maintenance

September 30, 2024 9:59PM UTC

Part 2 of Cluster Migration MaintenancePlanned Maintenance

Description

NovelAI.net will be undergoing maintenance. This maintenance is required as part of the cluster migration we have been working on through the past couple of weeks. As such, NovelAI.net will be unstable and/or inaccessible in the following two maintenance windows: UTC: - Friday 27th 2024, starting at 1600 and ending at 1700 (1 hour) - Monday 30th 2024, starting at 1600 and ending at 2100 (5 hours) Pacific Time (UTC-7): - Friday 27th, starting at 0900, ending at 1000 - Monday 30th, starting at 0900, ending at 1400 Eastern Time (UTC-4): - Friday 27th, starting at 1200, ending at 1300 - Monday 30th, starting at 1200, ending at 1700 Central European Summer Time (UTC+2): - Friday 27th, starting at 1800, ending at 1900 - Monday 30th, starting at 1800, ending at 2300 Japan Standard Time (UTC+9): - Saturday 28th, starting at 0100, ending at 0200 - Tuesday 1st October, starting at 0100, ending at 0600 We apologize for any inconvenience this may cause and appreciate your understanding. --- 計画メンテナンスとサービス停止のお知らせ NovelAI.netではメンテナンスを予定しております。このメンテナンスは数週間前から実施しているクラスター移行作業の一環で必要なものとなります。 これに伴い、下記2回の時間帯でNovelAI.netが不安定になるかアクセスできない状態になります。 - 2024年9月28日（土） 午前1:00～午前2:00 [日本標準時]（1時間） - 2024年10月1日（火） 午前1:00～午前6:00 [日本標準時]（5時間） ご不便をおかけして誠に申し訳ございませんが、ご理解いただきますようお願い申し上げます。

Components

Image Generation, Text Generation, Login

Locations

Coreweave, Cloudflare

Schedule

September 30, 2024 4:00PM - September 30, 2024 9:00PM UTC

---

September 30, 2024 4:01PM UTC

[Update] Maintenance has started.

September 30, 2024 6:20PM UTC

[Update] Maintenance is ongoing. Expect generation services to remain unstable throughout the maintenance window.

September 30, 2024 9:01PM UTC

[Update] Due to a cluster fault causing majority of the generation nodes to go offline, we're extending the maintenance window by one hour as we coordinate with our service provider, CoreWeave.

September 30, 2024 9:59PM UTC

[Update] Maintenance is complete as we see recovery of generation services. Thank you for your understanding during this period. We'll be keeping an eye on things and update you as needed! サーバーは復旧し、安定して再び通常通り稼動しております。復旧作業の間、ご理解いただきありがとうございました。今後も状況をモニターし、必要に応じて最新の状況をお知らせいたします。

Scheduled Maintenance and Service Interruption

September 27, 2024 5:48PM UTC

Scheduled Maintenance and Service InterruptionPlanned Maintenance

Description

NovelAI.net will be undergoing maintenance. This maintenance is required as part of the cluster migration we have been working on through the past couple of weeks. As such, NovelAI.net will be unstable and/or inaccessible in the following two maintenance windows: UTC: - Friday 27th 2024, starting at 1600 and ending at 1700 (1 hour) - Monday 30th 2024, starting at 1600 and ending at 2100 (5 hours) Pacific Time (UTC-7): - Friday 27th, starting at 0900, ending at 1000 - Monday 30th, starting at 0900, ending at 1400 Eastern Time (UTC-4): - Friday 27th, starting at 1200, ending at 1300 - Monday 30th, starting at 1200, ending at 1700 Central European Summer Time (UTC+2): - Friday 27th, starting at 1800, ending at 1900 - Monday 30th, starting at 1800, ending at 2300 Japan Standard Time (UTC+9): - Saturday 28th, starting at 0100, ending at 0200 - Tuesday 1st October, starting at 0100, ending at 0600 We apologize for any inconvenience this may cause and appreciate your understanding.

Components

Image Generation, Text Generation, Login

Locations

Coreweave, Cloudflare

Schedule

September 27, 2024 4:00PM - September 27, 2024 5:00PM UTC

---

September 27, 2024 4:03PM UTC

[Update] Maintenance has started.

September 27, 2024 4:56PM UTC

[Update] We're extending maintenance by one extra hour.

September 27, 2024 5:44PM UTC

[Update] Part 1 of Cluster Migration Maintenance is complete

September 27, 2024 5:48PM UTC

[Update] NovelAI.net is back online

Login & Generation Outage

September 26, 2024 10:59AM UTC

Login & Generation OutageService Disruption

Incident Status

Service Disruption

Components

Website, Image Generation, Text Generation, Login, Payments

Locations

Github Pages, Coreweave, Cloudflare, Paddle

---

September 25, 2024 4:02PM UTC

[Investigating] We're currently experiencing some CoreWeave related outages. The team is aware and actively looking into the situation. We will keep you updated as things change and appreciate your patience in the meantime. --- 現在、CoreWeaveに関連した障害が発生しております。 チームは現在、問題の解決に向けて状況をモニターしつつ対応作業中です。最新情報を追ってお知らせいたします。ご不便をおかけし誠に申し訳ありませんが、ご理解とご協力をお願いいたします。

September 25, 2024 4:12PM UTC

[Identified] We identified this as a cluster networking issue and are in talks with our service provider, CoreWeave. We also see ongoing recovery across our metrics, we'll keep you updated as this incident progresses. More information on status.coreweave.com/pages/incident/5e126e998f2f032e1f8f0f4b/66f436057c63fe64a2877ae1

September 25, 2024 4:49PM UTC

[Monitoring] CoreWeave believes the issue has been mitigated. We are continuing to monitor our services.

September 26, 2024 10:59AM UTC

[Resolved] Networking appears to be stable again, and this issue has been resolved.

Generation time outs

September 25, 2024 1:58PM UTC

Generation time outsOperational

Incident Status

Operational

Components

Image Generation, Text Generation

Locations

Coreweave

---

September 24, 2024 7:14PM UTC

[Investigating] We're aware of issues affecting the servers and are actively looking into the cause. We will keep you updated and thank you for your patience in the meantime. 現在サーバーに問題が起こっており、チームは原因を調査中です。最新情報を追ってお知らせいたします。ご迷惑をおかけいたしますが今しばらくお待ちください。

September 24, 2024 7:31PM UTC

[Identified] We identified this as a cluster networking issue and are in talks with our service provider, CoreWeave.

September 24, 2024 8:25PM UTC

[Identified] This cluster issue is preventing our inference services from operating at full capacity, leading to generation timeouts. We continue to communicate with CoreWeave about this incident. More information on status.coreweave.com/pages/incident/5e126e998f2f032e1f8f0f4b/66f2f7d68bf9f2649b51c2eb

September 24, 2024 10:10PM UTC

[Monitoring] The servers have stabilized and are operating normally again. Thank you for your understanding during the outage. We'll be keeping an eye on things and update you as needed! サーバーは復旧し、安定して再び通常通り稼動しております。復旧作業の間、ご理解いただきありがとうございました。今後も状況をモニターし、必要に応じて最新の状況をお知らせいたします。

September 25, 2024 1:58PM UTC

[Resolved] This incident is resolved.

Server issues

September 24, 2024 7:12PM UTC

Server issuesService Disruption

Incident Status

Service Disruption

Components

Image Generation, Text Generation

Locations

Coreweave

---

September 19, 2024 8:01PM UTC

[Investigating] We're aware of issues affecting the servers and are actively looking into the cause. We will keep you updated and thank you for your patience in the meantime. 現在サーバーに問題が起こっており、チームは原因を調査中です。最新情報を追ってお知らせいたします。ご迷惑をおかけいたしますが今しばらくお待ちください。

September 19, 2024 8:09PM UTC

[Identified] We identified this as a cluster networking issue and are making fixes while talking to our service provider, CoreWeave.

September 19, 2024 8:32PM UTC

[Monitoring] The servers have stabilized and are operating normally again. Thank you for your understanding during the outage. We'll be keeping an eye on things and update you as needed! サーバーは復旧し、安定して再び通常通り稼動しております。復旧作業の間、ご理解いただきありがとうございました。今後も状況をモニターし、必要に応じて最新の状況をお知らせいたします。

September 24, 2024 7:12PM UTC

[Resolved] This incident is resolved

Image Generation Errors

September 19, 2024 8:01PM UTC

Image Generation ErrorsPartial Service Disruption

Incident Status

Partial Service Disruption

Components

Image Generation

Locations

Coreweave

---

September 17, 2024 9:42PM UTC

[Investigating] We are currently experiencing an issue with image generation and our team is working on a fix. We apologize for the inconvenience and ask for your patience. We will keep you updated on the progress of the fix as soon as possible.

September 17, 2024 9:57PM UTC

[Identified] We identified this as a cluster fault. We have escalated this issue to our service provider, CoreWeave and will update you as it progresses.

September 17, 2024 10:38PM UTC

[Monitoring] The servers have stabilized and are operating normally again. Thank you for your understanding during the outage. We'll be keeping an eye on things and update you as needed! サーバーは復旧し、安定して再び通常通り稼動しております。復旧作業の間、ご理解いただきありがとうございました。今後も状況をモニターし、必要に応じて最新の状況をお知らせいたします。

September 19, 2024 8:01PM UTC

[Resolved] This incident is resolved

Server issues

September 5, 2024 2:53PM UTC

Server issuesPartial Service Disruption

Incident Status

Partial Service Disruption

Components

Image Generation, Text Generation, Login

Locations

Coreweave

---

September 4, 2024 1:10AM UTC

[Investigating] We're aware of issues affecting the servers and are actively looking into the cause. We will keep you updated and thank you for your patience in the meantime. 現在サーバーに問題が起こっており、チームは原因を調査中です。最新情報を追ってお知らせいたします。ご迷惑をおかけいたしますが今しばらくお待ちください。

September 4, 2024 1:25AM UTC

[Identified] We identified this as an internal cluster networking issue and are in talks with CoreWeave to resolve it. More information on status.coreweave.com/pages/incident/5e126e998f2f032e1f8f0f4b/66d7af0bf205ea33ce7e8cd1

September 4, 2024 3:15AM UTC

[Monitoring] We have deployed fixes to the cluster and see slow but upwards recovery of all generation services.

September 4, 2024 3:36AM UTC

[Monitoring] The servers have stabilized and are operating normally again. Thank you for your understanding during the outage. We'll be keeping an eye on things and update you as needed! サーバーは復旧し、安定して再び通常通り稼動しております。復旧作業の間、ご理解いただきありがとうございました。今後も状況をモニターし、必要に応じて最新の状況をお知らせいたします。

September 5, 2024 2:53PM UTC

[Resolved] This incident is closed.

August 2024

Server issues

August 15, 2024 3:52PM UTC

Server issuesService Disruption

Incident Status

Service Disruption

Components

Image Generation, Text Generation, Login

Locations

Coreweave

---

August 14, 2024 9:01PM UTC

[Investigating] We're aware of issues affecting the servers and are actively looking into the cause. We will keep you updated and thank you for your patience in the meantime. 現在サーバーに問題が起こっており、チームは原因を調査中です。最新情報を追ってお知らせいたします。ご迷惑をおかけいたしますが今しばらくお待ちください。

August 14, 2024 9:09PM UTC

[Identified] The issue has been identified to a faulty node within the cluster tht runs a critical component and are in conversations with CoreWeave.

August 14, 2024 9:34PM UTC

[Identified] We have switched the component to a different node and are observing slow recovery across the other components. Expect some instability as recovery continues.

August 14, 2024 9:55PM UTC

[Monitoring] The servers have stabilized and are operating normally again. Thank you for your understanding during the outage. We'll be keeping an eye on things and update you as needed! サーバーは復旧し、安定して再び通常通り稼動しております。復旧作業の間、ご理解いただきありがとうございました。今後も状況をモニターし、必要に応じて最新の状況をお知らせいたします。

August 15, 2024 3:52PM UTC

[Resolved] This incident is resolved.

Scheduled Maintenance and Service Interruption

August 14, 2024 4:36PM UTC

Scheduled Maintenance and Service InterruptionPlanned Maintenance

Description

We need to inform you that NovelAI will be temporarily unavailable due to essential maintenance by our infrastructure provider. This maintenance requires relocating some critical components, resulting in planned downtime. The service interruption is scheduled to start at: - Aug 14th, 09:00 Pacific Time - Aug 14th, 12:00 Eastern Time - Aug 14th, 18:00 Central European Summer Time - Aug 15th, 01:00 Japan Standard Time We expect the downtime to last less than one hour. We apologize for any inconvenience this may cause and appreciate your understanding. --- 計画メンテナンスとサービス停止のお知らせ NovelAIは、インフラプロバイダーによるメンテナンスのため、一時的にサービスを停止させていただきます。このメンテナンスでは、いくつかの重要なコンポーネントを再配置する必要があるため、計画的なダウンタイムが発生します。 サービス停止の開始予定: - 8月14日 09:00 太平洋時間 - 8月14日 12:00 東部時間 - 8月14日 18:00 中央ヨーロッパ夏時間 - 8月15日 01:00 日本標準時 ダウンタイムは1時間以下を予定しています。 ご不便をおかけして誠に申し訳ございませんが、ご理解いただきますようお願い申し上げます。

Components

Website, Image Generation, Text Generation, Login, Payments

Locations

Github Pages, Coreweave, Cloudflare, Paddle

Schedule

August 14, 2024 4:00PM - August 14, 2024 5:00PM UTC

---

August 14, 2024 4:07PM UTC

[Update] Maintenance has started.

August 14, 2024 4:34PM UTC

[Update] We have sucessfully relocated all necessary components. Total downtime was 5 minutes.

August 14, 2024 4:36PM UTC

[Update] Maintenance is complete.

Errors in Text Generation for Trial Users and Third-Party Frontends

August 14, 2024 8:55AM UTC

Errors in Text Generation for Trial Users and Third-Party FrontendsPartial Service Disruption

Incident Status

Partial Service Disruption

Components

Website, Image Generation, Text Generation, Login, Payments

Locations

Github Pages, Coreweave, Cloudflare, Paddle

---

August 14, 2024 8:02AM UTC

[Investigating] We are aware of issues affecting text generation requests made through api.novelai.net. Trial users and those using third-party frontends may encounter errors when attempting to generate text. To the best of our knowledge, users of our official frontend are not impacted.

August 14, 2024 8:31AM UTC

[Identified] We have identified the root cause of the issue and are actively working on a fix. In the meantime, we have implemented a manual workaround that should allow Kayra text generation requests to function again.

August 14, 2024 8:55AM UTC

[Resolved] We have applied a fix and believe the issue is now fully resolved.