[PR #290] [MERGED] feat: create robots.txt and sitemap.xml #851

Closed
opened 2026-02-26 19:30:45 +03:00 by kerem · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/documenso/documenso/pull/290
Author: @nsylke
Created: 8/22/2023
Status: Merged
Merged: 8/23/2023
Merged by: @Mythie

Base: feat/refreshHead: nsylke-patch-5


📝 Commits (1)

  • 04f9422 feat: robots.txt & sitemap.xml

📊 Changes

2 files changed (+55 additions, -0 deletions)

View changed files

apps/marketing/src/app/robots.ts (+14 -0)
apps/marketing/src/app/sitemap.ts (+41 -0)

📄 Description

With the latest versions of Next.js we can automatically generate robots & sitemap files.

In the robots.txt we are allowing all paths except for _next since those files don't need to be crawled.

In the sitemap.xml we are setting all the pages that have been explicitly created and then automatically pulling all generic and blog posts from contentlayer. The sitemap entries are alphabetized based on the directories inside of app/.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/documenso/documenso/pull/290 **Author:** [@nsylke](https://github.com/nsylke) **Created:** 8/22/2023 **Status:** ✅ Merged **Merged:** 8/23/2023 **Merged by:** [@Mythie](https://github.com/Mythie) **Base:** `feat/refresh` ← **Head:** `nsylke-patch-5` --- ### 📝 Commits (1) - [`04f9422`](https://github.com/documenso/documenso/commit/04f9422f244d7d41ef0002d4bd6611d2695f4ad9) feat: robots.txt & sitemap.xml ### 📊 Changes **2 files changed** (+55 additions, -0 deletions) <details> <summary>View changed files</summary> ➕ `apps/marketing/src/app/robots.ts` (+14 -0) ➕ `apps/marketing/src/app/sitemap.ts` (+41 -0) </details> ### 📄 Description With the latest versions of Next.js we can automatically generate robots & sitemap files. In the `robots.txt` we are allowing all paths except for `_next` since those files don't need to be crawled. In the `sitemap.xml` we are setting all the pages that have been explicitly created and then automatically pulling all generic and blog posts from contentlayer. The sitemap entries are alphabetized based on the directories inside of `app/`. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
kerem 2026-02-26 19:30:45 +03:00
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference
starred/documenso#851
No description provided.