You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

754 lines
20 KiB

Git LFS support v2 (#122) * Import github.com/git-lfs/lfs-test-server as lfs module base Imported commit is 3968aac269a77b73924649b9412ae03f7ccd3198 Removed: Dockerfile CONTRIBUTING.md mgmt* script/ vendor/ kvlogger.go .dockerignore .gitignore README.md * Remove config, add JWT support from github.com/mgit-at/lfs-test-server Imported commit f0cdcc5a01599c5a955dc1bbf683bb4acecdba83 * Add LFS settings * Add LFS meta object model * Add LFS routes and initialization * Import github.com/dgrijalva/jwt-go into vendor/ * Adapt LFS module: handlers, routing, meta store * Move LFS routes to /user/repo/info/lfs/* * Add request header checks to LFS BatchHandler / PostHandler * Implement LFS basic authentication * Rework JWT secret generation / load * Implement LFS SSH token authentication with JWT Specification: https://github.com/github/git-lfs/tree/master/docs/api * Integrate LFS settings into install process * Remove LFS objects when repository is deleted Only removes objects from content store when deleted repo is the only referencing repository * Make LFS module stateless Fixes bug where LFS would not work after installation without restarting Gitea * Change 500 'Internal Server Error' to 400 'Bad Request' * Change sql query to xorm call * Remove unneeded type from LFS module * Change internal imports to code.gitea.io/gitea/ * Add Gitea authors copyright * Change basic auth realm to "gitea-lfs" * Add unique indexes to LFS model * Use xorm count function in LFS check on repository delete * Return io.ReadCloser from content store and close after usage * Add LFS info to runWeb() * Export LFS content store base path * LFS file download from UI * Work around git-lfs client issue with unauthenticated requests Returning a dummy Authorization header for unauthenticated requests lets git-lfs client skip asking for auth credentials See: https://github.com/github/git-lfs/issues/1088 * Fix unauthenticated UI downloads from public repositories * Authentication check order, Finish LFS file view logic * Ignore LFS hooks if installed for current OS user Fixes Gitea UI actions for repositories tracking LFS files. Checks for minimum needed git version by parsing the semantic version string. * Hide LFS metafile diff from commit view, marking as binary * Show LFS notice if file in commit view is tracked * Add notbefore/nbf JWT claim * Correct lint suggestions - comments for structs and functions - Add comments to LFS model - Function comment for GetRandomBytesAsBase64 - LFS server function comments and lint variable suggestion * Move secret generation code out of conditional Ensures no LFS code may run with an empty secret * Do not hand out JWT tokens if LFS server support is disabled
8 years ago
Improve listing performance by using go-git (#6478) * Use go-git for tree reading and commit info lookup. Signed-off-by: Filip Navara <navara@emclient.com> * Use TreeEntry.IsRegular() instead of ObjectType that was removed. Signed-off-by: Filip Navara <navara@emclient.com> * Use the treePath to optimize commit info search. Signed-off-by: Filip Navara <navara@emclient.com> * Extract the latest commit at treePath along with the other commits. Signed-off-by: Filip Navara <navara@emclient.com> * Fix listing commit info for a directory that was created in one commit and never modified after. Signed-off-by: Filip Navara <navara@emclient.com> * Avoid nearly all external 'git' invocations when doing directory listing (.editorconfig code path is still hit). Signed-off-by: Filip Navara <navara@emclient.com> * Use go-git for reading blobs. Signed-off-by: Filip Navara <navara@emclient.com> * Make SHA1 type alias for plumbing.Hash in go-git. Signed-off-by: Filip Navara <navara@emclient.com> * Make Signature type alias for object.Signature in go-git. Signed-off-by: Filip Navara <navara@emclient.com> * Fix GetCommitsInfo for repository with only one commit. Signed-off-by: Filip Navara <navara@emclient.com> * Fix PGP signature verification. Signed-off-by: Filip Navara <navara@emclient.com> * Fix issues with walking commit graph across merges. Signed-off-by: Filip Navara <navara@emclient.com> * Fix typo in condition. Signed-off-by: Filip Navara <navara@emclient.com> * Speed up loading branch list by keeping the repository reference (and thus all the loaded packfile indexes). Signed-off-by: Filip Navara <navara@emclient.com> * Fix lising submodules. Signed-off-by: Filip Navara <navara@emclient.com> * Fix build Signed-off-by: Filip Navara <navara@emclient.com> * Add back commit cache because of name-rev Signed-off-by: Filip Navara <navara@emclient.com> * Fix tests Signed-off-by: Filip Navara <navara@emclient.com> * Fix code style * Fix spelling * Address PR feedback Signed-off-by: Filip Navara <navara@emclient.com> * Update vendor module list Signed-off-by: Filip Navara <navara@emclient.com> * Fix getting trees by commit id Signed-off-by: Filip Navara <navara@emclient.com> * Fix remaining unit test failures * Fix GetTreeBySHA * Avoid running `git name-rev` if not necessary Signed-off-by: Filip Navara <navara@emclient.com> * Move Branch code to git module * Clean up GPG signature verification and fix it for tagged commits * Address PR feedback (import formatting, copyright headers) * Make blob lookup by SHA working * Update tests to use public API * Allow getting content from any type of object through the blob interface * Change test to actually expect the object content that is in the GIT repository * Change one more test to actually expect the object content that is in the GIT repository * Add comments
5 years ago
Better logging (#6038) (#6095) * Panic don't fatal on create new logger Fixes #5854 Signed-off-by: Andrew Thornton <art27@cantab.net> * partial broken * Update the logging infrastrcture Signed-off-by: Andrew Thornton <art27@cantab.net> * Reset the skip levels for Fatal and Error Signed-off-by: Andrew Thornton <art27@cantab.net> * broken ncsa * More log.Error fixes Signed-off-by: Andrew Thornton <art27@cantab.net> * Remove nal * set log-levels to lowercase * Make console_test test all levels * switch to lowercased levels * OK now working * Fix vetting issues * Fix lint * Fix tests * change default logging to match current gitea * Improve log testing Signed-off-by: Andrew Thornton <art27@cantab.net> * reset error skip levels to 0 * Update documentation and access logger configuration * Redirect the router log back to gitea if redirect macaron log but also allow setting the log level - i.e. TRACE * Fix broken level caching * Refactor the router log * Add Router logger * Add colorizing options * Adjust router colors * Only create logger if they will be used * update app.ini.sample * rename Attribute ColorAttribute * Change from white to green for function * Set fatal/error levels * Restore initial trace logger * Fix Trace arguments in modules/auth/auth.go * Properly handle XORMLogger * Improve admin/config page * fix fmt * Add auto-compression of old logs * Update error log levels * Remove the unnecessary skip argument from Error, Fatal and Critical * Add stacktrace support * Fix tests * Remove x/sync from vendors? * Add stderr option to console logger * Use filepath.ToSlash to protect against Windows in tests * Remove prefixed underscores from names in colors.go * Remove not implemented database logger This was removed from Gogs on 4 Mar 2016 but left in the configuration since then. * Ensure that log paths are relative to ROOT_PATH * use path.Join * rename jsonConfig to logConfig * Rename "config" to "jsonConfig" to make it clearer * Requested changes * Requested changes: XormLogger * Try to color the windows terminal If successful default to colorizing the console logs * fixup * Colorize initially too * update vendor * Colorize logs on default and remove if this is not a colorizing logger * Fix documentation * fix test * Use go-isatty to detect if on windows we are on msys or cygwin * Fix spelling mistake * Add missing vendors * More changes * Rationalise the ANSI writer protection * Adjust colors on advice from @0x5c * Make Flags a comma separated list * Move to use the windows constant for ENABLE_VIRTUAL_TERMINAL_PROCESSING * Ensure matching is done on the non-colored message - to simpify EXPRESSION
5 years ago
10 years ago
Git LFS support v2 (#122) * Import github.com/git-lfs/lfs-test-server as lfs module base Imported commit is 3968aac269a77b73924649b9412ae03f7ccd3198 Removed: Dockerfile CONTRIBUTING.md mgmt* script/ vendor/ kvlogger.go .dockerignore .gitignore README.md * Remove config, add JWT support from github.com/mgit-at/lfs-test-server Imported commit f0cdcc5a01599c5a955dc1bbf683bb4acecdba83 * Add LFS settings * Add LFS meta object model * Add LFS routes and initialization * Import github.com/dgrijalva/jwt-go into vendor/ * Adapt LFS module: handlers, routing, meta store * Move LFS routes to /user/repo/info/lfs/* * Add request header checks to LFS BatchHandler / PostHandler * Implement LFS basic authentication * Rework JWT secret generation / load * Implement LFS SSH token authentication with JWT Specification: https://github.com/github/git-lfs/tree/master/docs/api * Integrate LFS settings into install process * Remove LFS objects when repository is deleted Only removes objects from content store when deleted repo is the only referencing repository * Make LFS module stateless Fixes bug where LFS would not work after installation without restarting Gitea * Change 500 'Internal Server Error' to 400 'Bad Request' * Change sql query to xorm call * Remove unneeded type from LFS module * Change internal imports to code.gitea.io/gitea/ * Add Gitea authors copyright * Change basic auth realm to "gitea-lfs" * Add unique indexes to LFS model * Use xorm count function in LFS check on repository delete * Return io.ReadCloser from content store and close after usage * Add LFS info to runWeb() * Export LFS content store base path * LFS file download from UI * Work around git-lfs client issue with unauthenticated requests Returning a dummy Authorization header for unauthenticated requests lets git-lfs client skip asking for auth credentials See: https://github.com/github/git-lfs/issues/1088 * Fix unauthenticated UI downloads from public repositories * Authentication check order, Finish LFS file view logic * Ignore LFS hooks if installed for current OS user Fixes Gitea UI actions for repositories tracking LFS files. Checks for minimum needed git version by parsing the semantic version string. * Hide LFS metafile diff from commit view, marking as binary * Show LFS notice if file in commit view is tracked * Add notbefore/nbf JWT claim * Correct lint suggestions - comments for structs and functions - Add comments to LFS model - Function comment for GetRandomBytesAsBase64 - LFS server function comments and lint variable suggestion * Move secret generation code out of conditional Ensures no LFS code may run with an empty secret * Do not hand out JWT tokens if LFS server support is disabled
8 years ago
Git LFS support v2 (#122) * Import github.com/git-lfs/lfs-test-server as lfs module base Imported commit is 3968aac269a77b73924649b9412ae03f7ccd3198 Removed: Dockerfile CONTRIBUTING.md mgmt* script/ vendor/ kvlogger.go .dockerignore .gitignore README.md * Remove config, add JWT support from github.com/mgit-at/lfs-test-server Imported commit f0cdcc5a01599c5a955dc1bbf683bb4acecdba83 * Add LFS settings * Add LFS meta object model * Add LFS routes and initialization * Import github.com/dgrijalva/jwt-go into vendor/ * Adapt LFS module: handlers, routing, meta store * Move LFS routes to /user/repo/info/lfs/* * Add request header checks to LFS BatchHandler / PostHandler * Implement LFS basic authentication * Rework JWT secret generation / load * Implement LFS SSH token authentication with JWT Specification: https://github.com/github/git-lfs/tree/master/docs/api * Integrate LFS settings into install process * Remove LFS objects when repository is deleted Only removes objects from content store when deleted repo is the only referencing repository * Make LFS module stateless Fixes bug where LFS would not work after installation without restarting Gitea * Change 500 'Internal Server Error' to 400 'Bad Request' * Change sql query to xorm call * Remove unneeded type from LFS module * Change internal imports to code.gitea.io/gitea/ * Add Gitea authors copyright * Change basic auth realm to "gitea-lfs" * Add unique indexes to LFS model * Use xorm count function in LFS check on repository delete * Return io.ReadCloser from content store and close after usage * Add LFS info to runWeb() * Export LFS content store base path * LFS file download from UI * Work around git-lfs client issue with unauthenticated requests Returning a dummy Authorization header for unauthenticated requests lets git-lfs client skip asking for auth credentials See: https://github.com/github/git-lfs/issues/1088 * Fix unauthenticated UI downloads from public repositories * Authentication check order, Finish LFS file view logic * Ignore LFS hooks if installed for current OS user Fixes Gitea UI actions for repositories tracking LFS files. Checks for minimum needed git version by parsing the semantic version string. * Hide LFS metafile diff from commit view, marking as binary * Show LFS notice if file in commit view is tracked * Add notbefore/nbf JWT claim * Correct lint suggestions - comments for structs and functions - Add comments to LFS model - Function comment for GetRandomBytesAsBase64 - LFS server function comments and lint variable suggestion * Move secret generation code out of conditional Ensures no LFS code may run with an empty secret * Do not hand out JWT tokens if LFS server support is disabled
8 years ago
Git LFS support v2 (#122) * Import github.com/git-lfs/lfs-test-server as lfs module base Imported commit is 3968aac269a77b73924649b9412ae03f7ccd3198 Removed: Dockerfile CONTRIBUTING.md mgmt* script/ vendor/ kvlogger.go .dockerignore .gitignore README.md * Remove config, add JWT support from github.com/mgit-at/lfs-test-server Imported commit f0cdcc5a01599c5a955dc1bbf683bb4acecdba83 * Add LFS settings * Add LFS meta object model * Add LFS routes and initialization * Import github.com/dgrijalva/jwt-go into vendor/ * Adapt LFS module: handlers, routing, meta store * Move LFS routes to /user/repo/info/lfs/* * Add request header checks to LFS BatchHandler / PostHandler * Implement LFS basic authentication * Rework JWT secret generation / load * Implement LFS SSH token authentication with JWT Specification: https://github.com/github/git-lfs/tree/master/docs/api * Integrate LFS settings into install process * Remove LFS objects when repository is deleted Only removes objects from content store when deleted repo is the only referencing repository * Make LFS module stateless Fixes bug where LFS would not work after installation without restarting Gitea * Change 500 'Internal Server Error' to 400 'Bad Request' * Change sql query to xorm call * Remove unneeded type from LFS module * Change internal imports to code.gitea.io/gitea/ * Add Gitea authors copyright * Change basic auth realm to "gitea-lfs" * Add unique indexes to LFS model * Use xorm count function in LFS check on repository delete * Return io.ReadCloser from content store and close after usage * Add LFS info to runWeb() * Export LFS content store base path * LFS file download from UI * Work around git-lfs client issue with unauthenticated requests Returning a dummy Authorization header for unauthenticated requests lets git-lfs client skip asking for auth credentials See: https://github.com/github/git-lfs/issues/1088 * Fix unauthenticated UI downloads from public repositories * Authentication check order, Finish LFS file view logic * Ignore LFS hooks if installed for current OS user Fixes Gitea UI actions for repositories tracking LFS files. Checks for minimum needed git version by parsing the semantic version string. * Hide LFS metafile diff from commit view, marking as binary * Show LFS notice if file in commit view is tracked * Add notbefore/nbf JWT claim * Correct lint suggestions - comments for structs and functions - Add comments to LFS model - Function comment for GetRandomBytesAsBase64 - LFS server function comments and lint variable suggestion * Move secret generation code out of conditional Ensures no LFS code may run with an empty secret * Do not hand out JWT tokens if LFS server support is disabled
8 years ago
API add/generalize pagination (#9452) * paginate results * fixed deadlock * prevented breaking change * updated swagger * go fmt * fixed find topic * go mod tidy * go mod vendor with go1.13.5 * fixed repo find topics * fixed unit test * added Limit method to Engine struct; use engine variable when provided; fixed gitignore * use ItemsPerPage for default pagesize; fix GetWatchers, getOrgUsersByOrgID and GetStargazers; fix GetAllCommits headers; reverted some changed behaviors * set Page value on Home route * improved memory allocations * fixed response headers * removed logfiles * fixed import order * import order * improved swagger * added function to get models.ListOptions from context * removed pagesize diff on unit test * fixed imports * removed unnecessary struct field * fixed go fmt * scoped PR * code improvements * code improvements * go mod tidy * fixed import order * fixed commit statuses session * fixed files headers * fixed headers; added pagination for notifications * go mod tidy * go fmt * removed Private from user search options; added setting.UI.IssuePagingNum as default valeu on repo's issues list * Apply suggestions from code review Co-Authored-By: 6543 <6543@obermui.de> Co-Authored-By: zeripath <art27@cantab.net> * fixed build error * CI.restart() * fixed merge conflicts resolve * fixed conflicts resolve * improved FindTrackedTimesOptions.ToOptions() method * added backwards compatibility on ListReleases request; fixed issue tracked time ToSession * fixed build error; fixed swagger template * fixed swagger template * fixed ListReleases backwards compatibility * added page to user search route Co-authored-by: techknowlogick <matti@mdranta.net> Co-authored-by: 6543 <6543@obermui.de> Co-authored-by: zeripath <art27@cantab.net>
4 years ago
API add/generalize pagination (#9452) * paginate results * fixed deadlock * prevented breaking change * updated swagger * go fmt * fixed find topic * go mod tidy * go mod vendor with go1.13.5 * fixed repo find topics * fixed unit test * added Limit method to Engine struct; use engine variable when provided; fixed gitignore * use ItemsPerPage for default pagesize; fix GetWatchers, getOrgUsersByOrgID and GetStargazers; fix GetAllCommits headers; reverted some changed behaviors * set Page value on Home route * improved memory allocations * fixed response headers * removed logfiles * fixed import order * import order * improved swagger * added function to get models.ListOptions from context * removed pagesize diff on unit test * fixed imports * removed unnecessary struct field * fixed go fmt * scoped PR * code improvements * code improvements * go mod tidy * fixed import order * fixed commit statuses session * fixed files headers * fixed headers; added pagination for notifications * go mod tidy * go fmt * removed Private from user search options; added setting.UI.IssuePagingNum as default valeu on repo's issues list * Apply suggestions from code review Co-Authored-By: 6543 <6543@obermui.de> Co-Authored-By: zeripath <art27@cantab.net> * fixed build error * CI.restart() * fixed merge conflicts resolve * fixed conflicts resolve * improved FindTrackedTimesOptions.ToOptions() method * added backwards compatibility on ListReleases request; fixed issue tracked time ToSession * fixed build error; fixed swagger template * fixed swagger template * fixed ListReleases backwards compatibility * added page to user search route Co-authored-by: techknowlogick <matti@mdranta.net> Co-authored-by: 6543 <6543@obermui.de> Co-authored-by: zeripath <art27@cantab.net>
4 years ago
9 years ago
9 years ago
API add/generalize pagination (#9452) * paginate results * fixed deadlock * prevented breaking change * updated swagger * go fmt * fixed find topic * go mod tidy * go mod vendor with go1.13.5 * fixed repo find topics * fixed unit test * added Limit method to Engine struct; use engine variable when provided; fixed gitignore * use ItemsPerPage for default pagesize; fix GetWatchers, getOrgUsersByOrgID and GetStargazers; fix GetAllCommits headers; reverted some changed behaviors * set Page value on Home route * improved memory allocations * fixed response headers * removed logfiles * fixed import order * import order * improved swagger * added function to get models.ListOptions from context * removed pagesize diff on unit test * fixed imports * removed unnecessary struct field * fixed go fmt * scoped PR * code improvements * code improvements * go mod tidy * fixed import order * fixed commit statuses session * fixed files headers * fixed headers; added pagination for notifications * go mod tidy * go fmt * removed Private from user search options; added setting.UI.IssuePagingNum as default valeu on repo's issues list * Apply suggestions from code review Co-Authored-By: 6543 <6543@obermui.de> Co-Authored-By: zeripath <art27@cantab.net> * fixed build error * CI.restart() * fixed merge conflicts resolve * fixed conflicts resolve * improved FindTrackedTimesOptions.ToOptions() method * added backwards compatibility on ListReleases request; fixed issue tracked time ToSession * fixed build error; fixed swagger template * fixed swagger template * fixed ListReleases backwards compatibility * added page to user search route Co-authored-by: techknowlogick <matti@mdranta.net> Co-authored-by: 6543 <6543@obermui.de> Co-authored-by: zeripath <art27@cantab.net>
4 years ago
9 years ago
9 years ago
9 years ago
9 years ago
  1. // Copyright 2017 The Gitea Authors. All rights reserved.
  2. // Copyright 2014 The Gogs Authors. All rights reserved.
  3. // Use of this source code is governed by a MIT-style
  4. // license that can be found in the LICENSE file.
  5. package repo
  6. import (
  7. "bytes"
  8. "encoding/base64"
  9. "fmt"
  10. gotemplate "html/template"
  11. "io/ioutil"
  12. "net/url"
  13. "path"
  14. "strings"
  15. "code.gitea.io/gitea/models"
  16. "code.gitea.io/gitea/modules/base"
  17. "code.gitea.io/gitea/modules/cache"
  18. "code.gitea.io/gitea/modules/charset"
  19. "code.gitea.io/gitea/modules/context"
  20. "code.gitea.io/gitea/modules/git"
  21. "code.gitea.io/gitea/modules/highlight"
  22. "code.gitea.io/gitea/modules/lfs"
  23. "code.gitea.io/gitea/modules/log"
  24. "code.gitea.io/gitea/modules/markup"
  25. "code.gitea.io/gitea/modules/setting"
  26. )
  27. const (
  28. tplRepoEMPTY base.TplName = "repo/empty"
  29. tplRepoHome base.TplName = "repo/home"
  30. tplWatchers base.TplName = "repo/watchers"
  31. tplForks base.TplName = "repo/forks"
  32. tplMigrating base.TplName = "repo/migrating"
  33. )
  34. type namedBlob struct {
  35. name string
  36. isSymlink bool
  37. blob *git.Blob
  38. }
  39. // FIXME: There has to be a more efficient way of doing this
  40. func getReadmeFileFromPath(commit *git.Commit, treePath string) (*namedBlob, error) {
  41. tree, err := commit.SubTree(treePath)
  42. if err != nil {
  43. return nil, err
  44. }
  45. entries, err := tree.ListEntries()
  46. if err != nil {
  47. return nil, err
  48. }
  49. var readmeFiles [4]*namedBlob
  50. var exts = []string{".md", ".txt", ""} // sorted by priority
  51. for _, entry := range entries {
  52. if entry.IsDir() {
  53. continue
  54. }
  55. for i, ext := range exts {
  56. if markup.IsReadmeFile(entry.Name(), ext) {
  57. if readmeFiles[i] == nil || base.NaturalSortLess(readmeFiles[i].name, entry.Blob().Name()) {
  58. name := entry.Name()
  59. isSymlink := entry.IsLink()
  60. target := entry
  61. if isSymlink {
  62. target, err = entry.FollowLinks()
  63. if err != nil && !git.IsErrBadLink(err) {
  64. return nil, err
  65. }
  66. }
  67. if target != nil && (target.IsExecutable() || target.IsRegular()) {
  68. readmeFiles[i] = &namedBlob{
  69. name,
  70. isSymlink,
  71. target.Blob(),
  72. }
  73. }
  74. }
  75. }
  76. }
  77. if markup.IsReadmeFile(entry.Name()) {
  78. if readmeFiles[3] == nil || base.NaturalSortLess(readmeFiles[3].name, entry.Blob().Name()) {
  79. name := entry.Name()
  80. isSymlink := entry.IsLink()
  81. if isSymlink {
  82. entry, err = entry.FollowLinks()
  83. if err != nil && !git.IsErrBadLink(err) {
  84. return nil, err
  85. }
  86. }
  87. if entry != nil && (entry.IsExecutable() || entry.IsRegular()) {
  88. readmeFiles[3] = &namedBlob{
  89. name,
  90. isSymlink,
  91. entry.Blob(),
  92. }
  93. }
  94. }
  95. }
  96. }
  97. var readmeFile *namedBlob
  98. for _, f := range readmeFiles {
  99. if f != nil {
  100. readmeFile = f
  101. break
  102. }
  103. }
  104. return readmeFile, nil
  105. }
  106. func renderDirectory(ctx *context.Context, treeLink string) {
  107. tree, err := ctx.Repo.Commit.SubTree(ctx.Repo.TreePath)
  108. if err != nil {
  109. ctx.NotFoundOrServerError("Repo.Commit.SubTree", git.IsErrNotExist, err)
  110. return
  111. }
  112. entries, err := tree.ListEntries()
  113. if err != nil {
  114. ctx.ServerError("ListEntries", err)
  115. return
  116. }
  117. entries.CustomSort(base.NaturalSortLess)
  118. var c git.LastCommitCache
  119. if setting.CacheService.LastCommit.Enabled && ctx.Repo.CommitsCount >= setting.CacheService.LastCommit.CommitsCount {
  120. c = cache.NewLastCommitCache(ctx.Repo.Repository.FullName(), ctx.Repo.GitRepo, int64(setting.CacheService.LastCommit.TTL.Seconds()))
  121. }
  122. var latestCommit *git.Commit
  123. ctx.Data["Files"], latestCommit, err = entries.GetCommitsInfo(ctx.Repo.Commit, ctx.Repo.TreePath, c)
  124. if err != nil {
  125. ctx.ServerError("GetCommitsInfo", err)
  126. return
  127. }
  128. // 3 for the extensions in exts[] in order
  129. // the last one is for a readme that doesn't
  130. // strictly match an extension
  131. var readmeFiles [4]*namedBlob
  132. var docsEntries [3]*git.TreeEntry
  133. var exts = []string{".md", ".txt", ""} // sorted by priority
  134. for _, entry := range entries {
  135. if entry.IsDir() {
  136. lowerName := strings.ToLower(entry.Name())
  137. switch lowerName {
  138. case "docs":
  139. if entry.Name() == "docs" || docsEntries[0] == nil {
  140. docsEntries[0] = entry
  141. }
  142. case ".gitea":
  143. if entry.Name() == ".gitea" || docsEntries[1] == nil {
  144. docsEntries[1] = entry
  145. }
  146. case ".github":
  147. if entry.Name() == ".github" || docsEntries[2] == nil {
  148. docsEntries[2] = entry
  149. }
  150. }
  151. continue
  152. }
  153. for i, ext := range exts {
  154. if markup.IsReadmeFile(entry.Name(), ext) {
  155. log.Debug("%s", entry.Name())
  156. name := entry.Name()
  157. isSymlink := entry.IsLink()
  158. target := entry
  159. if isSymlink {
  160. target, err = entry.FollowLinks()
  161. if err != nil && !git.IsErrBadLink(err) {
  162. ctx.ServerError("FollowLinks", err)
  163. return
  164. }
  165. }
  166. log.Debug("%t", target == nil)
  167. if target != nil && (target.IsExecutable() || target.IsRegular()) {
  168. readmeFiles[i] = &namedBlob{
  169. name,
  170. isSymlink,
  171. target.Blob(),
  172. }
  173. }
  174. }
  175. }
  176. if markup.IsReadmeFile(entry.Name()) {
  177. name := entry.Name()
  178. isSymlink := entry.IsLink()
  179. if isSymlink {
  180. entry, err = entry.FollowLinks()
  181. if err != nil && !git.IsErrBadLink(err) {
  182. ctx.ServerError("FollowLinks", err)
  183. return
  184. }
  185. }
  186. if entry != nil && (entry.IsExecutable() || entry.IsRegular()) {
  187. readmeFiles[3] = &namedBlob{
  188. name,
  189. isSymlink,
  190. entry.Blob(),
  191. }
  192. }
  193. }
  194. }
  195. var readmeFile *namedBlob
  196. readmeTreelink := treeLink
  197. for _, f := range readmeFiles {
  198. if f != nil {
  199. readmeFile = f
  200. break
  201. }
  202. }
  203. if ctx.Repo.TreePath == "" && readmeFile == nil {
  204. for _, entry := range docsEntries {
  205. if entry == nil {
  206. continue
  207. }
  208. readmeFile, err = getReadmeFileFromPath(ctx.Repo.Commit, entry.GetSubJumpablePathName())
  209. if err != nil {
  210. ctx.ServerError("getReadmeFileFromPath", err)
  211. return
  212. }
  213. if readmeFile != nil {
  214. readmeFile.name = entry.Name() + "/" + readmeFile.name
  215. readmeTreelink = treeLink + "/" + entry.GetSubJumpablePathName()
  216. break
  217. }
  218. }
  219. }
  220. if readmeFile != nil {
  221. ctx.Data["RawFileLink"] = ""
  222. ctx.Data["ReadmeInList"] = true
  223. ctx.Data["ReadmeExist"] = true
  224. ctx.Data["FileIsSymlink"] = readmeFile.isSymlink
  225. dataRc, err := readmeFile.blob.DataAsync()
  226. if err != nil {
  227. ctx.ServerError("Data", err)
  228. return
  229. }
  230. defer dataRc.Close()
  231. buf := make([]byte, 1024)
  232. n, _ := dataRc.Read(buf)
  233. buf = buf[:n]
  234. isTextFile := base.IsTextFile(buf)
  235. ctx.Data["FileIsText"] = isTextFile
  236. ctx.Data["FileName"] = readmeFile.name
  237. fileSize := int64(0)
  238. isLFSFile := false
  239. ctx.Data["IsLFSFile"] = false
  240. // FIXME: what happens when README file is an image?
  241. if isTextFile && setting.LFS.StartServer {
  242. meta := lfs.IsPointerFile(&buf)
  243. if meta != nil {
  244. meta, err = ctx.Repo.Repository.GetLFSMetaObjectByOid(meta.Oid)
  245. if err != nil && err != models.ErrLFSObjectNotExist {
  246. ctx.ServerError("GetLFSMetaObject", err)
  247. return
  248. }
  249. }
  250. if meta != nil {
  251. ctx.Data["IsLFSFile"] = true
  252. isLFSFile = true
  253. // OK read the lfs object
  254. var err error
  255. dataRc, err = lfs.ReadMetaObject(meta)
  256. if err != nil {
  257. ctx.ServerError("ReadMetaObject", err)
  258. return
  259. }
  260. defer dataRc.Close()
  261. buf = make([]byte, 1024)
  262. n, err = dataRc.Read(buf)
  263. if err != nil {
  264. ctx.ServerError("Data", err)
  265. return
  266. }
  267. buf = buf[:n]
  268. isTextFile = base.IsTextFile(buf)
  269. ctx.Data["IsTextFile"] = isTextFile
  270. fileSize = meta.Size
  271. ctx.Data["FileSize"] = meta.Size
  272. filenameBase64 := base64.RawURLEncoding.EncodeToString([]byte(readmeFile.name))
  273. ctx.Data["RawFileLink"] = fmt.Sprintf("%s%s.git/info/lfs/objects/%s/%s", setting.AppURL, ctx.Repo.Repository.FullName(), meta.Oid, filenameBase64)
  274. }
  275. }
  276. if !isLFSFile {
  277. fileSize = readmeFile.blob.Size()
  278. }
  279. if isTextFile {
  280. if fileSize >= setting.UI.MaxDisplayFileSize {
  281. // Pretend that this is a normal text file to display 'This file is too large to be shown'
  282. ctx.Data["IsFileTooLarge"] = true
  283. ctx.Data["IsTextFile"] = true
  284. ctx.Data["FileSize"] = fileSize
  285. } else {
  286. d, _ := ioutil.ReadAll(dataRc)
  287. buf = charset.ToUTF8WithFallback(append(buf, d...))
  288. if markupType := markup.Type(readmeFile.name); markupType != "" {
  289. ctx.Data["IsMarkup"] = true
  290. ctx.Data["MarkupType"] = string(markupType)
  291. ctx.Data["FileContent"] = string(markup.Render(readmeFile.name, buf, readmeTreelink, ctx.Repo.Repository.ComposeMetas()))
  292. } else {
  293. ctx.Data["IsRenderedHTML"] = true
  294. ctx.Data["FileContent"] = strings.Replace(
  295. gotemplate.HTMLEscapeString(string(buf)), "\n", `<br>`, -1,
  296. )
  297. }
  298. }
  299. }
  300. }
  301. // Show latest commit info of repository in table header,
  302. // or of directory if not in root directory.
  303. ctx.Data["LatestCommit"] = latestCommit
  304. verification := models.ParseCommitWithSignature(latestCommit)
  305. if err := models.CalculateTrustStatus(verification, ctx.Repo.Repository, nil); err != nil {
  306. ctx.ServerError("CalculateTrustStatus", err)
  307. return
  308. }
  309. ctx.Data["LatestCommitVerification"] = verification
  310. ctx.Data["LatestCommitUser"] = models.ValidateCommitWithEmail(latestCommit)
  311. statuses, err := models.GetLatestCommitStatus(ctx.Repo.Repository, ctx.Repo.Commit.ID.String(), 0)
  312. if err != nil {
  313. log.Error("GetLatestCommitStatus: %v", err)
  314. }
  315. ctx.Data["LatestCommitStatus"] = models.CalcCommitStatus(statuses)
  316. // Check permission to add or upload new file.
  317. if ctx.Repo.CanWrite(models.UnitTypeCode) && ctx.Repo.IsViewBranch {
  318. ctx.Data["CanAddFile"] = !ctx.Repo.Repository.IsArchived
  319. ctx.Data["CanUploadFile"] = setting.Repository.Upload.Enabled && !ctx.Repo.Repository.IsArchived
  320. }
  321. }
  322. func renderFile(ctx *context.Context, entry *git.TreeEntry, treeLink, rawLink string) {
  323. ctx.Data["IsViewFile"] = true
  324. blob := entry.Blob()
  325. dataRc, err := blob.DataAsync()
  326. if err != nil {
  327. ctx.ServerError("DataAsync", err)
  328. return
  329. }
  330. defer dataRc.Close()
  331. ctx.Data["Title"] = ctx.Data["Title"].(string) + " - " + ctx.Repo.TreePath + " at " + ctx.Repo.BranchName
  332. fileSize := blob.Size()
  333. ctx.Data["FileIsSymlink"] = entry.IsLink()
  334. ctx.Data["FileSize"] = fileSize
  335. ctx.Data["FileName"] = blob.Name()
  336. ctx.Data["HighlightClass"] = highlight.FileNameToHighlightClass(blob.Name())
  337. ctx.Data["RawFileLink"] = rawLink + "/" + ctx.Repo.TreePath
  338. buf := make([]byte, 1024)
  339. n, _ := dataRc.Read(buf)
  340. buf = buf[:n]
  341. isTextFile := base.IsTextFile(buf)
  342. isLFSFile := false
  343. ctx.Data["IsTextFile"] = isTextFile
  344. //Check for LFS meta file
  345. if isTextFile && setting.LFS.StartServer {
  346. meta := lfs.IsPointerFile(&buf)
  347. if meta != nil {
  348. meta, err = ctx.Repo.Repository.GetLFSMetaObjectByOid(meta.Oid)
  349. if err != nil && err != models.ErrLFSObjectNotExist {
  350. ctx.ServerError("GetLFSMetaObject", err)
  351. return
  352. }
  353. }
  354. if meta != nil {
  355. ctx.Data["IsLFSFile"] = true
  356. isLFSFile = true
  357. // OK read the lfs object
  358. var err error
  359. dataRc, err = lfs.ReadMetaObject(meta)
  360. if err != nil {
  361. ctx.ServerError("ReadMetaObject", err)
  362. return
  363. }
  364. defer dataRc.Close()
  365. buf = make([]byte, 1024)
  366. n, err = dataRc.Read(buf)
  367. if err != nil {
  368. ctx.ServerError("Data", err)
  369. return
  370. }
  371. buf = buf[:n]
  372. isTextFile = base.IsTextFile(buf)
  373. ctx.Data["IsTextFile"] = isTextFile
  374. fileSize = meta.Size
  375. ctx.Data["FileSize"] = meta.Size
  376. filenameBase64 := base64.RawURLEncoding.EncodeToString([]byte(blob.Name()))
  377. ctx.Data["RawFileLink"] = fmt.Sprintf("%s%s.git/info/lfs/objects/%s/%s", setting.AppURL, ctx.Repo.Repository.FullName(), meta.Oid, filenameBase64)
  378. }
  379. }
  380. // Check LFS Lock
  381. lfsLock, err := ctx.Repo.Repository.GetTreePathLock(ctx.Repo.TreePath)
  382. ctx.Data["LFSLock"] = lfsLock
  383. if err != nil {
  384. ctx.ServerError("GetTreePathLock", err)
  385. return
  386. }
  387. if lfsLock != nil {
  388. ctx.Data["LFSLockOwner"] = lfsLock.Owner.DisplayName()
  389. ctx.Data["LFSLockHint"] = ctx.Tr("repo.editor.this_file_locked")
  390. }
  391. // Assume file is not editable first.
  392. if isLFSFile {
  393. ctx.Data["EditFileTooltip"] = ctx.Tr("repo.editor.cannot_edit_lfs_files")
  394. } else if !isTextFile {
  395. ctx.Data["EditFileTooltip"] = ctx.Tr("repo.editor.cannot_edit_non_text_files")
  396. }
  397. switch {
  398. case isTextFile:
  399. if fileSize >= setting.UI.MaxDisplayFileSize {
  400. ctx.Data["IsFileTooLarge"] = true
  401. break
  402. }
  403. d, _ := ioutil.ReadAll(dataRc)
  404. buf = charset.ToUTF8WithFallback(append(buf, d...))
  405. readmeExist := markup.IsReadmeFile(blob.Name())
  406. ctx.Data["ReadmeExist"] = readmeExist
  407. if markupType := markup.Type(blob.Name()); markupType != "" {
  408. ctx.Data["IsMarkup"] = true
  409. ctx.Data["MarkupType"] = markupType
  410. ctx.Data["FileContent"] = string(markup.Render(blob.Name(), buf, path.Dir(treeLink), ctx.Repo.Repository.ComposeMetas()))
  411. } else if readmeExist {
  412. ctx.Data["IsRenderedHTML"] = true
  413. ctx.Data["FileContent"] = strings.Replace(
  414. gotemplate.HTMLEscapeString(string(buf)), "\n", `<br>`, -1,
  415. )
  416. } else {
  417. // Building code view blocks with line number on server side.
  418. var fileContent string
  419. if content, err := charset.ToUTF8WithErr(buf); err != nil {
  420. log.Error("ToUTF8WithErr: %v", err)
  421. fileContent = string(buf)
  422. } else {
  423. fileContent = content
  424. }
  425. var output bytes.Buffer
  426. lines := strings.Split(fileContent, "\n")
  427. ctx.Data["NumLines"] = len(lines)
  428. if len(lines) == 1 && lines[0] == "" {
  429. // If the file is completely empty, we show zero lines at the line counter
  430. ctx.Data["NumLines"] = 0
  431. }
  432. ctx.Data["NumLinesSet"] = true
  433. //Remove blank line at the end of file
  434. if len(lines) > 0 && lines[len(lines)-1] == "" {
  435. lines = lines[:len(lines)-1]
  436. }
  437. for index, line := range lines {
  438. line = gotemplate.HTMLEscapeString(line)
  439. if index != len(lines)-1 {
  440. line += "\n"
  441. }
  442. output.WriteString(fmt.Sprintf(`<li class="L%d" rel="L%d">%s</li>`, index+1, index+1, line))
  443. }
  444. ctx.Data["FileContent"] = gotemplate.HTML(output.String())
  445. output.Reset()
  446. for i := 0; i < len(lines); i++ {
  447. output.WriteString(fmt.Sprintf(`<span id="L%[1]d" data-line-number="%[1]d"></span>`, i+1))
  448. }
  449. ctx.Data["LineNums"] = gotemplate.HTML(output.String())
  450. }
  451. if !isLFSFile {
  452. if ctx.Repo.CanEnableEditor() {
  453. if lfsLock != nil && lfsLock.OwnerID != ctx.User.ID {
  454. ctx.Data["CanEditFile"] = false
  455. ctx.Data["EditFileTooltip"] = ctx.Tr("repo.editor.this_file_locked")
  456. } else {
  457. ctx.Data["CanEditFile"] = true
  458. ctx.Data["EditFileTooltip"] = ctx.Tr("repo.editor.edit_this_file")
  459. }
  460. } else if !ctx.Repo.IsViewBranch {
  461. ctx.Data["EditFileTooltip"] = ctx.Tr("repo.editor.must_be_on_a_branch")
  462. } else if !ctx.Repo.CanWrite(models.UnitTypeCode) {
  463. ctx.Data["EditFileTooltip"] = ctx.Tr("repo.editor.fork_before_edit")
  464. }
  465. }
  466. case base.IsPDFFile(buf):
  467. ctx.Data["IsPDFFile"] = true
  468. case base.IsVideoFile(buf):
  469. ctx.Data["IsVideoFile"] = true
  470. case base.IsAudioFile(buf):
  471. ctx.Data["IsAudioFile"] = true
  472. case base.IsImageFile(buf):
  473. ctx.Data["IsImageFile"] = true
  474. default:
  475. if fileSize >= setting.UI.MaxDisplayFileSize {
  476. ctx.Data["IsFileTooLarge"] = true
  477. break
  478. }
  479. if markupType := markup.Type(blob.Name()); markupType != "" {
  480. d, _ := ioutil.ReadAll(dataRc)
  481. buf = append(buf, d...)
  482. ctx.Data["IsMarkup"] = true
  483. ctx.Data["MarkupType"] = markupType
  484. ctx.Data["FileContent"] = string(markup.Render(blob.Name(), buf, path.Dir(treeLink), ctx.Repo.Repository.ComposeMetas()))
  485. }
  486. }
  487. if ctx.Repo.CanEnableEditor() {
  488. if lfsLock != nil && lfsLock.OwnerID != ctx.User.ID {
  489. ctx.Data["CanDeleteFile"] = false
  490. ctx.Data["DeleteFileTooltip"] = ctx.Tr("repo.editor.this_file_locked")
  491. } else {
  492. ctx.Data["CanDeleteFile"] = true
  493. ctx.Data["DeleteFileTooltip"] = ctx.Tr("repo.editor.delete_this_file")
  494. }
  495. } else if !ctx.Repo.IsViewBranch {
  496. ctx.Data["DeleteFileTooltip"] = ctx.Tr("repo.editor.must_be_on_a_branch")
  497. } else if !ctx.Repo.CanWrite(models.UnitTypeCode) {
  498. ctx.Data["DeleteFileTooltip"] = ctx.Tr("repo.editor.must_have_write_access")
  499. }
  500. }
  501. func safeURL(address string) string {
  502. u, err := url.Parse(address)
  503. if err != nil {
  504. return address
  505. }
  506. u.User = nil
  507. return u.String()
  508. }
  509. // Home render repository home page
  510. func Home(ctx *context.Context) {
  511. if len(ctx.Repo.Units) > 0 {
  512. if ctx.Repo.Repository.IsBeingCreated() {
  513. task, err := models.GetMigratingTask(ctx.Repo.Repository.ID)
  514. if err != nil {
  515. ctx.ServerError("models.GetMigratingTask", err)
  516. return
  517. }
  518. cfg, err := task.MigrateConfig()
  519. if err != nil {
  520. ctx.ServerError("task.MigrateConfig", err)
  521. return
  522. }
  523. ctx.Data["Repo"] = ctx.Repo
  524. ctx.Data["MigrateTask"] = task
  525. ctx.Data["CloneAddr"] = safeURL(cfg.CloneAddr)
  526. ctx.HTML(200, tplMigrating)
  527. return
  528. }
  529. var firstUnit *models.Unit
  530. for _, repoUnit := range ctx.Repo.Units {
  531. if repoUnit.Type == models.UnitTypeCode {
  532. renderCode(ctx)
  533. return
  534. }
  535. unit, ok := models.Units[repoUnit.Type]
  536. if ok && (firstUnit == nil || !firstUnit.IsLessThan(unit)) {
  537. firstUnit = &unit
  538. }
  539. }
  540. if firstUnit != nil {
  541. ctx.Redirect(fmt.Sprintf("%s/%s%s", setting.AppSubURL, ctx.Repo.Repository.FullName(), firstUnit.URI))
  542. return
  543. }
  544. }
  545. ctx.NotFound("Home", fmt.Errorf(ctx.Tr("units.error.no_unit_allowed_repo")))
  546. }
  547. func renderLanguageStats(ctx *context.Context) {
  548. langs, err := ctx.Repo.Repository.GetTopLanguageStats(5)
  549. if err != nil {
  550. ctx.ServerError("Repo.GetTopLanguageStats", err)
  551. return
  552. }
  553. ctx.Data["LanguageStats"] = langs
  554. }
  555. func renderCode(ctx *context.Context) {
  556. ctx.Data["PageIsViewCode"] = true
  557. if ctx.Repo.Repository.IsEmpty {
  558. ctx.HTML(200, tplRepoEMPTY)
  559. return
  560. }
  561. title := ctx.Repo.Repository.Owner.Name + "/" + ctx.Repo.Repository.Name
  562. if len(ctx.Repo.Repository.Description) > 0 {
  563. title += ": " + ctx.Repo.Repository.Description
  564. }
  565. ctx.Data["Title"] = title
  566. ctx.Data["RequireHighlightJS"] = true
  567. branchLink := ctx.Repo.RepoLink + "/src/" + ctx.Repo.BranchNameSubURL()
  568. treeLink := branchLink
  569. rawLink := ctx.Repo.RepoLink + "/raw/" + ctx.Repo.BranchNameSubURL()
  570. if len(ctx.Repo.TreePath) > 0 {
  571. treeLink += "/" + ctx.Repo.TreePath
  572. }
  573. // Get Topics of this repo
  574. topics, err := models.FindTopics(&models.FindTopicOptions{
  575. RepoID: ctx.Repo.Repository.ID,
  576. })
  577. if err != nil {
  578. ctx.ServerError("models.FindTopics", err)
  579. return
  580. }
  581. ctx.Data["Topics"] = topics
  582. // Get current entry user currently looking at.
  583. entry, err := ctx.Repo.Commit.GetTreeEntryByPath(ctx.Repo.TreePath)
  584. if err != nil {
  585. ctx.NotFoundOrServerError("Repo.Commit.GetTreeEntryByPath", git.IsErrNotExist, err)
  586. return
  587. }
  588. renderLanguageStats(ctx)
  589. if ctx.Written() {
  590. return
  591. }
  592. if entry.IsDir() {
  593. renderDirectory(ctx, treeLink)
  594. } else {
  595. renderFile(ctx, entry, treeLink, rawLink)
  596. }
  597. if ctx.Written() {
  598. return
  599. }
  600. var treeNames []string
  601. paths := make([]string, 0, 5)
  602. if len(ctx.Repo.TreePath) > 0 {
  603. treeNames = strings.Split(ctx.Repo.TreePath, "/")
  604. for i := range treeNames {
  605. paths = append(paths, strings.Join(treeNames[:i+1], "/"))
  606. }
  607. ctx.Data["HasParentPath"] = true
  608. if len(paths)-2 >= 0 {
  609. ctx.Data["ParentPath"] = "/" + paths[len(paths)-2]
  610. }
  611. }
  612. ctx.Data["Paths"] = paths
  613. ctx.Data["TreeLink"] = treeLink
  614. ctx.Data["TreeNames"] = treeNames
  615. ctx.Data["BranchLink"] = branchLink
  616. ctx.HTML(200, tplRepoHome)
  617. }
  618. // RenderUserCards render a page show users according the input templaet
  619. func RenderUserCards(ctx *context.Context, total int, getter func(opts models.ListOptions) ([]*models.User, error), tpl base.TplName) {
  620. page := ctx.QueryInt("page")
  621. if page <= 0 {
  622. page = 1
  623. }
  624. pager := context.NewPagination(total, models.ItemsPerPage, page, 5)
  625. ctx.Data["Page"] = pager
  626. items, err := getter(models.ListOptions{Page: pager.Paginater.Current()})
  627. if err != nil {
  628. ctx.ServerError("getter", err)
  629. return
  630. }
  631. ctx.Data["Cards"] = items
  632. ctx.HTML(200, tpl)
  633. }
  634. // Watchers render repository's watch users
  635. func Watchers(ctx *context.Context) {
  636. ctx.Data["Title"] = ctx.Tr("repo.watchers")
  637. ctx.Data["CardsTitle"] = ctx.Tr("repo.watchers")
  638. ctx.Data["PageIsWatchers"] = true
  639. RenderUserCards(ctx, ctx.Repo.Repository.NumWatches, ctx.Repo.Repository.GetWatchers, tplWatchers)
  640. }
  641. // Stars render repository's starred users
  642. func Stars(ctx *context.Context) {
  643. ctx.Data["Title"] = ctx.Tr("repo.stargazers")
  644. ctx.Data["CardsTitle"] = ctx.Tr("repo.stargazers")
  645. ctx.Data["PageIsStargazers"] = true
  646. RenderUserCards(ctx, ctx.Repo.Repository.NumStars, ctx.Repo.Repository.GetStargazers, tplWatchers)
  647. }
  648. // Forks render repository's forked users
  649. func Forks(ctx *context.Context) {
  650. ctx.Data["Title"] = ctx.Tr("repos.forks")
  651. forks, err := ctx.Repo.Repository.GetForks(models.ListOptions{})
  652. if err != nil {
  653. ctx.ServerError("GetForks", err)
  654. return
  655. }
  656. for _, fork := range forks {
  657. if err = fork.GetOwner(); err != nil {
  658. ctx.ServerError("GetOwner", err)
  659. return
  660. }
  661. }
  662. ctx.Data["Forks"] = forks
  663. ctx.HTML(200, tplForks)
  664. }