Commit Graph

140 Commits

Author SHA1 Message Date
Himanshu Mishra 67b6221a2a Merge pull request #4509 from backstage/mob/techdocs-build-timestamp-metadata 2021-02-15 16:12:58 +01:00
Himanshu Mishra 07bca64b07 techdocs: remove invalid comment 2021-02-15 15:50:43 +01:00
Himanshu Mishra 3914453850 chore: TechDocs publisher does not work well with Windows paths 2021-02-14 19:52:48 +01:00
Himanshu Mishra d27c9a86ed techdocs: avoid collision with existing /tmp dir 2021-02-12 11:34:36 +01:00
Himanshu Mishra 4ddc18c849 techdocs: cleanup mock fs before mounting 2021-02-12 11:17:32 +01:00
Himanshu Mishra ec7ba00581 techdocs: Add build timestamp to techdocs_metadata.json
Co-authored-by: Raghunandan Balachandran <soapraj@gmail.com>
2021-02-12 10:56:57 +01:00
github-actions[bot] aa49ca2284 Version Packages 2021-02-11 10:15:47 +00:00
Joel Low 7623778385 Revert "Merge pull request #3953 from ayshiff/feature/techdocs-aws-sdkv3"
This reverts commit 1c7771871e, reversing
changes made to 65d5c8e6fe.
2021-02-11 13:25:08 +08:00
Himanshu Mishra 9e6e4b89a8 techdocs: meaningful logs when readTree starts 2021-02-10 13:14:52 +01:00
Himanshu Mishra 4ed4d44cca TechDocs: Implement caching for dir preparer 2021-02-10 11:02:40 +01:00
Himanshu Mishra df130db759 TechDocs: Deduplicate git clone for cache check
Signed-off-by: Himanshu Mishra <himanshu@orkohunter.net>
2021-02-10 11:02:40 +01:00
Himanshu Mishra 50fcdc48b4 TechDocs: Warn when using legacy git preparer and dir preparer in backstage.io/techdocs-ref
Context: https://github.com/backstage/backstage/issues/4409
2021-02-10 11:02:40 +01:00
Himanshu Mishra 057af3cac0 TechDocs: Implement etag based caching for git preparer
Signed-off-by: Himanshu Mishra <himanshu@orkohunter.net>
2021-02-10 11:02:40 +01:00
Himanshu Mishra 97a9a7365f TechDocs: Implement etag based caching for url preparer
Signed-off-by: Himanshu Mishra <himanshu@orkohunter.net>
2021-02-10 11:02:38 +01:00
Himanshu Mishra 66944ec7bf TechDocs: Preparers will take and return an etag for cache invalidation 2021-02-10 11:01:18 +01:00
Fredrik Adelöw 5a51635197 backend-common: implement UrlReader.search that does glob matching 2021-02-09 12:16:12 +01:00
github-actions[bot] 6794967d20 Version Packages 2021-02-04 13:02:30 +00:00
Debajyoti Halder 5f5cf2acfb Merge branch 'master' of https://github.com/spotify/backstage into lintMod 2021-02-03 11:05:45 +05:30
Himanshu Mishra 1ca98d7df8 TechDocs: Use mockFs for tests instead of real filesystem 2021-02-02 23:50:23 +01:00
Himanshu Mishra ae893e99f9 TechDocs: Update tests to reflect requestUrl change 2021-02-02 13:52:47 +01:00
Himanshu Mishra 5d94132bf9 TechDocs: Suppress ts error of config not being used 2021-02-02 13:51:05 +01:00
Himanshu Mishra 3927e79c29 techdocs: local publisher should directly access file system 2021-02-02 13:51:05 +01:00
Himanshu Mishra 38469b66bf techdocs: fix tests by reusing the instantiated discovery 2021-02-02 13:51:05 +01:00
Parth Shandilya e44925723e TechDocs: Make requestUrl and storageUrl optional configs by using discovery APIs
closes #3715

Co-authored-by: Himanshu Mishra <himanshu@orkohunter.net>
2021-02-02 13:51:04 +01:00
Debajyoti Halder 39e7f4a81e Merge branch 'master' of https://github.com/spotify/backstage into lintMod 2021-02-02 17:02:33 +05:30
Himanshu Mishra 3bdd6eac07 techdocs: Fix broken tests on Windows
https://github.com/backstage/backstage/runs/1805649470\?check_suite_focus\=true
2021-02-01 13:36:46 +01:00
Himanshu Mishra 8eb862c58e Merge pull request #4017 from viavarejo/feature/techdocs-azure-storage 2021-01-31 16:03:24 +01:00
Debajyoti Halder e0fb5dfccf Merge branch 'master' of https://github.com/spotify/backstage into lintMod 2021-01-29 16:34:22 +05:30
Debajyoti Halder 4dad818e01 Merge branch 'master' of https://github.com/spotify/backstage into lintMod 2021-01-29 14:05:27 +05:30
Debajyoti Halder 6106345e6d Update project with latest eslint rules 2021-01-29 11:55:12 +05:30
vitorgrenzel a2feeb288d feat(techdocs-common): update tests Azure Blob Storage 2021-01-28 16:17:30 -03:00
vitorgrenzel 9197ac3a0b feat(techdocs-common): update tests Azure Blob Storage 2021-01-28 16:17:29 -03:00
vitorgrenzel 0024d6d8c0 feat(techdocs-common): update Azure Blob Storage 2021-01-28 16:17:28 -03:00
vitorgrenzel 0be9694aa6 feat(techdocs-common): update Azure Blob Storage 2021-01-28 16:17:27 -03:00
vitorgrenzel 2d8d7697d6 feat(techdocs-common): update Azure Blob Storage 2021-01-28 16:17:20 -03:00
vitorgrenzel 59b8d5a0d9 feat(techdocs-common): add Azure Blob Storage 2021-01-28 16:16:22 -03:00
vitorgrenzel c777df180a feat(techdocs-common): add Azure Storage 2021-01-28 16:16:21 -03:00
Himanshu Mishra 03a2d95c71 TechDocs: Update tests with mock url reader 2021-01-28 15:32:09 +01:00
Himanshu Mishra 4bc89c555a TechDocs: Dir preparer should also use URL Reader 2021-01-28 14:54:48 +01:00
github-actions[bot] cda741034d Version Packages 2021-01-28 10:46:08 +00:00
Alan Crosswell 73c299c9ee upgrade git-url-parse to 11.4.4 2021-01-27 11:54:03 -05:00
Matei David 27f529afb6 Rename limitFactory to createLimiter in p-limit import
Signed-off-by: Matei David <matei.david.35@gmail.com>
2021-01-25 11:43:03 +00:00
Matei David 36bd49fa56 Remove async keyword from anon limiter fn
Signed-off-by: Matei David <matei.david.35@gmail.com>
2021-01-25 11:40:47 +00:00
Matei David db2328c885 Introduce execution limiter for file uploads
* TechDoc publishers for storage providers (i.e aws, google storage)
 should now rate limit concurrent executions allowing for file uploads to run in batches of 10.
 * Add PATCH changeset to techdocs common
 * Update yarn.lock
2021-01-25 11:40:47 +00:00
github-actions[bot] c5584b62c2 Version Packages 2021-01-21 13:13:05 +00:00
Himanshu Mishra 25f0b76c0b Merge pull request #3968 from mateiidavid/create-techdocs-metadata-type 2021-01-20 21:23:23 +01:00
Himanshu Mishra e8e6bd92b6 Merge pull request #4120 from backstage/orkohunter/url-reader-readTree-with-sha 2021-01-20 14:49:47 +01:00
Himanshu Mishra 060fd0a44a Merge pull request #4109 from backstage/iameap/stream-from-gcs 2021-01-19 12:15:19 +01:00
Himanshu Mishra 8565ad2279 1. Use etag over sha for the identifier
2. Re-combine Resonse types into one
2021-01-18 22:52:45 +01:00
Himanshu Mishra 2305296073 backend-common: Support SHA based caching in URL Reader's readTree
readTree now takes a SHA in options, and throws a NotModifiedError if the SHA matches with the latest commit SHA on the tree. readTree response now contains a new 'sha' parameter.

Also, the default branch will now be used if no branch is provided in the url's target
2021-01-18 21:53:49 +01:00