145 Commits

Author SHA1 Message Date
Kyle Brennan
67c2800c1c
[content-service] remove s5cmd integration (#18863)
* [ws-daemon] log download and extract times

* Revert "[content-service] log duration for s3 download and tar extract (#18829)"

This reverts commit ac8d3e25f10e4caf4bbe3475501e33dc49bbb068.

* Revert "[content-service] download s3 content using s5cmd (#18783)"

This reverts commit 4fb2677c4a6849b6f140214fcb84dce2cc6c7899.
2023-10-03 23:42:11 +03:00
Anton Kosyakov
40c39f5312
Revert "Relax assumptions in supervisor (#18782)" (#18857)
This reverts commit 9a38b607055780fa7b2cd61c1379143d6c7b3715.
2023-10-02 23:00:11 +03:00
Christian Weichel
9a38b60705
Relax assumptions in supervisor (#18782)
* [supervisor] Make UID/GID configurable

* Support content initializer as env var

* Make workspace runtime explicit

* Make linux user configurable for Git operations

* Don't assume /home/gitpod

* Fix unittest

* Fix wsdaemon
2023-09-27 17:32:06 +03:00
Manuel Alejandro de Brito Fontes
64994160d9
Remove FUSE support (#18536)
* Remove FUSE support

* Update docs

* Remove fuse-overlayfs

* Fix installer validation
2023-08-18 16:13:44 +02:00
Wouter Verlaek
516b67cfbc
[test] Fix slack footer and improve ws-daemon log (#18168)
* [test] Fix slack footer

* Add OWI and err size log
2023-07-05 19:01:22 +08:00
Wouter Verlaek
cbc8b38a91
[ws-daemon] Add OWI to logs (#18017) 2023-06-22 21:44:12 +08:00
Thomas Schubart
fe08421325
[ws-daemon] Remove full workspace backup (#17803) 2023-06-01 17:36:06 +08:00
Thomas Schubart
588d2919de
[ws-manager-mk2] Remove workspace service (#17801)
* [ws-daemon] Remove workspace service

* [ws-daemon] Move metrics
2023-05-31 23:08:06 +08:00
Kyle Brennan
1a7c50a8b5
[ws-manager-mk2] support storage quotas (#17606)
* [ws-manager-mk2] add support for storage quotas

This way, on workspace create, `ws-daemon` can set XFS limits for `/workspace`

* [preview] set smaller /workspace limits

This way we don't have to spend more on preview environments.

* [ws-daemon] warn when xfs is missing

* Partial revert of "Revert "[ws-daemon] Restart IWS if ws-daemon is restarted (#17552)" (#17645)"

This reverts commit e082b7f48885199013df927d3c71c62935f74047.

It avoids reverts on notify.go and workspace_provider.go.

* [ws-daemon] log when handling running workspaces

* [test] add test for xfs quotas
2023-05-19 20:49:53 +08:00
Manuel Alejandro de Brito Fontes
9cf0243e54
Add new feature for custom workspace network CIDR (#17145)
* Add new feature for custom workspace network CIDR

* Cleanup
2023-04-07 13:17:47 +02:00
Thomas Schubart
75be62fba0 [ws-daemon] Dispose workspace 2023-01-30 14:59:37 +01:00
Christian Weichel
572fcbb008 [ws-daemon] Start workspace controller based content init 2023-01-23 14:14:30 +01:00
utam0k
808d58c3ce ws-daemon: Plant some traces around the hooks 2022-12-28 23:23:37 +01:00
Christian Weichel
478a75e744 Switch license to AGPL 2022-12-08 13:05:19 -03:00
Thomas Schubart
d0ccc7f044 [content-service] Log filesystem usage error 2022-12-05 07:01:15 -03:00
Thomas Schubart
6da3df83a8 [ws-daemon] Provide initializer metrics for object storage 2022-12-05 07:01:15 -03:00
Thomas Schubart
98a735727a [content-service] Create initialize metrics 2022-12-05 07:01:15 -03:00
utam0k
19b72c57c1 ws-daemon: Enhause the traces for DisposeWorkspace 2022-12-01 07:46:00 -03:00
Manuel Alejandro de Brito Fontes
6e50a50764 [ws-daemon] Add logs setting disk quotas 2022-11-07 11:18:37 +01:00
Manuel Alejandro de Brito Fontes
f06f18191b [ws-daemon] Improve download options 2022-10-06 00:22:21 +02:00
Pavel Tumik
389f7767fb [ws-daemon] fix WaitForInit not found error in tracing 2022-10-05 10:35:21 +02:00
Manuel Alejandro de Brito Fontes
0412c5f461 [test] Reduce loop wait time 2022-10-05 05:15:20 +02:00
Manuel Alejandro de Brito Fontes
0b1006ab56 [ws-daemon] Improve download speed of snapshots 2022-10-04 15:57:21 +02:00
Pavel Tumik @ GitPod
153726046a add addional tracing for remoteContentStorage Download fn 2022-09-27 02:23:27 +02:00
Pavel Tumik @ GitPod
c8c906e278 replace os.IsNotExist with errors.Is(err, fs.ErrNotExist) 2022-08-24 03:35:40 +02:00
utam0k
c2d249a5b5 ws-daemon: Proper use of content.json 2022-08-19 19:38:36 +02:00
Thomas Schubart
212b4712f4 [ws-daemon] Include workspace id in error 2022-08-09 15:38:53 +02:00
JenTing Hsiao
9017476767 Return error to the client and only ignore tracing error
Signed-off-by: JenTing Hsiao <hsiaoairplane@gmail.com>
2022-08-06 19:18:50 -03:00
JenTing Hsiao
d5c9bd792f Log warning instead of tracing error span
Special handling the error message for tracing when we can't find
workspace in memory.

Signed-off-by: JenTing Hsiao <hsiaoairplane@gmail.com>
2022-08-04 06:46:48 -03:00
Manuel Alejandro de Brito Fontes
ccb4e180a7 Remove backup trail 2022-08-04 05:00:48 -03:00
JenTing Hsiao
80eedafd74 The instance ID is required field
Signed-off-by: JenTing Hsiao <hsiaoairplane@gmail.com>
2022-08-02 05:34:46 -03:00
Manuel Alejandro de Brito Fontes
797f440c7c Simplify configuration of git setting safe.directory 2022-07-19 17:23:14 +02:00
Manuel Alejandro de Brito Fontes
38b886bb6a [ws-daemon] Increase number of concurrent backup uploads 2022-07-15 01:45:01 +02:00
Pavel Tumik
af62571a40 Update components/ws-daemon/pkg/content/service.go
Co-authored-by: Christian Weichel <chris@gitpod.io>
2022-07-14 09:24:01 +02:00
Pavel Tumik
52717d7104 [ws-daemon] do not fail workspace if git status failed during dispose 2022-07-14 09:24:01 +02:00
Pavel Tumik
6dd7fc82b4 [ws-daemon] improve DisposeWorkspace logging 2022-07-13 02:01:59 +02:00
Christian Weichel
8248935e44 [ws-manager] Add Git token to workspace secret 2022-07-06 19:22:53 +05:30
Christian Weichel
9ace0e8f1e Make content init work on Ubuntu 2022-07-06 05:12:53 +05:30
Pavel Tumik
7d005012a8 Add PVC support to prebuilds 2022-06-24 22:22:33 +05:30
utam0k
561df01704 ws-daemon: Soft limit the xfs at first to ensure that the contents can be restored 2022-06-08 16:12:18 +05:30
utam0k
0ace3aa498 ws-daemon: Apply the xfs limit in stages. 2022-06-01 14:00:50 +05:30
Christian Weichel
d9a66c466b [ws-daemon] Add backup ratelimiting timeout 2022-06-01 01:52:49 +05:30
Manuel Alejandro de Brito Fontes
afdf9614d5 [ws-daemon] Use a metric for backup waiting time instead logs 2022-05-30 16:12:48 +05:30
Tarun Pothulapati
77279a892e [initializer] Replace GIT_SSL_CAINFO with GIT_SSL_CAPATH
Fixes https://github.com/gitpod-io/gitpod/issues/10173

Using `GIT_SSL_CAPATH` means that we will continue to support
publicly signed SCM's even when we have a `customCA` configured.

Signed-off-by: Tarun Pothulapati <tarun@gitpod.io>
2022-05-30 14:03:48 +05:30
Manuel Alejandro de Brito Fontes
2dbef7ad51 [ws-daemon] Limit the number of concurrent workspace backups 2022-05-26 19:24:45 +05:30
Pavel Tumik
56d1756376 remove daemon-api change as it is not needed 2022-05-25 13:17:39 +05:30
Pavel Tumik
88768f6e50 snapshot volume support 2022-05-25 13:17:39 +05:30
Pavel Tumik
0cdce52b73 [ws-daemon] update git safe directory at init workspace phase 2022-05-14 00:15:28 +05:30
Sven Efftinge
d8f51d3cf0 [supervisor] inflate all git repos
fixes [multi-repo] Shallow clones are not inflated #9021
2022-05-13 15:01:28 +05:30
utam0k
8ef12e49ef improve start up time of iws for workspacekit. 2022-05-13 14:58:28 +05:30