721 Commits

Author SHA1 Message Date
Wouter Verlaek
563bbd5ba1
[test] Add test for process limit (#17974) 2023-06-20 17:52:10 +08:00
Wouter Verlaek
7bf7966e23
Prepare for gen100 (#17920) 2023-06-20 05:32:10 +08:00
Thomas Schubart
4584f8fda9
[wsman-mk2] Change default class to g1-standard (#17950)
* [wsman-mk2] Change default class to g1-standard

* [preview] Update workspace classes
2023-06-15 20:23:05 +08:00
Wouter Verlaek
19cb889b88
[gpctl] Use mk2 tls by default (#17949) 2023-06-15 18:26:05 +08:00
Thomas Schubart
2cab1406dd
[ws-manager-mk2] Remove persistent volume claim feature (#17860)
* [ws-daemon] Remove PVC

* [installer] Remove PVC

* [workspacekit] Remove PVC

* [content] Remove PVC

* [preview] Remove PVC

* [wsman-api] Remove PVC

* [ws-daemon-api] Remove PVC

* [workspacekit] Mount workspace directory

* [supervisor] Remove PVC

* [test] Remove PVC

* Fix build
2023-06-13 18:35:04 +08:00
Robo Quat
b27795e15c
update index (#17856)
Co-authored-by: roboquat <roboquat@users.noreply.github.com>
2023-06-12 14:29:02 +08:00
Thomas Schubart
fc6eb007ac
[preview] Enable network limiting (#17863) 2023-06-10 03:11:00 +08:00
Wouter Verlaek
7656b09baf
[preview] Fix remove wsman mk1 reference (#17874) 2023-06-09 17:39:59 +08:00
Kyle Brennan
41e12e3dab
[preview] update image for gen99 (#17855) 2023-06-08 08:12:58 +08:00
Thomas Schubart
460875058f
[ws-manager-mk2] Remove ws-manager-mk2 from experimental section (#17848)
* [wsman-mk2] Remove ws-manager-mk2 from experimental

* [ws-daemon] Remove readiness check for service

* [ws-daemon] Use mk2 working area only

* [preview] Remove mk2 customization

* [installer] Remove constant
2023-06-06 22:56:57 +08:00
Robo Quat
99e74f600e
update index (#17662)
Co-authored-by: roboquat <roboquat@users.noreply.github.com>
2023-06-02 15:05:07 +08:00
Gero Posmyk-Leinemann
8c11623c2d
[server] Make telepresence work again (#17785) 2023-05-30 20:56:04 +08:00
Alex Tugarev
c8c4c3bda9
Root out obsolete self-hosted setup (#17729) 2023-05-25 15:44:59 +08:00
Kyle Brennan
80ac25ca97
[workspace] update deps for gen98 (#17719)
* [docker-up] update docker compose to 2.18.1-gitpod.2

* [workspace] update containerd

From v1.6.20 -> v1.6.21

* [image-builder-bob] fix build error after containerd update

Context:
[components/image-builder-bob:app] level=error msg="Running error: 1 error occurred:\n\t* can't run linter goanalysis_metalinter: buildir: failed to load package tracetransform: could not load export data: no export data for \"go.opentelemetry.io/otel/exporters/otlp/otlptrace/internal/tracetransform\"\n\n"

* [preview] update VM image with fewer cached images

This will help us avoid pod eviction and improve stability

Related: https://github.com/gitpod-io/gitpod-packer-gcp-image/pull/235

* [test] more cowbell
2023-05-24 21:18:59 +08:00
Sven Efftinge
dd7f5f70ba
[dedicated] explicit single-org config (#17547) 2023-05-22 20:08:56 +08:00
Kyle Brennan
1a7c50a8b5
[ws-manager-mk2] support storage quotas (#17606)
* [ws-manager-mk2] add support for storage quotas

This way, on workspace create, `ws-daemon` can set XFS limits for `/workspace`

* [preview] set smaller /workspace limits

This way we don't have to spend more on preview environments.

* [ws-daemon] warn when xfs is missing

* Partial revert of "Revert "[ws-daemon] Restart IWS if ws-daemon is restarted (#17552)" (#17645)"

This reverts commit e082b7f48885199013df927d3c71c62935f74047.

It avoids reverts on notify.go and workspace_provider.go.

* [ws-daemon] log when handling running workspaces

* [test] add test for xfs quotas
2023-05-19 20:49:53 +08:00
Kyle Brennan
0e8322699d
[preview] update VM image to match gen97 (#17554)
Ref: https://github.com/gitpod-io/gitpod-packer-gcp-image/releases/tag/gitpod-k3s-202305091902
2023-05-10 07:28:55 +08:00
Robo Quat
2cd57728ae
update index (#17474)
Co-authored-by: roboquat <roboquat@users.noreply.github.com>
2023-05-08 18:46:46 +08:00
Kyle Brennan
f3d36817da
[loadgen] update docs to support ws-manager-mk2 (#17524) 2023-05-06 09:40:44 +08:00
Wouter Verlaek
62c296e7b2
[ws-manager-mk2] Enable by default in preview envs (#17480)
* [ws-manager-mk2] Enable by default in preview envs

* Enable in pull request template
2023-05-05 21:17:43 +08:00
Kyle Brennan
99eb2593d5
[test] Fix workspace integration tests (#17222)
* [tests] unique ContextURL for commit only

* [tests] include std output in the error message for commit

Sometimes commit fails with status 1 w/o error output...so it's helpful to look at StdOut

* [tests] Fix TestGitActions by using the test case context

Prior to this, createWorkspace was working, but getWorkspace could not find the created workspace.

* [test] bypass exit code 1 on `git commit` with `--allow-empty`

* [test] Fix gcloud auth, do setup before auth

* Show all output

Might remove later...

* [test] avoid using deleted user, identity, and token

* [test] add organizationId to CreateWorkspaceOptions

It's expected on the Typescript side:
90b7d65858/components/server/src/workspace/gitpod-server-impl.ts (L1227-L1235)

* [test] orgId is required on createWorkspace

But sometimes there's no team 🤷

* [test] fix git context tests

We use UBP now, there is no more unleashed.

Also, remove the "ff" feature flag code (which was for PVC). It was mutating the username, resulting in Code 460 errors on createWorkspace

* [test] Use example test as the example

* [test] fix context tests when run as gitpod-integration-test user

* [test] clean-up

* [test] wait for workspaces to stop

Tests intermittently fail with  to avoid intermittent failures

* [test] add code owners

This way, we can assert tests are passing for all teams prior to merging

* [test] limit # of tests that can run in parallel

* [test] no parallel tests

Test to see if flakeyness goes away...
...and bump the timeout because we reduced parallel runs

* [preview] update the VM image to have parity with production

This:
1. updates from K3s 1.23 to 1.26
2. requires that we remove PodSecurityPolicy changes (as it's no longer supported)
3. resolves intermittent disk pressure issues

* [preview] no PSP in support of VM image update

* We were getting PSP from rook/ceph, which I think was for PVC
* We were getting PSP from the monitoring-satellite

* [test] don't wait for workspace stop with git_test.go, we're testing git actions.

Why? We miss state transitions, it's not guaranteed each one will be returned, and there are other tests waiting.

For example, in the below log, we miss INITIALIZING, RUNNING, and STOPPING.

 workspace.go:369: attempt to create the workspace as user 0565bb3c-e724-4da9-84fb-22e2a7b23b8c, with context github.com/gitpod-io/gitpod-test-repo/tree/integration-test/commit
    workspace.go:411: attempt to get the workspace information: gitpodio-gitpodtestrepo-nscsowy1njb
    workspace.go:423: not preparing
    workspace.go:432: got the workspace information: gitpodio-gitpodtestrepo-nscsowy1njb
    workspace.go:460: wait for workspace to be fully up and running
    workspace.go:569: prepare for a connection with ws-manager
    workspace.go:590: established for a connection with ws-manager
    workspace.go:598: check if the status of workspace is in the running phase: 462f1325-3019-4547-8666-508e8353335e
    workspace.go:631: status: 462f1325-3019-4547-8666-508e8353335e, PENDING
    workspace.go:598: check if the status of workspace is in the running phase: 462f1325-3019-4547-8666-508e8353335e
    workspace.go:631: status: 462f1325-3019-4547-8666-508e8353335e, PENDING
    workspace.go:598: check if the status of workspace is in the running phase: 462f1325-3019-4547-8666-508e8353335e
    workspace.go:631: status: 462f1325-3019-4547-8666-508e8353335e, CREATING
    workspace.go:598: check if the status of workspace is in the running phase: 462f1325-3019-4547-8666-508e8353335e
    workspace.go:631: status: 462f1325-3019-4547-8666-508e8353335e, CREATING
    workspace.go:598: check if the status of workspace is in the running phase: 462f1325-3019-4547-8666-508e8353335e
    workspace.go:631: status: 462f1325-3019-4547-8666-508e8353335e, CREATING
    workspace.go:598: check if the status of workspace is in the running phase: 462f1325-3019-4547-8666-508e8353335e
    workspace.go:504: waiting for stopping the workspace: 462f1325-3019-4547-8666-508e8353335e
    workspace.go:514: attemp to delete the workspace: 462f1325-3019-4547-8666-508e8353335e
    workspace.go:797: confirmed the worksapce is stopped: 462f1325-3019-4547-8666-508e8353335e, STOPPED
    workspace.go:538: successfully terminated workspace
    git_test.go:172: failed to wait for the workspace to start up: cannot wait for workspace: context deadline exceeded

* [preview] retry installing trust-manager

And use trust-manager from the packer image

* [test] clarify USER_TOKEN value for preview environments

* Cleanup

* [preview] remove commented out yaml related to PodSecurityPolicy
2023-05-04 04:07:41 +08:00
Kyle Brennan
47d1412e95
[preview] force gce when providing infrastructure, avoid harvester (#17475)
* [preview] force gce, no harvester

* [preview] default to using spot for GCE VMs

* [preview] bump sizes up now that we're using spot

...and actually use spot by changing the default for gce_use_spot

We'll address the disk pressure issues (which cause pods to evict on install, but eventually succeed) in a separate PR.
2023-05-04 01:54:42 +08:00
Thomas Schubart
f77c23605b
[wsman-mk2] Schedule on non experimental nodes (#17481)
* [wsman-mk2] Schedule on non experimental nodes

* [wsman-mk2] Remove experimental label from preview nodes
2023-05-03 19:43:41 +08:00
Robo Quat
ae59069ecf
update index (#17443)
Co-authored-by: roboquat <roboquat@users.noreply.github.com>
2023-05-02 14:37:40 +08:00
Wouter Verlaek
f1432b1153
[ws-manager-mk2] Run integration tests against mk2 by default in GHA (+ preview fixes) (#17393)
* Clarify inputs

* Default tests to use mk2

* fix

* Improve inputs

* Remove cut, latest

* Remove previewctl hash

* Apply namespaces first

* Output if mk2 is used

* Wait for mk2 deploy

* Fix image-builder-mk3-wsman no longer used

* Fix: catch failure when grep matches no files
2023-05-01 22:43:40 +08:00
Sven Efftinge
24b1408ccc
[previewctl] print admin link (#17427) 2023-04-28 19:25:37 +08:00
Anton Kosyakov
7bde75d29d
internal analytics endpoint (#17389)
* internal analytics endpoint

to prevent triggering rate limitting on analytics from internal components
see https://gitpod.slack.com/archives/C02EN94AEPL/p1682493547309509

* add AnalyticsPort to service and modify network policy

* include all internal components

* fully qualified service reference

---------

Co-authored-by: Pudong <tianshi8650@gmail.com>
2023-04-27 15:50:35 +08:00
Manuel Alejandro de Brito Fontes
c407cafe2e
Add new github action to update container images digest (#17349)
* Add new github action to update container images digest

* Add latest tag to dockerfiles

* Update .github/workflows/update-image-digest.yml

Co-authored-by: Milan Pavlik <milan@gitpod.io>

---------

Co-authored-by: Milan Pavlik <milan@gitpod.io>
2023-04-26 21:13:34 +08:00
Pudong
da6b19e64b
using hardcode seed vault in preview environment (#17374) 2023-04-26 15:17:47 +08:00
Wouter Verlaek
96100e9975
[ws-manager-mk2] Always send OnReconcile events (#17376) 2023-04-26 00:08:46 +08:00
Gero Posmyk-Leinemann
179e55b98a
[preview] Configure with-dedicated-emulation (#17337)
* [preview] Disable stripe secrets on GITPOD_WITH_DEDICATED_EMU

* [preview] Disable linkedin secrets on GITPOD_WITH_DEDICATED_EMU

* [dashboard, db] Don't show onboarding dialogues for "admin-user"

* [preview] Configure stripe/linkedin in the same code block
2023-04-25 16:04:46 +08:00
Milan Pavlik
1cdb7ab142
[installer] Remove OIDC secret from public-api WEB-206 (#17331)
* Fix

* retest

* [installer] Remove OIDC secret from public-api

* fix

* remove ci secret

* fix
2023-04-24 20:51:45 +08:00
Alex Tugarev
b7872c1372
Remove deprecated and unused getPortAuthenticationToken method (#17321) 2023-04-24 16:02:45 +08:00
Filip Troníček
29bb626d22
Fix typo in log message (#17277) 2023-04-20 23:39:42 +08:00
Manuel Alejandro de Brito Fontes
891cd5417d
Update k8s dependencies to v0.26.2 (#17211)
* Update k8s dependencies to v0.26.2

* Update controller-runtime to v0.14.6

* Update cloud storage
 https://github.com/googleapis/google-cloud-go/issues/6857

* Update copy options

* Update wolfi image

* Remove controller-runtime replace directives

* Fix integration tests
2023-04-18 03:59:49 +08:00
Milan Pavlik
bce4700f97
[installer] Remove payment endpoint - WEB-144 (#17233)
* [installer] Remove payment endpoint

* fix

* fix

* Fix
2023-04-17 19:48:49 +08:00
Anton Kosyakov
bf65f38734
[proxy] add analytics endpoint 2023-04-17 10:28:19 +02:00
Kyle Brennan
0a85a2c14c
[preview] Use cert-manager namespace for satellite, not certmanager namespace (#17210)
* [preview] Use cert-manager namespace, not certmanager

* [preview] set proper namespace for cert-manager in obs-installer config
2023-04-14 20:37:54 +02:00
Jan Keromnes
f7101c5aed
Implement user account verification with LinkedIn during onboarding (#17074)
* Implement user account verification with LinkedIn during onboarding

* updating connect with linked-in banner

* removing unused imports

* Store token, fix binding

* Refactor LinkedInToken to LinkedInProfile

* Actually write the LinkedIn secret to the server config

* Fetch LinkedIn user profile and email address

* Add creationTime column to d_b_linked_in_profile

* Add more debug logging

* Fix LinkedIn API calls, mount LinkedInProfileDB

* Also bind LinkedInProfileDB

* Add LinkedIn scope r_liteprofile

* Enhance LinkedIn profile retrieval, store the profile, ensure uniqueness

* Align with UX spec and complete onboarding flow

* Prevent the LinkedIn button from auto-submitting the onboarding form

* Address nits (LinkedInService to /src and minor spacing)

---------

Co-authored-by: Brad Harris <bmharris@gmail.com>
2023-04-12 16:39:52 +02:00
Manuel Alejandro de Brito Fontes
27979c9395
Update go dependencies (#17101)
* Update go dependencies

Signed-off-by: Manuel de Brito Fontes <aledbf@gmail.com>

* Update runc to v1.1.5

* Update docker cli to v23.0.2+incompatible

---------

Signed-off-by: Manuel de Brito Fontes <aledbf@gmail.com>
2023-04-12 10:03:52 +02:00
Milan Pavlik
909c3ff47f
[dev] Add redis to workspace image (#17174)
* [dev] Add redis to workspace image

* Fix
2023-04-12 09:56:51 +02:00
Huiwen
8f2f1e7409
[preview] add local ssh dns to preview env (#17117) 2023-04-01 11:29:41 +02:00
Jan Keromnes
0dc417e54a
Configure LinkedIn in preview environments (#17110) 2023-03-31 14:03:40 +02:00
Wouter Verlaek
db756b354e
[loadgen] Resubscribe and log ids (#17080) 2023-03-29 20:44:39 +02:00
Anton Kosyakov
d405f4bdfd
[jb] support testing of stable GW (#17073) 2023-03-29 15:47:39 +02:00
Kyle Brennan
235655e250
[dev image] update base image (#17019)
* [dev image] fix prebuilds & include build output of dev/* in Github Action Summary

Fixes prebuilds by leveraging the latest workspace-full.

It also adds `pup` to our dev image, so we can more parse HTML files using CSS selectors.

Lastly, it adds the output of dev/* builds to our Github Action summary, while removing the output from dev/image, which is too large.

* A couple more dev-environment references
2023-03-28 19:23:26 +02:00
Wouter Verlaek
c032c4f5f1
[preview] Fix preview env, remove /tmp/license refs (#17047) 2023-03-27 21:04:25 +02:00
Manuel Alejandro de Brito Fontes
172e1464fa
Remove references to enterprise licenses (#17008)
Signed-off-by: Manuel de Brito Fontes <aledbf@gmail.com>
2023-03-26 00:38:24 +01:00
Wouter Verlaek
ea5c7a6aab
[e2e] Support and fixes for mk2 e2e tests (#16990)
* [e2e] Support and fixes for mk2 e2e tests

* Fix GHA mk2 flag, add experimental label

* Add if

* Fix slack msg

* Empty-Commit again

---------

Co-authored-by: Kyle Brennan <kylos101@gmail.com>
2023-03-24 23:42:23 +01:00
Kyle Brennan
a2176718ec
[dev image] update to Jammy (#16718)
* [dev image] update to Jammy

Ref: https://github.com/gitpod-io/workspace-images/pull/1017

no more `python-dev`

ref:
https://github.com/lewagon/data-setup/issues/219#issuecomment-1207519811
https://wiki.termux.com/wiki/No_more_-dev_packages

* [dev image] update images latest dev image

* [ws-manager] avoid false positive linter errors

* [ws-daemon] fix ineffectual assignment for err

golangci-lint is catching more errors since upgrading to go 1.19.5

* Update to more recent gcloud

* Moar timeout
2023-03-22 19:37:14 +01:00