Fix gitlab v15 token refresh

[KSauter]

No description provided.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 99.16%. Comparing base (50fe808) to head (32c0d24).
⚠️ Report is 19 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff            @@
##             master     #596   +/-   ##
=========================================
  Coverage     99.16%   99.16%           
- Complexity     1910     1912    +2     
=========================================
  Files           301      301           
  Lines          6072     6078    +6     
=========================================
+ Hits           6021     6027    +6     
  Misses           51       51           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[KSauter]

⚠️ This will not fix already broken entries, or expired tokens which have no expire date in the database.

For this, an additional migrate task would be required.

[Fahl-Design]

interesting find and fix, is creating/register a new user from "oauth" still possible?
I will check it tomorrow

[Fahl-Design]

looks good to me, but please fix the redirect_route

[Fahl-Design]

Is it still possible to register a user with oauth flow? (route: register_gitlab_check (\Buddy\Repman\Controller\OAuth\GitLabController::registerCheck) will create/login users \Buddy\Repman\Controller\OAuth\OAuthController::createAndAuthenticateUser

edit:
this breaks the initial redirect to create the user

[KSauter]

To keep the redirect_url the same in the initial request for the oauth token which is stored and for the token refresh, i changed the config here.

I changed the route for registration to the register_gitlab_check in d22367b

[Fahl-Design]

👍

[belprixx]

🆙 please

[slappyslap]

Hi,
This PR works great, we just need to delete the record for gitlab in "user_oauth_token" table in the database

[babbassp]

+1. Updated code with these changes and I'm able to synchronize packages again. Thanks @KSauter and @Fahl-Design for addressing this!

[edit]
Spoke too soon. Still gives a bad request...

[temp]

Stumbled upon this PR after I got errors in repman after upgrading to gitlab 15.1.
Applied the changes, emtpied the user_oauth_token table, and it worked like a charm.
However, today it is back to errors on updates, with a different error:

Error: An error occurred while refreshing the access token: Bad Request

Anyone else experiencing this?

[temp]

The error from gitlab is:

{"error":"invalid_grant","error_description":"The provided authorization grant is invalid, expired, revoked, does not match the redirection URI used in the authorization request, or was issued to another client."}

[xvilo]

We've just upgraded our GitLab to 15.x as well and are also seeing these issues. Yesterday I was able to fix it by adding an expires timestamp (might want to set a date by default in the next version). But are also now seeing the bad request error.

@temp / @KSauter / @babbassp do we need more work on this PR to get everything working? Or can we see if this one can be merged already, and create a new PR for other issues regarding the token refreshing for GitLab?

[temp]

@xvilo like I stated in this thread (or another one? don't know), the PR works, but for us it still requires manual intervention.
Need to clear the user-token table, call the "add repo" page, afterwards I can synchronize packages for a few minutes.
So it seems to me that something is still missing...

[KSauter]

@temp are you sure that you are running the newest version of this MR? It works for me since Jun without any manual steps.

@xvilo if you set the expire date before you applied this patch, the refreshed tokens in your databare are broken. Please test if applying this patch and deleting the tokens from the DB will help. You have to go to the "app package" => "Gitlab" process to generate a new token after you updated everyting.

[temp]

@KSauter doh. I really had an error in the changed files. Will report later if it works now.
But one thing is still weird, I deleted everything from user_oauth_token table, afterwards logged in again, and I wasn't able to sync, because of "Missing OAuth Token". Had to jump to add package and select gitlab, afterwards the sync worked.
Shouldn't the OAuth token be fetched automatically?

[xvilo]

So, to add, on 31 Aug 2022 we started using this branch (custom deployed fork on Kubernetes). Which, after removing the OAuth tokens from DB worked fine again.

HOWEVER, I'm currently looking at it (around 2 days later) and seeing these again:

I suspect this PR is not fully ready yet, so this might confirm @temp's suspicions

[slappyslap]

Hey, when i reboot all the virtual machine of repman (Installation with ansible) the error with token will apear an another time, and i need to clear the user_oauth_token tabke again and retry the authentification with gitlab and it work again

[f3l1x]

Confirmed @slappyslap comment.

1. DELETE FROM "public"."user_oauth_token" WHERE "id" = 'yourtokenid';
2. Go to organization -> add package -> gitlab and authenticate again.
3. Works.

[mv-ics]

@f3l1x Thx for the workaround. For people like me, running this in docker, there is a simple way to run the query using the console:

bin/console doctrine:query:sql "<QUERY HERE>"

[mikk150]

Seems to work fine for 55 days

[xuandung38]

Any update ?

[prey87]

Any update ?

[slappyslap]

I still have a problem, when i reboot the VM (ansible install), i need to clear the token and reconnect to gitlab every reboot, but i'm not able to reproduce this locally on my mac, I'm going to investigate with clone of the VM

[xvilo]

Hi folks, how do we get this merged? /cc @akondas

[moay]

This bug is awfully annoying. We keep running into this on an near to every day basis. Is there any way we can speed this up here?

Does this PR work with the current code base? If so, why can't we merge it?

[xvilo]

AFAIK @akondas is the only one with write access, and he seems to have stopped responding on any issue or PR.

We can create a fork and apply the patches ourselves, but this will only help with self-hosted instances of Repman

[konanado]

Nice project, but we are using Packeton with GitLab synchronization and merge request review feature. But it would be nice to have this features here too.

[slappyslap]

We plan to switch to packeton too, any tips for me ? Le ven. 28 juil. 2023 à 16:01, konanado ***@***.***> a écrit :

…

Nice project, but we are using Packeton <https://github.com/vtsykun/packeton> with GitLab synchronization and merge request review feature. But it would be nice to have this features here too. — Reply to this email directly, view it on GitHub <#596 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ADTZEPZSVIKZ44E553ARI3DXSPA4ZANCNFSM5ZJPSIOA> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[xvilo]

It seems Packaton is not easy to scale horizontally, as there is no option to save package dists to S3, they need to be on disk. So doing this, requiring something like NFS shares or ReadWriteMany PVC volumes on Kubernetes. In case you don't need to scale that way, it's not such of a big issue, but for us it might be

[xvilo]

It's really weird, it did work for quite a while. But since a week or two (no update on GitLab's side) it's not working anymore and we manually have to create a new token. I'm a bit confused by this TBH

[mv-ics]

Just to leave this here: Packeton is really easy to setup. We have a setup where we run the docker version behind Caddy as a reverse proxy. Took me round about 2 hours to figure everything out + get it running. Sad to see Repman go, but it just got too annoying to revive the token every 2 days.

[Sevyls]

any update?

[xvilo]

I'd like to point out that:

• This is still an issue
• The patch still doesn't fully fixes it