infrastructureProject
ActivePublic

Watchers

  • This project does not have any watchers.

Properties

Description

QA specific infrastructure

Recent Activity

Yesterday

kparal moved T953: support wildcards in FMN filters from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Fri, May 26, 4:25 PM · Restricted Project, infrastructure
kparal added a project to T953: support wildcards in FMN filters: Restricted Project.

Pull request here: https://github.com/fedora-infra/fmn/pull/197

Fri, May 26, 4:24 PM · Restricted Project, infrastructure
kparal created T953: support wildcards in FMN filters.
Fri, May 26, 2:19 PM · Restricted Project, infrastructure

Tue, May 23

kparal reopened T835: fedora-phabricator repo is not available for Fedora 25 as "Open".

Our documentation links to https://repos.fedorapeople.org/repos/tflink/phabricator/ . I can change that, but kanarip's packages don't work with our Phab instance:

$ arc list
Exception
[cURL/77] (https://phab.qa.fedoraproject.org/api/user.whoami) <CURLE_SSL_CACERT_BADFILE> The SSL CA Bundles that we tried to use could not be read or are not formatted correctly.
(Run with `--trace` for a full exception trace.)
$ arc list --trace
 ARGV  '/usr/share/arcanist/bin/../scripts/arcanist.php' 'list' '--trace'
 LOAD  Loaded "phutil" from "/usr/share/libphutil/src".
 LOAD  Loaded "arcanist" from "/usr/share/arcanist/src".
Config: Reading user configuration file "/home/kparal/.arcrc"...
Config: Did not find system configuration at "/etc/arcconfig".
Working Copy: Reading .arcconfig from "/home/kparal/devel/taskotron/libtaskotron/.arcconfig".
Working Copy: Path "/home/kparal/devel/taskotron/libtaskotron" is part of `git` working copy "/home/kparal/devel/taskotron/libtaskotron".
Working Copy: Project root is at "/home/kparal/devel/taskotron/libtaskotron".
Config: Did not find local configuration at "/home/kparal/devel/taskotron/libtaskotron/.git/arc/config".
>>> [0] <conduit> user.whoami() <bytes = 117>
>>> [1] <http> https://phab.qa.fedoraproject.org/api/user.whoami
<<< [1] <http> 297,727 us
<<< [0] <conduit> 297,936 us
Tue, May 23, 9:40 AM · Restricted Project, infrastructure

Mon, May 22

tflink closed T796: arcanist does not require php correctly as "Resolved".

This is not valid anymore with either kararip's COPR or the packages up for review.

Mon, May 22, 7:19 PM · Restricted Project, infrastructure
tflink closed T835: fedora-phabricator repo is not available for Fedora 25 as "Resolved".

Until the package reviews go through, use kararip's copr. https://copr.fedorainfracloud.org/coprs/kanarip/phabricator/

Mon, May 22, 7:18 PM · Restricted Project, infrastructure

Fri, May 12

tflink added a revision to T951: Decouple ExecDB from Buildbot: D1150: Decouple ExecDB from Buildbot.
Fri, May 12, 2:30 PM · infrastructure, execdb
tflink created T952: Rework taskmaster to work with new ExecDB.
Fri, May 12, 2:30 PM · infrastructure, execdb
tflink created T951: Decouple ExecDB from Buildbot.
Fri, May 12, 2:29 PM · infrastructure, execdb

Apr 24 2017

tflink added a comment to T948: fedmsg-meta: Unhandled taskotron type u'compose'.
In T948#13684, @roshi wrote:
Apr 24 2017, 3:27 PM · infrastructure
roshi added a comment to T948: fedmsg-meta: Unhandled taskotron type u'compose'.

'compose' is in the canonical list of accepted types: https://pagure.io/taskotron/libtaskotron/blob/develop/f/libtaskotron/check.py#_244

Apr 24 2017, 2:12 PM · infrastructure
mkrizek added a comment to T948: fedmsg-meta: Unhandled taskotron type u'compose'.

I'm not exactly sure what the problem is, I didn't know we even use that item type.

Apr 24 2017, 6:58 AM · infrastructure
kparal created T948: fedmsg-meta: Unhandled taskotron type u'compose'.
Apr 24 2017, 6:46 AM · infrastructure

Apr 21 2017

mkrizek added a comment to T881: all gzipped artifacts are served as text/plain.

Gzipping disabled on dev for the modularity demo next week.

Apr 21 2017, 10:56 AM · infrastructure
kparal closed T944: pkgs.fedoraproject.org not reachable from our minions as "Resolved".

I can confirm this is now working. No need for modularity-testing-framework workaround anymore. Thanks, @puiterwijk!

Apr 21 2017, 10:42 AM · infrastructure
puiterwijk added a comment to T944: pkgs.fedoraproject.org not reachable from our minions.

The fedpkg config change should not be required to work anymore since I have just updated DNS so the internal IP is used for access to pkgs.fp.o, which should resolve this issue in the short term.

Apr 21 2017, 8:56 AM · infrastructure
kparal updated subscribers of T944: pkgs.fedoraproject.org not reachable from our minions.
Apr 21 2017, 7:48 AM · infrastructure
kparal added a comment to T944: pkgs.fedoraproject.org not reachable from our minions.

After reading the PR response and looking over the bug, I think this will take a longer time to resolve. However, you can do a temporary workaround in modularity-testing-framework - copy the fedpkg config to a temp dir, modify it and then use fedpkg --config. See https://pagure.io/fedpkg/pull-request/120#request_diff to see the necessary changes. I tried it and it works.

Apr 21 2017, 7:47 AM · infrastructure
phracek added a comment to T944: pkgs.fedoraproject.org not reachable from our minions.

It should be solved ideally during Monday 24th.
We will build huge set of modules during Tuesday 25th and testing would go over taskotron.

Apr 21 2017, 6:56 AM · infrastructure

Apr 20 2017

tflink added a comment to T944: pkgs.fedoraproject.org not reachable from our minions.

I've submitted a PR to fix the issue:

Apr 20 2017, 7:59 PM · infrastructure
tflink added a comment to T944: pkgs.fedoraproject.org not reachable from our minions.

Filed issue with fedpkg to fix the problem:
https://pagure.io/fedpkg/issue/119

Apr 20 2017, 7:34 PM · infrastructure
mkrizek added a comment to T881: all gzipped artifacts are served as text/plain.

So I fixed it for html. It's not pretty but it should do for this particular use case, for now. Leaving open until I come up with a proper solution.

Apr 20 2017, 5:06 PM · infrastructure
phracek added a comment to T944: pkgs.fedoraproject.org not reachable from our minions.

This will be definitely shown in the next Modularity demo. Sprint #29.
Please fix it asap. We will do hackfest Tue 25 and would be fine to fix the issue before it.

Apr 20 2017, 3:02 PM · infrastructure
kparal assigned T944: pkgs.fedoraproject.org not reachable from our minions to tflink.
Apr 20 2017, 2:50 PM · infrastructure
kparal created T944: pkgs.fedoraproject.org not reachable from our minions.
Apr 20 2017, 2:50 PM · infrastructure
kparal added a comment to T876: i686 to be migrated to Alternative Architecture beginning with Fedora 26.

Fix confirmed with depcheck:
https://taskotron.fedoraproject.org/taskmaster/builders/x86_64/builds/468835

Apr 20 2017, 2:48 PM · infrastructure, Restricted Project, libtaskotron
kparal closed T876: i686 to be migrated to Alternative Architecture beginning with Fedora 26 as "Resolved".

This should be now fixed everywhere:
https://infrastructure.fedoraproject.org/cgit/ansible.git/commit/?id=cddf101acb9d67a099ae3cdf6ce184692c1f0a93

Apr 20 2017, 2:39 PM · infrastructure, Restricted Project, libtaskotron
kparal claimed T876: i686 to be migrated to Alternative Architecture beginning with Fedora 26.

Found it. Example: https://taskotron.fedoraproject.org/taskmaster/builders/x86_64/builds/468182

[depcheck] 20:56:06 WARNING Mirror Error:  None Status code: 404 for http://infrastructure.fedoraproject.org/pub/fedora-secondary/updates/testing/24/i386/repodata/repomd.xml
[libtaskotron] 20:56:06 CRITICAL Traceback (most recent call last):
Exception: Librepo Error 19: Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried
Apr 20 2017, 1:17 PM · infrastructure, Restricted Project, libtaskotron
kparal added a comment to T876: i686 to be migrated to Alternative Architecture beginning with Fedora 26.

Tim, can you point me to some of the crashes? I believed all of this was fixed.

Apr 20 2017, 1:10 PM · infrastructure, Restricted Project, libtaskotron
kparal added a comment to T881: all gzipped artifacts are served as text/plain.

It also affects task-modularity-testing-framework, which reports in html.

Apr 20 2017, 11:46 AM · infrastructure
mkrizek claimed T881: all gzipped artifacts are served as text/plain.

We need to fix this sooner than later since this will impact dist git tasks that will have reports in html.

Apr 20 2017, 11:24 AM · infrastructure

Apr 19 2017

tflink added a comment to T876: i686 to be migrated to Alternative Architecture beginning with Fedora 26.

As far as I know, this is done. The biggest problem is that now the non-26 builds of i686 are failing for the same reason that the 26+ builds used to fail - can't find the correct URL

Apr 19 2017, 6:41 PM · infrastructure, Restricted Project, libtaskotron

Mar 21 2017

tflink closed T931: disable libtaskotron.readthedocs.io as "Resolved".

Project has been deleted

Mar 21 2017, 2:13 PM · Restricted Project, infrastructure
kparal created T931: disable libtaskotron.readthedocs.io.
Mar 21 2017, 11:21 AM · Restricted Project, infrastructure
kparal lowered the priority of T929: production resultsdb fails to run from "Unbreak Now!" to "High".

Production resultsdb seems to work better now, so lowering the priority. However, since we can't track how many tasks failed to post results (since we don't fail them if they do so), it's hard to guess how much uptime do we actually have. Maybe we should start failing jobs if resultsdb responds 5xx? Or retry a few times and fail eventually?

Mar 21 2017, 11:07 AM · Restricted Project, resultsdb, infrastructure

Mar 20 2017

kparal reassigned T876: i686 to be migrated to Alternative Architecture beginning with Fedora 26 from kparal to tflink.

D1164 has been pushed even to production. We now need a new libtaskotron release deployed to dev/stg/prod.

Mar 20 2017, 11:47 AM · infrastructure, Restricted Project, libtaskotron

Mar 17 2017

mkrizek moved T928: atomic/cloud checks fail silently from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Mar 17 2017, 5:22 PM · infrastructure, Restricted Project
kparal added a comment to T929: production resultsdb fails to run.

Googlebot stopped hammering us, new robots.txt work. They are present in ansible now. However, it didn't solve the problems, resultsdb (and execdb) is down again.

Mar 17 2017, 7:25 AM · Restricted Project, resultsdb, infrastructure

Mar 16 2017

roshi added a comment to T928: atomic/cloud checks fail silently.

I'm updating the tasks to throw an exception if it can't get the image.

Mar 16 2017, 9:11 PM · infrastructure, Restricted Project
kparal closed T926: drop-down list of Taskotron instances on main web page as "Resolved".

Deployed to production. Thanks Lukas and Martin!

Mar 16 2017, 1:23 PM · papercuts, Restricted Project, infrastructure
kparal added a comment to T929: production resultsdb fails to run.

I have deployed new robots.txt: https://taskotron.fedoraproject.org/robots.txt
We should see whether it helps in a day or so (once Google refreshes that file). Btw, these are the current per-hour access numbers from Google:
2568
2341
3083
4336
3213
4225
3738
So about 3300 hits per hour on overage, 55 per minute. They are performed in bursts, though (ten or twenty simultaneous requests, then a pause, then again).

Mar 16 2017, 1:12 PM · Restricted Project, resultsdb, infrastructure
mkrizek removed a revision from T928: atomic/cloud checks fail silently: D1170: Update logic to parse compose metadata instead of having a hardcoded value..
Mar 16 2017, 1:04 PM · infrastructure, Restricted Project
mkrizek reopened T928: atomic/cloud checks fail silently as "Open".
In T928#13385, @tflink wrote:

I don't think that's a FAILED, honestly. If the images don't work - that's an execution error, not a test failure

Mar 16 2017, 10:58 AM · infrastructure, Restricted Project
kparal added a comment to T929: production resultsdb fails to run.

Today resultsdb_api seems to run somewhat (testcases work, but some tasks fail to post results). The frontend seems completely non-functional (testcases return Service Unavailable).

Mar 16 2017, 9:09 AM · Restricted Project, resultsdb, infrastructure
roshi added a commit to T928: atomic/cloud checks fail silently: rTRGR64231a152451: Fix hardcoded paths in cloud_compose_completed_msg.py. Fixes T928.
Mar 16 2017, 4:50 AM · infrastructure, Restricted Project
tflink added a comment to T928: atomic/cloud checks fail silently.

I don't think that's a FAILED, honestly. If the images don't work - that's an execution error, not a test failure

Mar 16 2017, 3:34 AM · infrastructure, Restricted Project
roshi closed T928: atomic/cloud checks fail silently as "Resolved".

I'd put this response in the task that was being called - as I thought it fit what "NEEDS_INSPECTION" was supposed to be. I've updated the task to report "FAILED" in these instances, so we'll see a failure in this case. Closing this issue.

Mar 16 2017, 2:54 AM · infrastructure, Restricted Project

Mar 15 2017

kparal added a revision to T928: atomic/cloud checks fail silently: D1170: Update logic to parse compose metadata instead of having a hardcoded value..
Mar 15 2017, 12:32 PM · infrastructure, Restricted Project
tflink added a comment to T929: production resultsdb fails to run.

A short term patch could be to increase the number of processes allocated to the wsgi application.

Mar 15 2017, 12:09 PM · Restricted Project, resultsdb, infrastructure
kparal moved T929: production resultsdb fails to run from Restricted Project Column to Restricted Project Column on the Restricted Project board.
Mar 15 2017, 10:07 AM · Restricted Project, resultsdb, infrastructure