Commit Graph

10 Commits

Author SHA1 Message Date
James Butters e906f03f5b metrics comparing crystalball vs non-crystalball builds
Change-Id: Ief34dade07be9f716d138c909f0f7e60730bcc75
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/282862
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: Aaron Ogata <aogata@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
2022-01-18 21:47:43 +00:00
James Butters 1634e7564f use new formatter to better caluclate number of nodes
flag = none

Change-Id: Ia3a5766acf100f3202b7d7667d4b026727a30b7a
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/282880
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: Aaron Ogata <aogata@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
2022-01-18 14:18:36 +00:00
James Butters 92e6b93b91 fix crystalball when prediction returns "."
Change-Id: I75f3618a45c733fad27a9f72daa88db303a2f837
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/282872
Reviewed-by: Brian Watson <bwatson@instructure.com>
QA-Review: Brian Watson <bwatson@instructure.com>
Product-Review: Brian Watson <bwatson@instructure.com>
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
2022-01-14 18:36:15 +00:00
Brian Watson ecf48fa9bb Add additional info to crystalball-noisy messages
- change '.' to 'New File Detected'
- Add colors to different levels of spec runs based on quantity

flag=none

Test-plan:
- verify things still work
- try messages of different loads

Change-Id: Ie0a6c05bf0c9422c4288d51aa9b048e46190c683
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/282807
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: James Butters <jbutters@instructure.com>
QA-Review: Brian Watson <bwatson@instructure.com>
Product-Review: Brian Watson <bwatson@instructure.com>
2022-01-14 16:14:24 +00:00
Brian Watson c5bf73c5cc Report crystalball predictions to crystalball-noisy in slack
flag=none

Test-plan:
- verify that crystalball-noisy messages are generated with correct
  jenkins and gerrit links

Change-Id: I172b3b236432a94bbc44d5767eef9cd34c843268
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/282774
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: James Butters <jbutters@instructure.com>
QA-Review: Brian Watson <bwatson@instructure.com>
Product-Review: Brian Watson <bwatson@instructure.com>
2022-01-13 19:41:02 +00:00
James Butters dcb9c45d3b don't run prediction in post-merge
do not run crystalball prediction in post-merge
and wrap in try/catch to not fail build while
still testing crystalball

flag = none

Test Plan:
-Jenkins passes

Change-Id: I33bb4ee2bf6107456e1d85614b0a3c9c994f1e2e
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/282773
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
Reviewed-by: Brian Watson <bwatson@instructure.com>
2022-01-13 17:45:11 +00:00
James Butters ee77da50ca run cyrstalball build silently
run crystalball build silently, in parallel to regular
builds.

flag = none

Test Plan:
-Jenkins passes
-proofs-of-concept/test-queue build runs same tests
-with ruby file change, proofs-of-concept/test-queue only
 runs crystalball predictions for selenium
 -regular test-queue still runs all tests

Change-Id: I243c096c9ac3fb2907d7b67272610663284aebc6
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/282684
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: Aaron Ogata <aogata@instructure.com>
Reviewed-by: Brian Watson <bwatson@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
2022-01-13 16:35:50 +00:00
James Butters 9e46664eaf Revert "Revert "rspecq/rspec separate build""
This reverts commit 7dd287adea.

Reason for revert: try again

Change-Id: Ie0eededa8465a7fb79bbd221c777646ab2640fa7
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/282036
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: Aaron Ogata <aogata@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
2022-01-12 18:21:47 +00:00
James Butters 7dd287adea Revert "rspecq/rspec separate build"
This reverts commit 276eb49f8e.

Reason for revert: Something in here is failing deploys

Change-Id: I615a90e6a4edf743ba47a2673bc14483ad141b3d
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/282032
Reviewed-by: Andrea Cirulli <andrea.cirulli@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
Tested-by: James Butters <jbutters@instructure.com>
2022-01-06 17:47:50 +00:00
James Butters 276eb49f8e rspecq/rspec separate build
run rspecq/rspec tests in separate sub-build.

flag = none
refs: DE-929

Test Plan:
-Jenkins passes
  -test count is consistent

Change-Id: Ia62730c32d1793d591555c0fd034538254efffc3
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/282016
Reviewed-by: Aaron Ogata <aogata@instructure.com>
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
2022-01-06 16:45:56 +00:00