Change-Id: I4cff55299a547f783e60534e1dea4ca0a698f9d5
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/320439
Reviewed-by: Isaac Moore <isaac.moore@instructure.com>
Build-Review: Isaac Moore <isaac.moore@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Change-Id: Ia95c8f3e3b47e2e4e51bcc32749698219dd94d22
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/320436
Reviewed-by: Isaac Moore <isaac.moore@instructure.com>
Build-Review: Isaac Moore <isaac.moore@instructure.com>
Build-Review: James Butters <jbutters@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
[force-crystalball]
if a new spec file is added the specTimings will return
null because there are no timings available in redis causing
the build to fail. Instead let's echo a different message
when there are no timings.
flag = none
Test Plan:
Jenkins passes
Change-Id: I8635dbefb17adc5863fda2b4d5680672915298c4
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/320425
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: Andrea Cirulli <andrea.cirulli@instructure.com>
Build-Review: Andrea Cirulli <andrea.cirulli@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
setup is not necessary for node 00 since it is running on the
main node that has already done the setup.
flag = none
Test Plan:
-Jenkins passes
Change-Id: Ie0290a687a2373ce82e15f761053434db1e41b5d
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/289284
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: Bobby Buten <bobby.buten@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
if all tests files in a dir are included in the crystalball
prediction, just run the parent dir to reduce arguments sent
to rspecq.
flag = none
fixes: DE-1073
Change-Id: I816d2f00e221b74652ed485e414866372def7dcb
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/285949
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: Aaron Ogata <aogata@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
Switches from standalone containers to explicit node+hub config
Selenium 4 has some differences in handling stale elements that we
should be aware of moving forward
closes OUT-4988
flag=none
[skip-stages=Flakey Spec Catcher]
Test-plan:
- make sure screenshots can happen for failures
- retrigger a few times and make sure things pass
- verify build summaries are intact
- verify FSC can still run seleniums
- verify local selenium running still works
- firefox / chrome / edge where applicable
- verify docker selenium running still works
- firefox / chrome / edge where applicable
Change-Id: I8f2fe5a34d712b5ccd7191bae7a9aeeb6f1f473d
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/284811
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: James Butters <jbutters@instructure.com>
QA-Review: Robin Kuss <rkuss@instructure.com>
Product-Review: Brian Watson <bwatson@instructure.com>
flag=none
Test-plan:
- crystalball-noisy text updates when suite re-run occurs
Change-Id: I43b3d88da3e179d76d5a1346cecca78ab287a183
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/285339
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: James Butters <jbutters@instructure.com>
QA-Review: Brian Watson <bwatson@instructure.com>
Product-Review: Brian Watson <bwatson@instructure.com>
remove poc/test-suite build trigger and small modifications
to Jenkinsfile.rspecq to ensure full builds don't get skipped.
flag = none
Change-Id: I5520800f90af0362e85551650b98cea388c09ca6
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/285058
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: Bobby Buten <bobby.buten@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
Change-Id: I57dcf4bd2f0f0f06e6dad89562b0828595eb409d
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/284284
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: Bobby Buten <bobby.buten@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
rather than trying to calculate the build times, use the new rspecq
version that now adds the buildTimes to redis.
flag = none
Change-Id: I40544859e2be2831f140fa45387922036af8cd8c
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/284181
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: Bobby Buten <bobby.buten@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
This reverts commit b7c3250955.
Reason for revert: needs more work
Change-Id: Id7ebb79b11315d5ea89b473d9caca837230e6c90
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/283268
Reviewed-by: Aaron Ogata <aogata@instructure.com>
Tested-by: James Butters <jbutters@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
in order to activate crystalball for selenium on regular builds
we need this to make sure rspec is not. Rspec will still run
full builds without crystalblal while we evaluate
flag = none
Change-Id: I51c25f15f68d82826e6cacc2d5c911f8482ee31e
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/283995
Reviewed-by: Aaron Ogata <aogata@instructure.com>
Reviewed-by: Brian Watson <bwatson@instructure.com>
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
missing a new line between selenium tests and rspec tests
flag = none
Change-Id: Ieb452692a450653be5ac35de19ed47e8ba8698f3
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/283939
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
Reviewed-by: Bobby Buten <bobby.buten@instructure.com>
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
we need to split the predictions by seleniums and non-selenium
flag = none
refs: DE-1007
Test Plan:
-Jenkins regular build is unaffected
-with ruby changes to only rspec
-only rspec tests
-no selenium tests run
-with only selenium changes
-only selenium tests run
-no rspec tests
-with changes to both selenium and rspec
-both rspec and selenium tests run
-reports to crystalball-noisy relfect rspec and selenium
Change-Id: Id9ecc0d1c93128515386d18796f84dfd8dfb0067
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/283770
Reviewed-by: Brian Watson <bwatson@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
flag=none
Test-plan:
- run a patchset with different value set for crystalball map
- previous timestamp should appear in #crystalball-noisy
Change-Id: I206e2c62bcfc00f0f8bc8c8ad0b1262d28caab4f
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/283794
Reviewed-by: Kyle Rosenbaum <krosenbaum@instructure.com>
QA-Review: Brian Watson <bwatson@instructure.com>
Product-Review: Brian Watson <bwatson@instructure.com>
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
refs: DE-1011
Test Plan:
-Jenkins passes
-no tests are actually ran without crystalball prediction
-add small ruby change: notice tests do get ran
Change-Id: Iec4adc84f109a6fa4fadc0539e1c0b138e954bb7
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/283530
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: Brian Watson <bwatson@instructure.com>
QA-Review: James Butters <jbutters@instructure.com>
Product-Review: James Butters <jbutters@instructure.com>
- change '.' to 'New File Detected'
- Add colors to different levels of spec runs based on quantity
flag=none
Test-plan:
- verify things still work
- try messages of different loads
Change-Id: Ie0a6c05bf0c9422c4288d51aa9b048e46190c683
Reviewed-on: https://gerrit.instructure.com/c/canvas-lms/+/282807
Tested-by: Service Cloud Jenkins <svc.cloudjenkins@instructure.com>
Reviewed-by: James Butters <jbutters@instructure.com>
QA-Review: Brian Watson <bwatson@instructure.com>
Product-Review: Brian Watson <bwatson@instructure.com>
James Butters